Hierarchical processing method and device for data in data warehouse and computing equipment cluster
By creating and associated multiple desensitization strategies in the data warehouse, the problem of data hierarchical management cannot be implemented in the data warehouse, different visible categories of data on the same business table by different roles are realized, and the flexibility of data protection and management is improved .
Patent Information
- Application Number
- CN202310911713.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-12
- Filing Date
- 2023-07-24
- Publication Date
- 2024-11-12
AI Technical Summary
The prior art cannot implement hierarchical management of sensitive data in the data warehouse, resulting in different roles being unable to implement different visible categories when querying the same business table.
By creating multiple desensitization policies in the data warehouse and associating them with business tables, dynamically selecting appropriate desensitization policies for data processing based on user roles, thus achieving hierarchical management of data.
It realizes different visible scopes of data in the same business table by different roles, supports more refined data classification applications, and improves the flexibility of data protection and management.
Smart Images

Figure CN118940305A_ABST
Abstract
Description
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on May 12, 2023, with application number 202310537979.5 and application name “A Data Desensitization System”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of information technology (IT) technology, and in particular to a method, device and computing device cluster for hierarchical processing of data in a data warehouse. Background Art
[0003] Data masking, also known as data bleaching, is to deform certain sensitive information in the data (such as ID number, mobile phone number, card number, customer name, customer address, email address, salary, etc.) through desensitization rules to ensure that sensitive information is not leaked, thereby achieving reliable protection of sensitive privacy data. At present, common data desensitization methods include: replacement (such as replacing a user name with F), rearrangement (such as rearranging the serial number 12345 to 54321), encryption (such as encrypting the number 12345 to 23456), truncation (such as truncating 13811001111 to 138), masking (such as changing 123456 to 1xxxx6), etc.
[0004] Currently, data desensitization technology is often used in data warehouses to protect the privacy and security of sensitive data so that sensitive information will not be exposed during analysis and sharing. However, it is currently impossible to manage sensitive data in a hierarchical manner in data warehouses. Summary of the invention
[0005] The present application provides a method, apparatus, computing device cluster, computer storage medium and computer product for hierarchical processing of data in a data warehouse, which can realize hierarchical management of data in the data warehouse.
[0006] In a first aspect, the present application provides a method for hierarchical processing of data in a data warehouse. The method can be applied to a server configured with a data warehouse. Exemplarily, the server can be, but is not limited to, a cloud server. The method includes: obtaining multiple policy creation statements for a first business table in a data warehouse sent by a client, a policy creation statement is used to create a desensitization policy, and a desensitization policy is used to configure the desensitization effect when at least one query role queries the first business table; parsing the multiple policy creation statements respectively to obtain multiple desensitization policies for the first business table; recording multiple desensitization policies for the first business table through the system table of the data warehouse to associate the first business table with multiple desensitization policies.
[0007] In this way, after associating a business table with multiple desensitization strategies, different desensitization strategies can be used to desensitize the data queried by different users when they query the data in the business table, thereby achieving the purpose of different visible scopes of data in the same business table for different roles, and realizing hierarchical management of data in the data warehouse.
[0008] In a possible implementation, the desensitization strategy includes: an identifier of the desensitization strategy, an identifier of the first business table, an identifier of the query role that triggers the desensitization strategy, a priority of the desensitization strategy, a desensitization field, and a desensitization function corresponding to the desensitization field.
[0009] In a possible implementation, multiple desensitization strategies include a first desensitization strategy; the system table includes a first system table and a second system table. At this time, the first desensitization strategy for the first business table is recorded through the system table of the data warehouse, specifically including: recording the identifier of the first desensitization strategy, the identifier of the first business table, the identifier of the query role that triggers the first desensitization strategy, and the priority of the first desensitization strategy through the first tuple, and recording the identifier of the first desensitization strategy, the desensitization field involved in the first desensitization strategy, and the desensitization function corresponding to the desensitization field involved in the first desensitization strategy through the second tuple; inserting the first tuple into the first system table, and inserting the second tuple into the second system table. In this way, the recording of the desensitization strategy is completed through the system table, and the association between the desensitization strategy and the business table is realized. In addition, by recording different elements in the desensitization strategy through multiple tuples, the amount of information in a single tuple can be reduced, thereby improving the efficiency of retrieving tuples.
[0010] In a possible implementation, after recording multiple desensitization policies for the first business table through the system table of the data warehouse, it also includes: obtaining a policy deletion statement for the first business table sent by the client, the policy deletion statement including the identifier of the second desensitization policy to be deleted and the identifier of the first business table; parsing the policy deletion statement to obtain the identifier of the second desensitization policy and the identifier of the first business table; based on the identifier of the second desensitization policy and the identifier of the first business table, querying the second desensitization policy in the system table, and deleting the second desensitization policy in the system table. In this way, the deletion of the desensitization policy is realized, so that users can retain appropriate desensitization policies according to their own needs.
[0011] In a possible implementation, after recording multiple desensitization policies for the first business table through the system table of the data warehouse, it also includes: obtaining a policy modification statement for the first business table sent by the client, the policy modification statement including the identifier of the third desensitization policy to be modified, the identifier of the first business table, the change item and the modification method of the change item; parsing the policy deletion statement to obtain the identifier of the third desensitization policy, the identifier of the first business table, the change item and the modification method of the change item; based on the identifier of the third desensitization policy and the identifier of the first business table, querying the third desensitization policy in the system table; based on the modification method of the change item, modifying the change item in the queried third desensitization policy. In this way, the modification of the desensitization policy is realized, so that users can retain appropriate desensitization policies according to their own needs.
[0012] In a possible implementation, after recording multiple desensitization strategies for the first business table through the system table of the data warehouse, it also includes: obtaining a first message sent by the client, the first message includes a first query statement input by the first user and the identifier of the first user, and the first query statement includes the identifier of the first business table; in response to the first message, based on the identifier of the first business table, querying multiple candidate desensitization strategies associated with the first business table from the system table; based on the identifier of the first user, screening out a fourth desensitization strategy that matches the identifier of the first user from the multiple candidate desensitization strategies queried, the fourth desensitization strategy is used to configure the desensitization effect when the first user queries the first business table; based on the fourth desensitization strategy, desensitizing the data queried by the first user in the first business table to obtain the first desensitized data; sending a second message to the client, the second message includes the first desensitized data. In this way, desensitizing the data queried by the corresponding user using the desensitization strategy is achieved.
[0013] Further, it also includes: obtaining a third message sent by the client, the third message includes a second query statement input by the second user and the identifier of the second user, and the second query statement is the same as the first query statement; in response to the third message, based on the identifier of the first business table, querying multiple candidate desensitization strategies associated with the first business table from the system table; based on the identifier of the second user, screening out a fifth desensitization strategy that matches the identifier of the second user from the multiple candidate desensitization strategies queried, the fifth desensitization strategy is used to configure the desensitization effect when the second user queries the first business table, wherein the fourth desensitization strategy and the fifth desensitization strategy are different; based on the fifth desensitization strategy, data desensitization is performed on the data queried by the second user in the first business table to obtain second desensitized data; sending a fourth message to the client, the fourth message includes the second desensitized data. In this way, data desensitization of the data queried by the corresponding user using the desensitization strategy is realized. Since the first user and the second user are different, the desensitized data obtained by the two users are also different, which realizes the hierarchical management of the data in the business table.
[0014] In a possible implementation, based on the target user's identifier, a target desensitization policy that matches the target user's identifier is screened out from the multiple candidate desensitization policies that are queried, including: based on the target user's identifier, multiple desensitization policies that match the target user's identifier are screened out from the multiple candidate desensitization policies that are queried, and each of the multiple desensitization policies that match the target user's identifier is used to configure the desensitization effect when the target user queries the first business table; a desensitization policy with the highest priority among the multiple desensitization policies that match the target user's identifier is used as the target desensitization policy, wherein the target user is the first user and the target desensitization policy is the fourth desensitization policy, or the target user is the second user and the target desensitization policy is the fifth desensitization policy. In this way, when a user is associated with multiple desensitization policies, the optimal desensitization policy can be screened out, reducing the probability of system errors.
[0015] In a second aspect, the present application provides a hierarchical processing method for data in a data warehouse, comprising: respectively obtaining a first query statement input by a first user and a second query statement input by a second user, the first query statement and the second query statement are the same and include an identifier of a first business table; respectively sending a first message and a second message to a server, the first message including the first query statement and the identifier of the first user, and the second message including the second query statement and the identifier of the second user, wherein the data warehouse configured in the server includes a first business table, and the first business table is associated with multiple desensitization strategies, the first desensitization strategy among the multiple desensitization strategies is used to configure the desensitization effect when the first user queries the first business table, the second desensitization strategy among the multiple desensitization strategies is used to configure the desensitization effect when the second user queries the first business table, and the first desensitization strategy and the second desensitization strategy are different; respectively obtaining a third message and a fourth message sent by the server, the third message including the first desensitized data, the fourth message including the second desensitized data, the first desensitized data is obtained by desensitizing the data queried by the first user in the first business table based on the first desensitization strategy, and the second desensitized data is obtained by desensitizing the data queried by the second user in the first business table based on the second desensitization strategy; and outputting the first desensitized data and the second desensitized data respectively.
[0016] In a third aspect, the present application provides a device for hierarchical processing of data in a data warehouse. The device can be deployed on a server configured with a data warehouse. The device includes: a communication module and a processing module. Among them, the communication module is used to obtain multiple policy creation statements for the first business table in the data warehouse sent by the client, one policy creation statement is used to create a desensitization policy, and one desensitization policy is used to configure the desensitization effect when at least one query role queries the first business table. The processing module is used to parse the multiple policy creation statements respectively to obtain multiple desensitization policies for the first business table, and to record the multiple desensitization policies for the first business table through the system table of the data warehouse to associate the first business table with the multiple desensitization policies.
[0017] In a possible implementation, the desensitization strategy includes: an identifier of the desensitization strategy, an identifier of the first business table, an identifier of the query role that triggers the desensitization strategy, a priority of the desensitization strategy, a desensitization field, and a desensitization function corresponding to the desensitization field.
[0018] In a possible implementation, multiple desensitization strategies include a first desensitization strategy; the system table includes a first system table and a second system table. At this time, when the processing module records the first desensitization strategy for the first business table through the system table of the data warehouse, it is specifically used to: record the identifier of the first desensitization strategy, the identifier of the first business table, the identifier of the query role that triggers the first desensitization strategy, and the priority of the first desensitization strategy through a first tuple, and, record the identifier of the first desensitization strategy, the desensitization fields involved in the first desensitization strategy, and the desensitization functions corresponding to the desensitization fields involved in the first desensitization strategy through a second tuple; insert the first tuple into the first system table, and insert the second tuple into the second system table.
[0019] In a possible implementation, after the processing module records multiple desensitization policies for the first business table through the system table of the data warehouse, the communication module is also used to obtain a policy deletion statement for the first business table sent by the client, and the policy deletion statement includes the identifier of the second desensitization policy to be deleted and the identifier of the first business table. The processing module is also used to parse the policy deletion statement to obtain the identifier of the second desensitization policy and the identifier of the first business table; and, based on the identifier of the second desensitization policy and the identifier of the first business table, query the second desensitization policy in the system table, and delete the second desensitization policy in the system table.
[0020] In a possible implementation, after the processing module records multiple desensitization policies for the first business table through the system table of the data warehouse, the communication module is also used to obtain the policy modification statement for the first business table sent by the client, and the policy modification statement includes the identifier of the third desensitization policy to be modified, the identifier of the first business table, the change item, and the modification method of the change item. The processing module is also used to parse the policy deletion statement to obtain the identifier of the third desensitization policy, the identifier of the first business table, the change item, and the modification method of the change item; and based on the identifier of the third desensitization policy and the identifier of the first business table, query the third desensitization policy in the system table; and, based on the modification method of the change item, modify the change item in the queried third desensitization policy.
[0021] In a possible implementation, after the processing module records multiple desensitization strategies for the first business table through the system table of the data warehouse, the communication module is also used to obtain a first message sent by the client, wherein the first message includes a first query statement input by a first user and an identifier of the first user, and the first query statement includes an identifier of the first business table. The processing module is also used to query multiple candidate desensitization strategies associated with the first business table from the system table in response to the first message based on the identifier of the first business table; and based on the identifier of the first user, filter out a fourth desensitization strategy that matches the identifier of the first user from the multiple candidate desensitization strategies queried, the fourth desensitization strategy is used to configure the desensitization effect when the first user queries the first business table; and, based on the fourth desensitization strategy, perform data desensitization on the data queried by the first user in the first business table to obtain first desensitized data. The communication module is also used to send a second message to the client, wherein the second message includes the first desensitized data.
[0022] Furthermore, the communication module is also used to obtain a third message sent by the client, the third message includes a second query statement input by the second user and the identifier of the second user, and the second query statement is the same as the first query statement. The processing module is also used to respond to the third message, based on the identifier of the first business table, query multiple candidate desensitization strategies associated with the first business table from the system table; and based on the identifier of the second user, filter out a fifth desensitization strategy that matches the identifier of the second user from the multiple candidate desensitization strategies queried, the fifth desensitization strategy is used to configure the desensitization effect when the second user queries the first business table, wherein the fourth desensitization strategy and the fifth desensitization strategy are different; and, based on the fifth desensitization strategy, the data queried by the second user in the first business table is desensitized to obtain second desensitized data. The communication module is also used to send a fourth message to the client, the fourth message includes the second desensitized data.
[0023] In one possible implementation, when the processing module filters out a target desensitization policy that matches the target user's identifier from multiple candidate desensitization policies that have been queried based on the target user's identifier, the processing module is specifically used to: based on the target user's identifier, filter out multiple desensitization policies that match the target user's identifier from multiple candidate desensitization policies that have been queried, and each of the multiple desensitization policies that match the target user's identifier is used to configure a desensitization effect when the target user queries the first business table; and use a desensitization policy with the highest priority among the multiple desensitization policies that match the target user's identifier as the target desensitization policy, wherein the target user is the first user and the target desensitization policy is the fourth desensitization policy, or the target user is the second user and the target desensitization policy is the fifth desensitization policy.
[0024] In a fourth aspect, the present application provides a device for hierarchical processing of data in a data warehouse. The device can be deployed on a terminal device. The device includes: a processing module and a communication module. The processing module is used to obtain a first query statement input by a first user and a second query statement input by a second user, respectively. The first query statement and the second query statement are the same and include an identifier of a first business table. The communication module is used to send a first message and a second message to a server, respectively. The first message includes a first query statement and an identifier of the first user, and the second message includes a second query statement and an identifier of the second user. The data warehouse configured in the server includes a first business table, and the first business table is associated with multiple desensitization strategies. The first desensitization strategy among the multiple desensitization strategies is used to configure the desensitization effect when the first user queries the first business table. The second desensitization strategy among the multiple desensitization strategies is used to configure the desensitization effect when the second user queries the first business table. The first desensitization strategy and the second desensitization strategy are different. The communication module is further used to respectively obtain a third message and a fourth message sent by the server, wherein the third message includes first desensitized data, and the fourth message includes second desensitized data. The first desensitized data is obtained by desensitizing the data queried by the first user in the first business table based on the first desensitization strategy, and the second desensitized data is obtained by desensitizing the data queried by the second user in the first business table based on the second desensitization strategy. The processing module is further used to respectively output the first desensitized data and the second desensitized data.
[0025] In a fifth aspect, the present application provides a computing device cluster, comprising at least one computing device, each computing device comprising a processor and a memory; the processor of at least one computing device is used to execute instructions stored in the memory of at least one computing device, so that the computing device cluster executes the method described in the first aspect or any possible implementation of the first aspect, or executes the method described in the second aspect.
[0026] In a sixth aspect, the present application provides a computer-readable storage medium, including computer program instructions, when the computer program instructions are executed by a computing device, the computing device executes the method described in the first aspect or any possible implementation of the first aspect; or, when the computer program instructions are executed by a computing device cluster, the computing device cluster executes the method described in the first aspect or any possible implementation of the first aspect, or executes the method described in the second aspect. Exemplarily, the computing device cluster may include one or more computing devices.
[0027] In a seventh aspect, the present application provides a computer program product comprising instructions, which, when executed by a computing device, causes the computing device to execute the method described in the first aspect or any possible implementation of the first aspect, or, when executed by a computing device cluster, causes the computing device cluster to execute the method described in the first aspect or any possible implementation of the first aspect, or, executes the method described in the second aspect. Exemplarily, the computing device cluster may include one or more computing devices.
[0028] It can be understood that the beneficial effects of the second to seventh aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1 It is a schematic diagram of the architecture of a hierarchical processing system for data in a data warehouse provided in an embodiment of the present application;
[0030] Figure 2 It is a structural diagram of a server provided in an embodiment of the present application;
[0031] Figure 3 It is a flowchart of creating multiple different desensitization strategies for a business table provided by an embodiment of the present application;
[0032] Figure 4 It is a flow chart of modifying a desensitization strategy provided in an embodiment of the present application;
[0033] Figure 5 It is a flowchart of a deletion desensitization strategy provided in an embodiment of the present application;
[0034] Figure 6 It is a flow chart of a desensitization strategy provided in an embodiment of the present application;
[0035] Figure 7 It is a flow chart of a method for hierarchical processing of data in a data warehouse provided in an embodiment of the present application;
[0036] Figure 8 It is a structural schematic diagram of a device for hierarchical processing of data in a data warehouse provided in an embodiment of the present application;
[0037] Fig. 9 It is a structural schematic diagram of a device for hierarchical processing of data in a data warehouse provided in an embodiment of the present application;
[0038] Fig.10 is a schematic diagram of the structure of a computing device provided in an embodiment of the present application;
[0039] Fig.11 is a schematic diagram of the structure of a computing device cluster provided in an embodiment of the present application;
[0040] Fig.12 It is a structural diagram of another computing device cluster provided in an embodiment of the present application. DETAILED DESCRIPTION
[0041] The term "and / or" in this article is a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The symbol " / " in this article indicates that the associated objects are in an or relationship, for example, A / B means A or B.
[0042] The terms "first" and "second" in the specification and claims herein are used to distinguish different objects rather than to describe a specific order of the objects. For example, a first response message and a second response message are used to distinguish different response messages rather than to describe a specific order of the response messages.
[0043] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0044] In the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more than two. For example, multiple processing units refer to two or more processing units, etc.; multiple elements refer to two or more elements, etc.
[0045] First, some technical terms involved in the embodiments of the present application are introduced.
[0046] (1) Data Warehouse
[0047] A data warehouse is a subject-oriented, integrated, and stable data storage system that is used to store and manage large amounts of historical and current data and provide rich data analysis and decision support functions. It extracts, cleans, and integrates data from multiple source systems to support users' comprehensive analysis and insights into specific topics or business areas. Through specific data models and structures, data warehouses provide analysis-oriented multidimensional query and report generation capabilities, enabling organizations to perform trend analysis, historical comparisons, and time series analysis. By building and utilizing data warehouses, organizations can achieve efficient management and utilization of data assets, and obtain valuable information and wisdom from them to support business growth, strategic decision-making, and the development of business intelligence.
[0048] One of the core components of a data warehouse is a database, which can be used to store and manage data in the data warehouse.
[0049] (2) Metadata
[0050] Metadata refers to a collection of data used to describe and manage data, structure, relationships and other related information in a data warehouse. It contains descriptions of various data objects, attributes and rules in the data warehouse, and provides an explanation of the structure, content and semantics of the data warehouse. Metadata can include: data object definition, data source and extraction rules, data quality rules and indicators, data relationship and dependency, data conversion and loading rules, metadata dictionary and business rules, etc. Among them, data object definition includes: the name, structure, data type, constraint conditions and other information of objects such as data tables, views and indexes. Data source and extraction rules can be used to describe the source system, data extraction rules, data update frequency and other information of data in the data warehouse. Data quality rules and indicators can be used to define the quality requirements and evaluation indicators of data in the data warehouse, including rules on accuracy, completeness, consistency and other aspects. Data relationships and dependencies can be used to record the relationships and dependencies between data objects, such as the association relationship between tables, the base table of views, etc. Data conversion and loading rules can be used to describe data conversion rules, cleaning rules and loading rules in the process of data extraction, transformation and loading (extract, transform, load, ETL) in the data warehouse. Metadata dictionaries and business rules can include data vocabularies, business rules, and term definitions that provide interpretation and understanding of the data in the data warehouse.
[0051] (3) System table
[0052] System tables are special tables used to store and manage the metadata, status information, and operation history of the data warehouse. The system tables record the structure, configuration, operating status, components, and data of the data warehouse, and support functions such as data management, monitoring, and query optimization.
[0053] (4) Tuple
[0054] A tuple is the smallest unit of data in a data warehouse, representing a complete data record or row in the data warehouse. It consists of a set of fields or attributes that describe a specific entity, fact, or event. For example, for a sales data warehouse, each tuple can represent a sales transaction, which contains attributes such as transaction date, product name, sales quantity, and sales amount.
[0055] Tuples are organized according to the data model and architecture of the data warehouse and have a fixed structure and order. Each tuple has a unique identifier, usually a primary key or a composite key, which is used to uniquely identify the tuple in the data warehouse. By associating and connecting different tuples, the relationship and association between data in the data warehouse can be constructed. Tuples are used in the data warehouse to store, query and analyze data, supporting tasks such as data mining, report generation and decision support.
[0056] (5) Desensitization strategy
[0057] A desensitization policy can be used to configure the desensitization effect expected by at least one query role for a specific table object (or business table). The desensitization policy may include: the identifier of the desensitization policy (such as name, etc.), the identifier of the business table to which the desensitization policy is applied, the identifier of the query role that triggers the desensitization policy, the priority of the desensitization policy, the desensitization fields involved, and the desensitization functions corresponding to the desensitization fields.
[0058] (6) Field
[0059] A field is a column in a business table, that is, a collection of data with the same attributes. Each field must have a unique name, called a field name. For example, in a business table, if a column is used to store "gender", then "gender" is a field name.
[0060] Next, the technical solution provided by the embodiments of the present application is introduced.
[0061] Generally, in a data warehouse, at a specific moment, the sensitive fields involved in a business table are static in the application dimension, that is, they will not change at that moment. Therefore, in a data warehouse, there is no need to distinguish the visible scope of sensitive fields according to business scenarios or query users, that is, a business table only needs one desensitization strategy. However, in actual applications, the sensitivity levels of different sensitive information are often different, so different levels of sensitive information have different visible scopes for different roles. But when a business table has only one desensitization strategy, except for certain specific roles, the information queried from the data warehouse by other roles is the same, that is, it is impossible to have different visible scopes for different query roles.
[0062] In view of this, an embodiment of the present application provides a hierarchical processing method for data in a data warehouse, through which multiple different desensitization strategies can be created for a business table, and different desensitization strategies cover sensitive data of different sensitivities, and different desensitization strategies have different effective conditions. In this way, when different roles query the data in the same business table in the data warehouse, different desensitization strategies can be used to process the sensitive data in the business table, thereby achieving the purpose of different visible scopes of sensitive data in the same business table for different roles, and then supporting more refined data classification applications downstream. Exemplarily, the hierarchical processing method for data in the data warehouse may include one or more of creating a desensitization strategy, modifying a desensitization strategy, deleting a desensitization strategy, and using a desensitization strategy.
[0063] For example, Figure 1 FIG. 1 is a schematic diagram showing the architecture of a hierarchical data processing system in a data warehouse provided by an embodiment of the present application. Figure 1 As shown, the hierarchical processing system 100 of data in the data warehouse includes: a terminal device 110 and a server 120. A communication connection can be established between the terminal device 110 and the server 120 through a wired network or a wireless network. A data warehouse is configured in the server 120 so that the server 120 can provide data warehouse services. The user can use the data warehouse service provided by the server 120 through the client configured on the terminal device 110 (such as: desktop application, mobile application, Web application or Web-based application, etc.), and / or create multiple different desensitization strategies for a business table in the server 120. Among them, the terminal device 110 can be a mobile phone, a tablet computer, a handheld computer, a laptop computer, or an artificial intelligence (AI) device. The embodiment of the present application does not impose any special restrictions on the specific type of the terminal device 110. The server 120 can be a central server, an edge server, or a cloud server, etc. The embodiment of the present application does not impose any special restrictions on the specific type of the server 120.
[0064] For example, Figure 2 FIG. 1 shows a schematic diagram of the structure of a server provided in an embodiment of the present application. Figure 2 As shown, the server 120 may include a structured query language (SQL) engine 121 , a storage engine 122 , and a data desensitization engine 123 .
[0065] Among them, the SQL engine 121 is mainly used to execute and process the query statements obtained by the server 120 from the terminal device 110, so as to convert the query statements into executable plans, and is responsible for executing and managing various operations related to the data warehouse. In addition, the SQL engine 121 can also be used to execute and process the policy creation statements obtained by the server 120 from the terminal device 110, so as to create multiple different desensitization strategies for a business table. The SQL engine 121 can also be used to execute and process the policy modification statements obtained by the server 120 from the terminal device 110, so as to modify the created desensitization strategy. The SQL engine 121 can also be used to execute and process the policy deletion statements obtained by the server 120 from the terminal device 110, so as to delete the created desensitization strategy. The SQL engine 121 can also generate an execution plan with data desensitization processing after obtaining the field set that needs to be desensitized and rewritten by the data desensitization engine 123, and interact with the storage engine 122 to generate a query result after data desensitization, and return the query result to the client configured on the terminal device 110.
[0066] The storage engine 122 is mainly used to manage and operate the data storage in the data warehouse. The storage engine 122 can persist the data in the data warehouse to the disk and provide data read and write operations. In addition, the storage engine 122 can also manage and operate the storage of the desensitization strategy to persist the desensitization strategy to the disk and provide desensitization strategy read and write operations.
[0067] The data desensitization engine 123 is mainly used to process the query tree (querytree) parsed by the SQL engine 121 from the query statement, so as to determine the desensitization strategy adapted to the query role corresponding to the query statement from the storage engine 122. The data desensitization engine 123 can also be used to mark the fields in the business table associated with the selected desensitization strategy in the query tree to obtain a set of fields that need to be rewritten for data desensitization.
[0068] It is understandable that this embodiment Figure 2 The illustrated structure does not constitute a specific limitation on the server 120. In other embodiments, the server 120 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0069] The above is an introduction to the data processing system 100 and the server 120 provided in the embodiment of the present application. Next, based on the above content, the creation of a desensitization strategy, modification of a desensitization strategy, deletion of a desensitization strategy, and use of a desensitization strategy involved in the embodiment of the present application are introduced respectively.
[0070] (1) Create a desensitization strategy to classify data in the data warehouse
[0071] For example, Figure 3 A schematic diagram of a process for creating a desensitization strategy provided by an embodiment of the present application is shown. Figure 3 The terminal device described in the above may also be replaced by a client configured on the terminal device, and the replaced solution is still within the protection scope of this application. Figure 3 As shown, creating a desensitization strategy may include the following steps:
[0072] S301. The terminal device 110 obtains multiple policy creation statements for a target business table input by a user, where one policy creation statement is used to create a desensitization policy.
[0073] In this embodiment, the user can enter multiple policy creation statements on the client related to the data warehouse on the terminal device 100. Among them, a policy creation statement can be used to create a desensitization policy. For example, taking the table emp (id, name, card_id, phone, email, address, honors), and for sensitive data of different sensitivity levels in the table emp, two desensitization strategies are proposed to specify different sensitive field categories: desensitization strategy p1 {id, name, card_id, phone}, desensitization strategy p2 {id, name, card_id, phone, email, address}, and desensitization strategy p2 takes precedence in the case of role conflict. For example, the two policy creation statements entered by the user can be:
[0074] CREATE REDACTION POLICY p1 ON emp WHEN current_user in('alice','bob')
[0075] ADD COLUMN nameWITHmask_partial(name,'*',2)
[0076] ADD COLUMN card_id WITH mask_partial(card_id,'*',5,13)
[0077] ADD COLUMN phone WITH mask_partial(phone,'*',4);
[0078] CREATE REDACTION POLICY p2 ON emp AFTER p1 WHEN current_user='bob'
[0079] ADD COLUMN name WITH mask_partial(name,'*',2)
[0080] ADD COLUMN card_id WITH mask_full(card_id)
[0081] ADD COLUMN phone WITH mask_full(phone)
[0082] ADD COLUMN email WITH mask_partial(email,'*',1,position('@'inemail)-1)
[0083] ADD COLUMN address WITH mask_full(address);
[0084] After the user completes inputting and confirming the policy creation statement, the terminal device 100 obtains the policy creation statement input by the user.
[0085] S302 : The terminal device 110 sends a message including multiple policy creation statements for a target business table to the server 120 .
[0086] S303 . In response to the acquired message, the server 120 parses multiple policy creation statements for the target business table through a SQL engine to obtain multiple desensitization policies for the target business table.
[0087] In this embodiment, after the server 120 obtains multiple policy creation statements for the target business table, the server 120 can parse the policy creation statements through the SQL engine therein to obtain multiple desensitization policies for the target business table.
[0088] S304. The server 120 records multiple desensitization strategies for the target business table through the system table of the data warehouse to associate the target business table with the multiple desensitization strategies.
[0089] In this embodiment, after parsing multiple desensitization policies for the target business table from multiple policy creation statements for the target business table, the multiple desensitization policies parsed can be recorded in the system table of the data warehouse. Since the desensitization policy contains the identifier of the target business table, after recording the desensitization policy in the system table, the target business table can be associated with the desensitization policy.
[0090] In some embodiments, in the process of parsing a policy creation statement, for a desensitization policy in a policy creation statement, the identifier of the desensitization policy, the identifier of the business table to which the desensitization policy is applied, the identifier of the query role that triggers the desensitization policy, the priority of the desensitization policy, the desensitization fields involved in the desensitization policy, and the desensitization function corresponding to the desensitization fields involved in the desensitization policy can all be recorded through a tuple. In this way, the desensitization policy can be described through the tuple. Further, after the tuple corresponding to a desensitization policy is inserted into the system table, the desensitization policy is recorded through the system table.
[0091] In other embodiments, due to recording all elements in a desensitization strategy through a tuple, it may cause too much information in the tuple, resulting in low retrieval efficiency. Therefore, in order to improve retrieval efficiency, in the process of parsing the policy creation statement, for the desensitization strategy in a policy creation statement, a tuple of a desensitization strategy can be used to record the identification of the desensitization strategy contained in the desensitization strategy, the identification of the business table applied by the desensitization strategy, the identification of the query role that triggers the desensitization strategy and the priority of the desensitization strategy, and a tuple of a desensitization field is used to record the identification of the desensitization strategy, the desensitization field involved in the desensitization strategy, and the desensitization function corresponding to the desensitization field involved in the desensitization strategy. In this way, by recording different elements in a desensitization strategy through two tuples, the amount of information in a single tuple can be reduced, thereby improving retrieval efficiency. At this time, the desensitization strategy is described by the tuple of a desensitization strategy and the tuple of the desensitization field involved in the desensitization strategy. Further, after two tuples corresponding to a desensitization strategy are inserted into the system table, the desensitization strategy is recorded through the system table.
[0092] After recording multiple desensitization strategies for the target business table through the system table, multiple different desensitization strategies are created for a business table in the data warehouse. In some embodiments, the process of creating a desensitization strategy can be understood as a part of the hierarchical processing method of data in the data warehouse.
[0093] (2) Modify the desensitization strategy
[0094] For example, Figure 4 A schematic diagram of a process for modifying a desensitization strategy provided in an embodiment of the present application is shown. Figure 4 The terminal device described in the above may also be replaced by a client configured on the terminal device, and the replaced solution is still within the protection scope of this application. Figure 4 As shown, modifying the desensitization strategy may include the following steps:
[0095] S401. The terminal device 110 obtains a policy modification statement for a target business table input by a user, wherein the policy modification statement includes an identifier of a modified desensitizing policy, an identifier of a business table corresponding to the desensitizing policy, a change item in the desensitizing policy, and a modification method of the change item.
[0096] In this embodiment, when the desensitization policy needs to be modified, the user can enter a policy modification statement on the client associated with the data warehouse on the terminal device 100. The policy modification statement includes the identifier of the modified desensitization policy, the identifier of the business table corresponding to the modified desensitization policy, the change item in the modified desensitization policy, and the modification method of the change item. For example, taking the modification of the desensitization policy created by the policy creation statement for the table emp described above as an example, when modifying the effective condition of the desensitization policy p2, the policy modification statement can be:
[0097] ALTER REDACTION POLICY p2 ON emp WHEN current_user in('Tom') changes the effective condition of the desensitization policy p2 corresponding to the emp table from the query role bob to Tom.
[0098] When modifying the desensitization effect of the phone column in desensitization policy p2, the policy modification statement can be:
[0099] ALTER REDACTION POLICY p2 ON emp modify COLUMN phone WITH mask_partial(phone,'*',4,8), that is, change the masking of all the phone numbers of the desensitization policy p2 corresponding to the table emp to masking the 4th to 8th digits in the phone number.
[0100] When modifying the desensitization effect of the email column in the desensitization policy p2, the policy modification statement can be:
[0101] ALTER REDACTION POLICY p2 ON emp drop COLUMN emai l, which deletes the desensitization effect of the emai l column in the desensitization policy p2 corresponding to the table emp. In other words, data desensitization is no longer performed on the emai l column in the table emp.
[0102] After the user completes inputting and confirming the policy modification statement, the terminal device 100 obtains the policy modification statement input by the user.
[0103] S402 : The terminal device 110 sends a message including a policy modification statement for a target service table to the server 120 .
[0104] S403. In response to the acquired message, the server 120 parses the policy modification statement for the target business table through the SQL engine to obtain the identifier of the modified desensitizing policy, the identifier of the business table corresponding to the desensitizing policy, the changed items in the desensitizing policy, and the modification method of the changed items.
[0105] S404. The server 120 searches the system table by the identifier of the modified desensitization policy and the identifier of the business table corresponding to the desensitization policy to find the desensitization policy to be modified.
[0106] In this embodiment, the server 120 can query the various desensitization policies associated with the business table from the system table through the identifier of the business table corresponding to the desensitization policy. Further, the modified desensitization policy can be queried in the various desensitization policies through the identifier of the desensitization policy modified this time to query the modified desensitization policy. In some embodiments, when the desensitization policy is described by a tuple in the system table, the tuple corresponding to the desensitization policy can be queried from the system table.
[0107] S405. The server 120 modifies the changed items in the desensitizing policy that are modified this time based on the modification method of the changed items in the desensitizing policy.
[0108] In this embodiment, after querying the modified desensitization policy, the server 120 can modify the changed items in the modified desensitization policy based on the modification method of the changed items in the desensitization policy. In some embodiments, when the desensitization policy is described by a tuple in the system table, when making a modification, the corresponding changed items in the tuple corresponding to the modified desensitization policy can be modified. For example, continuing to modify the desensitization policy p2 created based on the policy creation statement for the table emp described above, when the policy modification statement is: ALTERREDACTION POLICY p2 ON emp modify COLUMN phone WITH mask_partial (phone,'*',4,8), the "ADD COLUMN phone WITHmask_full(phone)" in the desensitization policy p2 can be modified to "ADDCOLUMNphone WITH mask_partial(phone,'*',4,8)".
[0109] In this way, the modification of the desensitization strategy recorded in the system table is completed. In some embodiments, the process of modifying the desensitization strategy can be understood as a part of the hierarchical processing method of data in the data warehouse.
[0110] (3) Delete the desensitization strategy
[0111] For example, Figure 5 A schematic diagram of a process for deleting a desensitization strategy provided in an embodiment of the present application is shown. Figure 5 The terminal device described in the above may also be replaced by a client configured on the terminal device, and the replaced solution is still within the protection scope of this application. Figure 5 As shown, deleting the desensitization strategy may include the following steps:
[0112] S501. The terminal device 110 obtains a policy deletion statement for a target service table input by a user. The policy deletion statement includes an identifier of a desensitizing policy to be deleted and an identifier of a service table corresponding to the desensitizing policy.
[0113] In this embodiment, when it is necessary to delete the desensitization policy, the user can enter a policy deletion statement on the client related to the data warehouse on the terminal device 100. The policy deletion statement includes the identifier of the deleted desensitization policy and the identifier of the business table corresponding to the desensitization policy. For example, taking the modification of the desensitization policy created by the policy creation statement for the table emp described above as an example, when deleting the desensitization policy p2, the policy deletion statement can be: Drop REDACTIONPOLICY p2 ON emp.
[0114] After the user completes inputting and confirming the policy deletion statement, the terminal device 100 obtains the policy deletion statement input by the user.
[0115] S502 : The terminal device 110 sends a message including a policy deletion statement for a target service table to the server 120 .
[0116] S503. In response to the acquired message, the server 120 parses the policy deletion statement for the target business table through the SQL engine to obtain the identifier of the deleted desensitization policy and the identifier of the business table corresponding to the desensitization policy.
[0117] S504. The server 120 searches the system table through the identifier of the deleted desensitization policy and the identifier of the business table corresponding to the desensitization policy to find the desensitization policy to be deleted this time, and deletes the desensitization policy from the system table.
[0118] In this embodiment, the server 120 can query the various desensitizing policies associated with the business table from the system table through the identifier of the business table corresponding to the desensitizing policy to be deleted this time. Furthermore, the desensitizing policy to be deleted can be queried in the various desensitizing policies queried through the identifier of the desensitizing policy to be deleted this time, so as to query the deleted desensitizing policy and delete the desensitizing policy.
[0119] In some embodiments, when the desensitization strategy is described by a tuple in the system table, the tuple corresponding to the desensitization strategy may be queried from the system table. At this time, when deleting the desensitization strategy, the tuple corresponding to the desensitization strategy is deleted from the system table.
[0120] In this way, the deletion of the desensitization strategy in the system table is completed. In some embodiments, the process of deleting the desensitization strategy can be understood as a part of the hierarchical processing method of data in the data warehouse.
[0121] (4) Use desensitization strategies
[0122] For example, Figure 6 A schematic diagram of a process for using a desensitization strategy provided in an embodiment of the present application is shown. Figure 6 The terminal device described in the above may also be replaced by a client configured on the terminal device, and the replaced solution is still within the protection scope of this application. Figure 6 As shown, the desensitization strategy may include the following steps:
[0123] S601: The terminal device 110 obtains a query statement input by a user, where the query statement includes an identifier of a service table to be queried.
[0124] In this embodiment, when querying the data in the data warehouse, the user can enter a query statement on the client associated with the data warehouse on the terminal device 100. The query statement includes the identifier of the queried business table. For example, the query statement can be: SELECT id, name, email FROM emp, or SELECT*FROM emp. SELECTid, name, email FROM emp means querying the data of the id column, name column and email column in the emp table; SELECT*FROMemp1,emp2 means querying the data of all columns in the emp1 and emp2 tables.
[0125] S602: The terminal device 110 sends a message including a query statement input by a user and a user identifier to the server 120.
[0126] S603 . In response to the acquired message, the server 120 parses the query statement input by the user through the SQL engine to obtain a query tree corresponding to the query statement.
[0127] In this embodiment, after the server 120 obtains the query statement input by the user, the query statement can be parsed by the SQL engine to obtain a query tree corresponding to the query statement. For example, when the query statement is SELECT id, name, email FROM emp1, emp2, the query tree obtained by parsing the query statement by the SQL engine can be:
[0128]
[0129] S604, the server 120 traverses the identifier of each business table in the query tree, and queries the candidate desensitization strategies associated with each business table in the query tree from the system table of the data warehouse, wherein one business table is associated with multiple candidate desensitization strategies.
[0130] In this embodiment, after the server 120 obtains the query tree corresponding to the query statement input by the user, it can recursively traverse the query tree, and use the identifiers of each business table in the query tree to query in the system table of the data warehouse to query the candidate desensitization strategies associated with each business table in the query tree. Since multiple desensitization strategies are created for one business table when creating a desensitization strategy, a business table queried at this time is associated with multiple candidate desensitization strategies. In some embodiments, when the desensitization strategy is described by a tuple in the system table, since the tuple corresponding to the desensitization strategy contains the identifier of the business table to which the desensitization strategy is applied, the tuples corresponding to the various desensitization strategies associated with the business table can be queried from the system table through the identifier of the business table.
[0131] S605 , the server 120 selects a desensitization policy that matches the current user (ie, the user who inputs the query statement) from the candidate desensitization policies associated with each business table based on the user identifier, so as to obtain a desensitization policy associated with each business table.
[0132] In this embodiment, since the business table is associated with multiple desensitization policies, and each desensitization policy contains a query role that triggers the desensitization policy, the desensitization policy that matches the current user can be screened out from the candidate desensitization policies associated with each business table through the user's ID, so as to obtain a desensitization policy associated with each business table.
[0133] In addition, for a business table, when multiple desensitization strategies matching the current user are screened out, the server 120 can select the desensitization strategy with the highest priority from among the multiple desensitization strategies as the desensitization strategy to be used based on the priorities contained in the multiple desensitization strategies.
[0134] In some embodiments, when a desensitization policy is described in a system table by two tuples (i.e., a desensitization policy tuple and a desensitization field tuple), the tuple selected by the user's identifier may be the desensitization policy tuple. Since the desensitization policy tuple contains the desensitization policy identifier, the desensitization policy that matches the current user can be obtained through the desensitization policy tuple.
[0135] S606: The server 120 performs data desensitization on the data queried by the user in each business table based on the screened desensitization strategies to obtain desensitized data.
[0136] In this embodiment, after the server 120 screens out various desensitization strategies for the current user, the screened out desensitization strategies can be used to desensitize the data queried by the current user in various business tables to obtain desensitized data. For example, when the user queries the data in Table A and Table B, and the desensitization strategy for the user and related to Table A is Strategy 1, and the desensitization strategy for the user and related to Table B is Strategy 2, Strategy 1 can be used to desensitize the data in Table A queried by the user, and Strategy 2 can be used to desensitize the data in Table B queried by the user.
[0137] In some embodiments, when a desensitizing strategy is described in a system table by two tuples (i.e., a tuple of a desensitizing strategy and a tuple of a desensitizing field), the tuple of the desensitizing strategy is obtained in the aforementioned S605, and the identifier of the desensitizing strategy can be obtained from the tuple. Since the identifier of the desensitizing strategy is also included in the tuple of the desensitizing field, the identifier of the desensitizing strategy obtained by the tuple of the desensitizing strategy can be queried from the system table to the tuple of the corresponding desensitizing field. In addition, since the tuple of the desensitizing field includes: the desensitizing fields involved in the desensitizing strategy and the desensitizing functions corresponding to the desensitizing fields involved in the desensitizing strategy. Therefore, after querying the tuple of the corresponding desensitizing field, the set of desensitizing fields involved in each desensitizing strategy (i.e., the set of fields that need to be desensitized and rewritten for data) and the desensitizing functions corresponding to each desensitizing field can be obtained.
[0138] Further, the server 120 can process the parsed query tree, the set of desensitized fields involved in each desensitization strategy, and the desensitization function corresponding to each desensitized field through the SQL engine to generate an execution plan with desensitization processing. Then, the server 120 can execute the execution plan through the SQL engine. Since the execution plan contains the desensitization processing method for the desensitized fields involved in the desensitization strategy, after executing the execution plan, desensitized data that has been desensitized can be obtained.
[0139] S607 . The server 120 sends a message containing the desensitized data to the terminal device 110 .
[0140] S608. The terminal device 110 outputs the desensitized data.
[0141] In this embodiment, after acquiring the desensitized data, the terminal device 110 can output the desensitized data, such as displaying the desensitized data on a display screen that is matched with it.
[0142] In this way, the data queried by the user is desensitized using the desensitization strategy in the system table. In some embodiments, the process of using the desensitization strategy can be understood as a part of the hierarchical processing method of data in the data warehouse. It should be understood that the process of using the desensitization strategy when different users query data can be referred to the description in S601 to S608, which will not be repeated here. In addition, when the desensitization strategies matched with different users are different, the desensitized data output by the terminal device 110 is also different.
[0143] The above is an introduction to the data processing system 100, the server 120, the creation of multiple different desensitization strategies for a business table, the modification of desensitization strategies, the deletion of desensitization strategies, and the use of desensitization strategies provided in the embodiment of the present application. Next, based on the above content, another hierarchical processing method for data in a data warehouse provided in the embodiment of the present application is introduced.
[0144] For example, Figure 7 The following is a flow chart of another method for hierarchical processing of data in a data warehouse provided by an embodiment of the present application. Figure 7 The various steps in the Figure 6 The description of the relevant steps in the above will not be repeated here. Figure 7 and Figure 6 The difference is: Figure 6 It is a process of a user querying data, and Figure 7 It is the process of two users querying the same data in the same business table. Figure 7 As shown, the hierarchical processing method of data in the data warehouse may include the following steps:
[0145] S701, respectively obtain a first query statement input by a first user and a second query statement input by a second user, wherein the first query statement and the second query statement are the same and include an identifier of a first business table. When obtaining the first query statement and the second query statement, the two query statements may be obtained simultaneously, or may be obtained at different times (e.g., at intervals of a certain period of time), which may be determined according to actual conditions and is not limited here.
[0146] S702, respectively sending a first message and a second message to the server, wherein the first message includes a first query statement and an identifier of the first user, and the second message includes a second query statement and an identifier of the second user, wherein the data warehouse configured in the server includes a first business table, and the first business table is associated with a plurality of desensitization strategies, the first desensitization strategy among the plurality of desensitization strategies is used to configure a desensitization effect when the first user queries the first business table, and the second desensitization strategy among the plurality of desensitization strategies is used to configure a desensitization effect when the second user queries the first business table, and the first desensitization strategy and the second desensitization strategy are different. Wherein, when sending the first message and the second message, the two messages may be sent simultaneously, or the two messages may be sent in different time periods (such as at intervals of a certain period of time, etc.), which may be determined according to the actual situation and is not limited here.
[0147] S703, respectively obtain the third message and the fourth message sent by the server, the third message includes the first desensitized data, the fourth message includes the second desensitized data, the first desensitized data is obtained by desensitizing the data queried by the first user in the first business table based on the first desensitization strategy, and the second desensitized data is obtained by desensitizing the data queried by the second user in the first business table based on the second desensitization strategy. When obtaining the third message and the fourth message, the two messages can be obtained at the same time, or they can be obtained at different times (such as a certain period of time, etc.), which can be determined according to the actual situation and is not limited here.
[0148] S704, output the first desensitized data and the second desensitized data respectively. When outputting the first desensitized data and the second desensitized data, the two data may be output simultaneously, or the two data may be output in different time periods (such as at intervals of a certain period of time), which may be determined according to actual conditions and is not limited here.
[0149] In this method, since the first desensitization strategy associated with the first user is different from the second desensitization strategy associated with the second user, the desensitized data obtained by desensitizing the data using these two desensitization strategies is also different. In this way, different users can see different desensitized data. Thus, hierarchical management of data is achieved. For example, if the data queried by the first user and the second user is "123456789", the first desensitized data can be "123******" and the second desensitized data can be "1234***89". In addition, when the fields contained in the table emp are: name, ID number, bank card number, salary, mobile phone number and department, and the data in the fields are: bob, 1000001, 6666666666, 22222, 12166666, IT, if desensitization strategy p1 is to desensitize the ID number and bank card number, and desensitization strategy p2 is to desensitize the ID number, bank card number, salary and mobile phone number, and the condition for triggering the desensitization strategy p1 to take effect is that the query role is user A, and the condition for triggering the desensitization strategy p2 to take effect is that the query role is user B, then when user A and user B both query all the data in the table emp, the data queried by user A is: bob, 1*****1, 66******66, 22222, 12166666, IT, and the data queried by user B is: bob, 1*****1, 66******66, 2****, 1216****, IT.
[0150] It is understandable that the size of the sequence number of each step in the above-mentioned embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. In addition, in some possible implementations, the steps in the above-mentioned embodiments can be selectively executed according to actual conditions, and can be partially executed or fully executed, which is not limited here. In addition, all or part of any features of any of the above-mentioned embodiments can be freely and arbitrarily combined without contradiction; the combined technical solutions are also within the scope of the present application.
[0151] Next, based on the method in the above embodiment, the hierarchical processing device of data in the data warehouse provided in the embodiment of the present application is introduced.
[0152] For example, Figure 8 The schematic diagram of the structure of a hierarchical processing device for data in a data warehouse provided by an embodiment of the present application is shown. The hierarchical processing device for data in a data warehouse can be deployed on a server configured with a data warehouse. The server can be, but is not limited to, a cloud server. Figure 8As shown, the hierarchical processing device 800 for data in the data warehouse may include: a communication module 801 and a processing module 802. Among them, the communication module 801 is used to obtain multiple policy creation statements sent by the client for the first business table in the data warehouse, one policy creation statement is used to create a desensitization policy, and one desensitization policy is used to configure the desensitization effect when at least one query role queries the first business table. The processing module 802 is used to parse the multiple policy creation statements respectively to obtain multiple desensitization policies for the first business table, and to record the multiple desensitization policies for the first business table through the system table of the data warehouse to associate the first business table with the multiple desensitization policies.
[0153] In some embodiments, the desensitization policy includes: an identifier of the desensitization policy, an identifier of the first business table, an identifier of the query role that triggers the desensitization policy, a priority of the desensitization policy, a desensitization field, and a desensitization function corresponding to the desensitization field.
[0154] In some embodiments, the first desensitization strategy is included in the plurality of desensitization strategies; the system table includes the first system table and the second system table. At this time, when the processing module 802 records the first desensitization strategy for the first business table through the system table of the data warehouse, it is specifically used to: record the identifier of the first desensitization strategy, the identifier of the first business table, the identifier of the query role that triggers the first desensitization strategy, and the priority of the first desensitization strategy through the first tuple, and, record the identifier of the first desensitization strategy, the desensitization fields involved in the first desensitization strategy, and the desensitization functions corresponding to the desensitization fields involved in the first desensitization strategy through the second tuple; insert the first tuple into the first system table, and, insert the second tuple into the second system table.
[0155] In some embodiments, after the processing module 802 records multiple desensitization policies for the first business table through the system table of the data warehouse, the communication module 801 is also used to obtain a policy deletion statement for the first business table sent by the client, and the policy deletion statement includes the identifier of the second desensitization policy to be deleted and the identifier of the first business table. The processing module 802 is also used to parse the policy deletion statement to obtain the identifier of the second desensitization policy and the identifier of the first business table; and, based on the identifier of the second desensitization policy and the identifier of the first business table, query the second desensitization policy in the system table, and delete the second desensitization policy in the system table.
[0156] In some embodiments, after the processing module 802 records multiple desensitization policies for the first business table through the system table of the data warehouse, the communication module 801 is also used to obtain the policy modification statement for the first business table sent by the client, and the policy modification statement includes the identifier of the third desensitization policy to be modified, the identifier of the first business table, the change item, and the modification method of the change item. The processing module 802 is also used to parse the policy deletion statement to obtain the identifier of the third desensitization policy, the identifier of the first business table, the change item, and the modification method of the change item; and based on the identifier of the third desensitization policy and the identifier of the first business table, query the third desensitization policy in the system table; and, based on the modification method of the change item, modify the change item in the queried third desensitization policy.
[0157] In some embodiments, after the processing module 802 records multiple desensitization strategies for the first business table through the system table of the data warehouse, the communication module 801 is also used to obtain a first message sent by the client, the first message includes a first query statement input by the first user and the identifier of the first user, and the first query statement includes the identifier of the first business table. The processing module 802 is also used to respond to the first message, based on the identifier of the first business table, query multiple candidate desensitization strategies associated with the first business table from the system table; and based on the identifier of the first user, filter out a fourth desensitization strategy that matches the identifier of the first user from the multiple candidate desensitization strategies queried, the fourth desensitization strategy is used to configure the desensitization effect when the first user queries the first business table; and, based on the fourth desensitization strategy, perform data desensitization on the data queried by the first user in the first business table to obtain the first desensitized data. The communication module 801 is also used to send a second message to the client, the second message includes the first desensitized data.
[0158] Furthermore, the communication module 801 is also used to obtain a third message sent by the client, wherein the third message includes a second query statement input by a second user and an identifier of the second user, and the second query statement is the same as the first query statement. The processing module 802 is also used to query multiple candidate desensitization strategies associated with the first business table from the system table in response to the third message based on the identifier of the first business table; and based on the identifier of the second user, filter out a fifth desensitization strategy that matches the identifier of the second user from the multiple candidate desensitization strategies queried, and the fifth desensitization strategy is used to configure the desensitization effect when the second user queries the first business table, wherein the fourth desensitization strategy and the fifth desensitization strategy are different; and, based on the fifth desensitization strategy, perform data desensitization on the data queried by the second user in the first business table to obtain second desensitized data. The communication module 801 is also used to send a fourth message to the client, wherein the fourth message includes the second desensitized data.
[0159] In some embodiments, when the processing module 802 filters out a target desensitization policy that matches the identifier of the target user from multiple candidate desensitization policies that have been queried based on the identifier of the target user, it is specifically used to: based on the identifier of the target user, filter out multiple desensitization policies that match the identifier of the target user from multiple candidate desensitization policies that have been queried, and each of the multiple desensitization policies that match the identifier of the target user is used to configure the desensitization effect when the target user queries the first business table; use a desensitization policy with the highest priority among the multiple desensitization policies that match the identifier of the target user as the target desensitization policy, wherein the target user is the first user and the target desensitization policy is the fourth desensitization policy, or the target user is the second user and the target desensitization policy is the fifth desensitization policy.
[0160] It should be understood that the above-mentioned device is used to execute the method in the above-mentioned embodiment. The implementation principle and technical effect of the corresponding program module in the device are similar to those described in the above-mentioned method. The working process of the device can refer to the corresponding process in the above-mentioned method, which will not be repeated here.
[0161] For example, Fig. 9 FIG. 1 is a schematic diagram showing the structure of another device for hierarchical processing of data in a data warehouse provided by an embodiment of the present application. The device for hierarchical processing of data in a data warehouse can be deployed in a terminal device. Fig. 9 As shown, the hierarchical processing device 900 for data in the data warehouse may include: a processing module 901 and a communication module 902. The processing module 901 is used to obtain a first query statement input by a first user and a second query statement input by a second user, respectively. The first query statement and the second query statement are the same and include an identifier of a first business table. The communication module 902 is used to send a first message and a second message to a server, respectively. The first message includes the first query statement and the identifier of the first user, and the second message includes the second query statement and the identifier of the second user. The data warehouse configured in the server includes a first business table, and the first business table is associated with multiple desensitization strategies. The first desensitization strategy among the multiple desensitization strategies is used to configure the desensitization effect when the first user queries the first business table. The second desensitization strategy among the multiple desensitization strategies is used to configure the desensitization effect when the second user queries the first business table. The first desensitization strategy and the second desensitization strategy are different. The communication module 902 is further used to respectively obtain a third message and a fourth message sent by the server, wherein the third message includes first desensitized data, and the fourth message includes second desensitized data. The first desensitized data is obtained by desensitizing the data queried by the first user in the first business table based on the first desensitization strategy, and the second desensitized data is obtained by desensitizing the data queried by the second user in the first business table based on the second desensitization strategy. The processing module 901 is further used to respectively output the first desensitized data and the second desensitized data.
[0162] It should be understood that the above-mentioned device is used to execute the method in the above-mentioned embodiment. The implementation principle and technical effect of the corresponding program module in the device are similar to those described in the above-mentioned method. The working process of the device can refer to the corresponding process in the above-mentioned method, which will not be repeated here.
[0163] In some embodiments, Figure 8 The communication module 801 and the processing module 802 shown in the figure can be implemented by software or by hardware. For example, the implementation of the communication module 801 is described below by taking the communication module 801 as an example. Similarly, the implementation of the processing module 802 can refer to the implementation of the communication module 801. In addition, Fig. 9 The processing module 901 and the communication module 902 shown in FIG. 1 can also be implemented by software, or can be implemented by hardware, see the embodiment of FIG. Figure 8 The description of the communication module 902 and the processing module 901 shown in the figure will not be repeated here.
[0164] As an example of a software functional unit, the communication module 801 may include code running on a computing instance. Among them, the computing instance may include at least one of a physical host (computing device), a virtual machine, and a container. Further, the above-mentioned computing instance may be one or more. For example, the communication module 801 may include code running on multiple hosts / virtual machines / containers. It should be noted that the multiple hosts / virtual machines / containers used to run the code can be distributed in the same region (region) or in different regions. Furthermore, the multiple hosts / virtual machines / containers used to run the code can be distributed in the same availability zone (AZ) or in different AZs, each AZ including a data center or multiple data centers with similar geographical locations. Among them, usually a region can include multiple AZs.
[0165] Similarly, multiple hosts / virtual machines / containers used to run the code can be distributed in the same virtual private cloud (VPC) or in multiple VPCs. Usually, a VPC is set up in a region. For cross-region communication between two VPCs in the same region and between VPCs in different regions, a communication gateway needs to be set up in each VPC to achieve interconnection between VPCs through the communication gateway.
[0166] As an example of a hardware functional unit, the communication module 801 may include at least one computing device, such as a server, etc. Alternatively, the communication module 801 may also be a device implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD). The PLD may be a complex programmable logical device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
[0167] The multiple computing devices included in the communication module 801 can be distributed in the same region or in different regions. The multiple computing devices included in the communication module 801 can be distributed in the same AZ or in different AZs. Similarly, the multiple computing devices included in the communication module 801 can be distributed in the same VPC or in multiple VPCs. The multiple computing devices can be any combination of computing devices such as servers, ASICs, PLDs, CPLDs, FPGAs, and GALs.
[0168] It should be noted that, in other embodiments, the communication module 801 can be used to execute any step in the hierarchical processing method for data in the data warehouse described in the above embodiment, and the processing module 802 can be used to execute any step in the hierarchical processing method for data in the data warehouse described in the above embodiment. The steps that the communication module 801 and the processing module 802 are responsible for implementing can be specified as needed, and the communication module 801 and the processing module 802 respectively implement different steps in the hierarchical processing method for data in the data warehouse described in the above embodiment to achieve Figure 8 The overall functions of the device 800 for hierarchical processing of data in the data warehouse are shown.
[0169] The present application also provides a computing device 1000. Fig.10 As shown, computing device 1000 includes: bus 1002, processor 1004, memory 1006 and communication interface 1008. Processor 1004, memory 1006 and communication interface 1008 communicate through bus 1002. Computing device 1000 can be a server or an electronic device. It should be understood that the present application does not limit the number of processors and memories in computing device 1000.
[0170] The bus 1002 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.10 The bus 1004 may include a path for transmitting information between various components of the computing device 1000 (eg, the memory 1006, the processor 1004, and the communication interface 1008).
[0171] The processor 1004 may include any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).
[0172] The memory 1006 may include a volatile memory, such as a random access memory (RAM). The processor 1004 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).
[0173] The memory 1006 stores executable program codes, and the processor 1004 executes the executable program codes to respectively implement the aforementioned Figure 8 The functions of the communication module 801 and the processing module 802 shown in the embodiment are implemented to realize the hierarchical processing method of data in the data warehouse described in the above embodiment. That is, the memory 1006 stores instructions for executing the hierarchical processing method of data in the data warehouse described in the above embodiment.
[0174] Alternatively, the memory 1006 stores executable codes, and the processor 1004 executes the executable codes to respectively implement the aforementioned Figure 8The functions of the data classification processing device 800 in the data warehouse shown in the embodiment are implemented to realize the data classification processing method in the data warehouse described in the above embodiment. That is, the memory 1006 stores instructions for executing the data classification processing method in the data warehouse described in the above embodiment.
[0175] The communication interface 1003 uses a transceiver module such as, but not limited to, a network interface card or a transceiver to implement communication between the computing device 1000 and other devices or a communication network.
[0176] The embodiment of the present application also provides a computing device cluster. The computing device cluster includes at least one computing device. The computing device can be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device can also be an electronic device such as a desktop computer, a laptop computer, or a smart phone.
[0177] like Fig.11 As shown, the computing device cluster includes at least one computing device 1000. The memory 1006 in one or more computing devices 1000 in the computing device cluster may store the same instructions for executing the hierarchical processing method for data in the data warehouse described in the above embodiment.
[0178] In some possible implementations, the memory 1006 of one or more computing devices 1000 in the computing device cluster may also store partial instructions for executing the method for hierarchical processing of data in the data warehouse described in the above embodiment. In other words, the combination of one or more computing devices 1000 may jointly execute instructions for executing the method for hierarchical processing of data in the data warehouse described in the above embodiment.
[0179] It should be noted that the memory 1006 in different computing devices 1000 in the computing device cluster may store different instructions, which are respectively used to execute the aforementioned Figure 8 The illustrated data warehouse data classification processing device 800 has partial functions. That is, the instructions stored in the memory 1006 in different computing devices 1000 can implement the functions of one or more modules in the communication module 801 and the processing module 802.
[0180] In some possible implementations, one or more computing devices in the computing device cluster may be connected via a network, which may be a wide area network or a local area network. Fig.12 A possible implementation is shown. Fig.12As shown, two computing devices 1000A and 1000B are connected via a network. Specifically, the network is connected via a communication interface in each computing device. In this type of possible implementation, the memory 1006 in the computing device 1000A stores instructions for executing the functions of the communication module 801. At the same time, the memory 1006 in the computing device 1000B stores instructions for executing the functions of the processing module 802.
[0181] It should be understood that Fig.12 The functions of the computing device 1000A shown in FIG. 1000A may also be completed by multiple computing devices 1000. Similarly, the functions of the computing device 1000B may also be completed by multiple computing devices 1000.
[0182] The present application embodiment also provides another computing device cluster. The connection relationship between the computing devices in the computing device cluster can be similar to that of Fig.11 and Fig.12 The connection mode of the computing device cluster is different in that the memory 1006 in one or more computing devices 1000 in the computing device cluster may store the same instructions for executing the method in the above embodiment.
[0183] In some possible implementations, the memory 1006 of one or more computing devices 1000 in the computing device cluster may also respectively store partial instructions for executing the aforementioned method for hierarchical processing of data in the data warehouse. In other words, the combination of one or more computing devices 1000 may jointly execute instructions for executing the aforementioned method for hierarchical processing of data in the data warehouse.
[0184] Based on the method in the above embodiment, the embodiment of the present application provides a computer-readable storage medium, including computer program instructions. When the computer program instructions are executed by a computing device, the computing device executes the method in the above embodiment; or, when the computer program instructions are executed by a computing device cluster, the computing device cluster executes the method in the above embodiment. Exemplarily, the computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.
[0185] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product containing instructions, which, when executed by a computing device, enables the computing device to execute the method in the above embodiment, or, when executed by a computing device cluster, enables the computing device cluster to execute the method in the above embodiment.
[0186] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.
[0187] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.
[0188] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.
[0189] It should be understood that the various numerical numbers involved in the embodiments of the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application.
[0190] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the protection scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for hierarchical processing of data in a data warehouse, characterized in that: Applied to a server, wherein the server is provided with a data warehouse, the method comprises: Acquire multiple policy creation statements for the first business table in the data warehouse sent by the client, one of the policy creation statements is used to create a desensitization policy, and one of the desensitization policies is used to configure a desensitization effect when at least one query role queries the first business table; Parsing the plurality of policy creation statements respectively to obtain a plurality of desensitization policies for the first business table; Multiple desensitization strategies for the first business table are recorded through the system table of the data warehouse to associate the first business table with the multiple desensitization strategies.
2. The method according to claim 1, characterized in that The desensitization strategy includes: an identifier of the desensitization strategy, an identifier of the first business table, an identifier of a query role that triggers the desensitization strategy, a priority of the desensitization strategy, a desensitization field, and a desensitization function corresponding to the desensitization field.
3. The method according to claim 2, characterized in that The multiple desensitization strategies include a first desensitization strategy; the system table includes a first system table and a second system table; Recording a first desensitization strategy for the first business table through a system table of the data warehouse specifically includes: The identifier of the first desensitization policy, the identifier of the first business table, the identifier of the query role that triggers the first desensitization policy, and the priority of the first desensitization policy are recorded through a first tuple, and the identifier of the first desensitization policy, the desensitization fields involved in the first desensitization policy, and the desensitization function corresponding to the desensitization fields involved in the first desensitization policy are recorded through a second tuple; The first tuple is inserted into the first system table, and the second tuple is inserted into the second system table.
4. The method according to any one of claims 1 to 3, characterized in that: After recording a plurality of desensitization strategies for the first business table through the system table of the data warehouse, the method further includes: Obtaining a policy deletion statement for the first service table sent by the client, wherein the policy deletion statement includes an identifier of the second desensitization policy to be deleted and an identifier of the first service table; Parsing the policy deletion statement to obtain an identifier of the second desensitization policy and an identifier of the first service table; Based on the identifier of the second desensitization policy and the identifier of the first business table, the second desensitization policy is queried in the system table, and the second desensitization policy is deleted in the system table.
5. The method according to any one of claims 1 to 4, characterized in that: After recording a plurality of desensitization strategies for the first business table through the system table of the data warehouse, the method further includes: Obtaining a policy modification statement for the first service table sent by the client, wherein the policy modification statement includes an identifier of the third desensitization policy to be modified, an identifier of the first service table, a change item, and a modification method of the change item; Parsing the policy deletion statement to obtain the identifier of the third desensitization policy, the identifier of the first service table, the change item, and the modification method of the change item; Based on the identifier of the third desensitization strategy and the identifier of the first business table, querying the third desensitization strategy in the system table; Based on the modification method of the change item, the change item in the queried third desensitization strategy is modified.
6. The method according to any one of claims 1 to 5, characterized in that: After recording a plurality of desensitization strategies for the first business table through the system table of the data warehouse, the method further includes: Acquire a first message sent by the client, wherein the first message includes a first query statement input by a first user and an identifier of the first user, and the first query statement includes an identifier of the first service table; In response to the first message, based on the identifier of the first service table, querying from the system table a plurality of candidate desensitization strategies associated with the first service table; Based on the identifier of the first user, a fourth desensitization policy matching the identifier of the first user is selected from the multiple candidate desensitization policies obtained, wherein the fourth desensitization policy is used to configure a desensitization effect when the first user queries the first service table; Based on the fourth desensitization strategy, desensitize the data queried by the first user in the first business table to obtain first desensitized data; A second message is sent to the client, where the second message includes the first desensitized data.
7. The method according to claim 6, characterized in that Also includes: Acquire a third message sent by the client, wherein the third message includes a second query statement input by a second user and an identifier of the second user, wherein the second query statement is the same as the first query statement; In response to the third message, based on the identifier of the first service table, querying from the system table a plurality of candidate desensitization strategies associated with the first service table; Based on the identifier of the second user, a fifth desensitization strategy matching the identifier of the second user is screened out from the multiple candidate desensitization strategies that are queried, wherein the fifth desensitization strategy is used to configure a desensitization effect when the second user queries the first service table, wherein the fourth desensitization strategy is different from the fifth desensitization strategy; Based on the fifth desensitization strategy, desensitize the data queried by the second user in the first business table to obtain second desensitized data; A fourth message is sent to the client, wherein the fourth message includes the second desensitized data.
8. The method according to claim 6 or 7, characterized in that: Based on the identifier of the target user, a target desensitization strategy matching the identifier of the target user is selected from the multiple candidate desensitization strategies that are queried, including: Based on the identifier of the target user, multiple desensitization strategies matching the identifier of the target user are screened out from the multiple candidate desensitization strategies queried, and each of the multiple desensitization strategies matching the identifier of the target user is used to configure a desensitization effect when the target user queries the first business table; A desensitization policy with the highest priority among multiple desensitization policies that match the identifier of the target user is used as the target desensitization policy, wherein the target user is the first user and the target desensitization policy is the fourth desensitization policy, or the target user is the second user and the target desensitization policy is the fifth desensitization policy.
9. A method for hierarchical processing of data in a data warehouse, characterized in that: include: Respectively acquiring a first query statement input by a first user and a second query statement input by a second user, wherein the first query statement and the second query statement are the same and include an identifier of a first business table; Sending a first message and a second message to a server respectively, wherein the first message includes the first query statement and the identifier of the first user, and the second message includes the second query statement and the identifier of the second user, wherein the data warehouse configured in the server includes the first business table, and the first business table is associated with multiple desensitization strategies, a first desensitization strategy among the multiple desensitization strategies is used to configure a desensitization effect when the first user queries the first business table, and a second desensitization strategy among the multiple desensitization strategies is used to configure a desensitization effect when the second user queries the first business table, and the first desensitization strategy and the second desensitization strategy are different; Respectively obtaining a third message and a fourth message sent by the server, the third message including first desensitized data, the fourth message including second desensitized data, the first desensitized data being obtained by desensitizing data queried by the first user in the first business table based on the first desensitization strategy, and the second desensitized data being obtained by desensitizing data queried by the second user in the first business table based on the second desensitization strategy; The first desensitized data and the second desensitized data are output respectively.
10. A device for hierarchical processing of data in a data warehouse, characterized in that: Deployed on a server, the server is equipped with a data warehouse, and the device includes: A communication module, used for acquiring multiple policy creation statements for the first business table in the data warehouse sent by the client, wherein one of the policy creation statements is used for creating a desensitization policy, and one of the desensitization policies is used for configuring a desensitization effect when at least one query role queries the first business table; A processing module, used for parsing the plurality of policy creation statements respectively to obtain a plurality of desensitization policies for the first business table; The processing module is further used to record multiple desensitization strategies for the first business table through the system table of the data warehouse to associate the first business table with the multiple desensitization strategies.
11. A device for hierarchical processing of data in a data warehouse, characterized in that: Deployed on a terminal device, the device includes: A processing module, configured to respectively obtain a first query statement input by a first user and a second query statement input by a second user, wherein the first query statement and the second query statement are the same and include an identifier of a first business table; A communication module, used to send a first message and a second message to a server respectively, wherein the first message includes the first query statement and the identifier of the first user, and the second message includes the second query statement and the identifier of the second user, wherein the data warehouse configured in the server includes the first business table, and the first business table is associated with multiple desensitization strategies, a first desensitization strategy among the multiple desensitization strategies is used to configure a desensitization effect when the first user queries the first business table, and a second desensitization strategy among the multiple desensitization strategies is used to configure a desensitization effect when the second user queries the first business table, and the first desensitization strategy and the second desensitization strategy are different; The communication module is further used to respectively obtain a third message and a fourth message sent by the server, wherein the third message includes first desensitized data, and the fourth message includes second desensitized data, wherein the first desensitized data is obtained by desensitizing data queried by the first user in the first business table based on the first desensitization strategy, and the second desensitized data is obtained by desensitizing data queried by the second user in the first business table based on the second desensitization strategy; The processing module is also used to output the first desensitized data and the second desensitized data respectively.
12. A computing device cluster, characterized in that: comprising at least one computing device, each computing device comprising a processor and a memory; The processor of the at least one computing device is used to execute instructions stored in the memory of the at least one computing device, so that the computing device cluster executes the method according to any one of claims 1 to 8, or executes the method according to claim 9.
13. A computer-readable storage medium, characterized in that: The method comprises computer program instructions, which, when executed by a computing device cluster, enable the computing device cluster to execute the method according to any one of claims 1 to 8, or execute the method according to claim 9, wherein the computing device cluster comprises at least one computing device.
14. A computer program product comprising instructions, characterized in that When the instruction is executed by a computing device cluster, the computing device cluster executes the method according to any one of claims 1 to 8, or executes the method according to claim 9, wherein the computing device cluster includes at least one computing device.
