Hive database dynamic desensitization system and implementation method

An implementation method and database technology, applied in the field of database security, to achieve the effects of supporting business diversity, ensuring effectiveness, and ensuring query performance

Inactive Publication Date: 2021-09-03
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical task of the present invention is to provide a Hive database dynamic desensitization system and its implementation method to solve how to realize real-time desensitization of sensitive data when querying data dynamically, to ensure the validity of original data and query performance while avoiding sensitive data the risk of leakage

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hive database dynamic desensitization system and implementation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] Hive database dynamic desensitization system of the present invention, this system adopts Java Web technology stack to carry out project development, realizes based on SpringBoot framework, and combines the sensitive data in real-time dynamic desensitization hive database of Ranger technology stack; This system comprises,

[0041] The desensitization algorithm management unit is used to synchronize the desensitization algorithm to the Hive database in the form of a UDF function;

[0042] The desensitization algorithm rule unit is used to manage the relationship between Hive data, users and desensitization algorithms, and set desensitization rules for fields in the Hive data table; among them, desensitization rules support setting different desensitization algorithms for different users .

[0043] Develop the web front-end page of the desensitization algorithm management unit. The web front-end page of the desensitization algorithm management unit is based on jsp and js ...

Embodiment 2

[0050] as attached figure 1 Shown, the Hive database dynamic desensitization realization method of the present invention, the method is specifically as follows:

[0051] S1. Realize the operation of adding, modifying and deleting the desensitization algorithm through the desensitization algorithm management unit;

[0052] S2. Register the desensitization algorithm as a UDF function of the Hive database through the Hive component; at the same time, synchronize the desensitization algorithm definition information to the Ranger component;

[0053] S3. Realize the operation of adding, modifying and deleting dynamic masking rules through the masking rule management unit;

[0054] S4. Synchronize the rule information to the Ranger component through the REST API of Ranger, as a strategy for dynamic desensitization of the Hive database;

[0055] S5. Enable the Ranger plug-in in the Hive component. When querying the Hive database, based on the original function, when the desensitizat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Hive database dynamic desensitization system and an implementation method, belongs to the technical field of database security, and aims to solve the technical problem of how to realize real-time desensitization of sensitive data during dynamic data query and avoid the leakage risk of the sensitive data while ensuring the validity and query performance of original data. According to the technical scheme, the system adopts a Java Web technology stack to carry out project development, is realized based on a SpringBoot framework and is combined with a Ranger technology stack to dynamically desensitize sensitive data in a hive database in real time; the system comprises a desensitization algorithm management unit and a desensitization algorithm rule unit, wherein the desensitization algorithm management unit is used for synchronizing a desensitization algorithm to a Hive database in a UDF function mode; and the desensitization algorithm rule unit is used for managing relations among Hive data, users and desensitization algorithms and setting desensitization rules for fields in a Hive data table, wherein the desensitization rule supports setting of different desensitization algorithms for different users.

Description

technical field [0001] The invention relates to the technical field of database security, in particular to a Hive database dynamic desensitization system and an implementation method. Background technique [0002] In the information age, data is a valuable asset. Regardless of whether enterprises or government units are collecting, storing, and sharing data intentionally or unintentionally every day, the scale is getting bigger and bigger. Dealing with all kinds of data is the only way for modern enterprises to grow, but the risk of sensitive data leakage is also increasing day by day. [0003] With the development of the information industry, the use of data warehouse technology is becoming more and more common, and the Hive database is an indispensable data storage tool for data warehouses. Identity card information, hotel check-in records, user payment information, etc. Once leaked, these data will involve personal privacy and security. Data desensitization is a techno...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F21/62G06F16/28G06F9/54G06F8/38G06F8/30
CPCG06F21/6245G06F16/284G06F9/543G06F8/38G06F8/315
Inventor 张滨胡清李国涛
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap