Sensitive data collection method and device and data processing equipment
A technology for data processing equipment and sensitive data, applied in digital data processing, special data processing applications, database indexing, etc., can solve problems such as long time spent, long execution time, poor random query performance of the database, etc., to reduce execution time , the effect of improving query performance
Pending Publication Date: 2020-09-08
南京星邺汇捷网络科技有限公司
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The above realizes the query of sensitive data in the database, but there are many shortcomings in performance: the random query performance of the database is very poor, and in the case of a large amount of data, it often takes a long time to execute SQL; the number of many production database tables is very large, tens of thousands Even for hundreds of thousands of tables, the performance of sequential collection and regular pattern matching is poor, and it takes a long time; there will be a large number of tables distinguished by year, month, and day in the production database. The same structure data consumes a lot of resources
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0040] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. The components of the embodiments of the invention generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.
[0041] Accordingly, the following detailed description of the embodiments of the invention provided in the accompanying drawings is not intended to limit the scope of the claimed invention, but merely represents selected embodiments of the invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.
[0042] It should be noted that relative ter...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The embodiment of the invention provides a sensitive data collection method and device and data processing equipment, and relates to the field of database data collection. The method comprises the steps of uniformly dividing all database tables into at least two subsets, and transmitting the subsets to all asynchronous subtasks, wherein the subset comprises at least two database tables; acquiringsensitive data in the subsets by the asynchronous subtasks to obtain collection results; after all the asynchronous subtasks collect the database tables in the corresponding subsets, gathering the collection results of the asynchronous subtasks by the main thread and outputting sensitive data information. According to the method, the database table is uniformly divided into the plurality of subsets, and the data in the subsets is simultaneously acquired through different asynchronous subtasks, so that the SQL statement execution time is shortened, and the database query performance is improved.
Description
technical field [0001] The invention relates to the field of database data collection, in particular to a sensitive data collection method, device and data processing equipment. Background technique [0002] Usually, the discovery of sensitive data in the database includes the following steps: first classify and classify sensitive data, define sensitive data rules, configure sensitive data discovery rules and discovery strategies, and then connect to the target database through a program, and collect a certain number of data in each table in order Random data, and then perform regular pattern matching on the collected data according to the policy library, analyze sensitive data information, and finally form a sensitive data view. The above realizes the query of sensitive data in the database, but there are many shortcomings in performance: the random query performance of the database is very poor, and in the case of a large amount of data, it often takes a long time to execu...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/242G06F16/2453
CPCG06F16/2282G06F16/2433G06F16/2453
Inventor 赵磊夏云洋黄哲苏入刘树权
Owner 南京星邺汇捷网络科技有限公司