User data processing method, device, equipment and storage medium

Abstract

The present application discloses a user data processing method, device, equipment and storage medium, which relates to the field of computer technology. The method is applied to a data management platform, and the method includes: receiving user sensitive data; based on the user sensitive data, confirming that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing flow, sinking the first user sensitive data to the data storage system in real time; according to the second data processing flow, sinking the second user sensitive data to the data storage system. The present application can realize parallel business processing for different users during the implementation of user sensitive data sinking, and ensure uninterrupted business processing.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a user data processing method, device, equipment and storage medium. Background Art

[0002] During the implementation of user sensitive data sinking, in addition to existing business system users, new users will continue to be added to the business system. However, in order to ensure the smooth implementation of sensitive data sinking, the existing user data processing methods often do not distinguish between users and use a set of data processing procedures to process user sensitive data, resulting in the problem of being unable to ensure the smooth implementation of sensitive data sinking while ensuring uninterrupted business processing for existing and new users.

[0003] Therefore, how to achieve uninterrupted processing of sensitive data of different users is a technical problem that needs to be solved urgently.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of this application is to provide a user data processing method, device, equipment and storage medium, aiming to solve the technical problem of how to achieve uninterrupted processing of sensitive data of different users.

[0006] To achieve the above purpose, the present application proposes a user data processing method, which is applied to a data management platform and includes:

[0007] Receive sensitive user data;

[0008] Based on the user sensitive data, confirm that the user sensitive data that meets the preset condition is the first user sensitive data, and the user sensitive data that does not meet the preset condition is the second user sensitive data;

[0009] According to the first data processing flow, the first user sensitive data is stored in a data storage system in real time;

[0010] According to the second data processing flow, the second user sensitive data is sunk to the data storage system.

[0011] In one embodiment, the step of confirming, based on the user sensitive data, that the user sensitive data that meets the preset condition is the first user sensitive data and the user sensitive data that does not meet the preset condition is the second user sensitive data includes:

[0012] Based on the user sensitive data, determine the user type and the user sinking grayscale value;

[0013] Determine whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range;

[0014] If both are true, confirm that the user sensitive data is the first user sensitive data;

[0015] If the user type is not a preset user type, or if the user type is a preset user type and the user sinking grayscale value is not within the preset grayscale range, it is confirmed that the user sensitive data is second user sensitive data.

[0016] In one embodiment, before the step of determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range, the step includes:

[0017] The preset grayscale range is dynamically adjusted based on the operation status of data sinking of the data management platform within a preset time.

[0018] In one embodiment, before the step of determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range, the step further includes:

[0019] Based on the user sensitive data, determine whether the user is in a preset user whitelist;

[0020] When the user is in the preset user whitelist, confirming that the user sensitive data is the first user sensitive data;

[0021] When the user is not in the preset user whitelist, the step is executed: determining whether the user type is a preset user type, and whether the user sinking grayscale value is within a preset grayscale range.

[0022] In one embodiment, the data management platform includes a cloud database, and the step of sinking the second user sensitive data to the data storage system according to the second data processing flow includes:

[0023] Encrypting the second user's sensitive data to obtain second user encrypted data, and storing the second user's encrypted data in the cloud database;

[0024] Based on a preset timed task mechanism, the encrypted data of the second user is downloaded to the data storage system.

[0025] In one embodiment, the data management platform includes a cloud database, and after the step of sinking the first user sensitive data to the data storage system in real time according to the first data processing flow, the step further includes:

[0026] When the data is successfully transferred, the sensitive data of the first user is desensitized to obtain the desensitized data of the first user, and the desensitized data of the first user is stored in the cloud database;

[0027] When the data sinking fails, encrypting the first user's sensitive data to obtain the first user's encrypted data;

[0028] The encrypted data of the first user is stored in the cloud database, and a sinking failure record is made for the sensitive data of the first user to obtain a sinking failure record result;

[0029] Based on the preset timing task mechanism and the failure record result of the sinking, the first user encrypted data is re-sunk to the data storage system.

[0030] In one embodiment, the method further comprises:

[0031] Based on the user's sensitive data usage requirements, query and confirm whether the corresponding user sensitive data in the cloud database has been sunk;

[0032] When the user sensitive data has been sunk, judging whether the complete user sensitive data is needed according to the user sensitive data usage requirements;

[0033] If so, query the corresponding user complete sensitive data in the data storage system according to the user sensitive data to obtain the required data;

[0034] If not, determining that the user sensitive data is demand data;

[0035] When the user sensitive data is not sunk, the user sensitive data is decrypted and desensitized to obtain the required data.

[0036] In addition, to achieve the above-mentioned purpose, the present application also proposes a user data processing device, which is applied to a data management platform, and the user data processing device includes:

[0037] A receiving module, used for receiving user sensitive data;

[0038] A determination module, configured to determine, based on the user sensitive data, that the user sensitive data that meets a preset condition is first user sensitive data, and that the user sensitive data that does not meet the preset condition is second user sensitive data;

[0039] The data sinking module is used to sink the first user sensitive data to the data storage system in real time according to the first data processing process; and sink the second user sensitive data to the data storage system according to the second data processing process.

[0040] In addition, to achieve the above-mentioned purpose, the present application also proposes a user data processing device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the user data processing method described above.

[0041] In addition, to achieve the above objectives, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the user data processing method described above are implemented.

[0042] One or more technical solutions proposed in this application have at least the following technical effects:

[0043] The user data processing method, apparatus, device and storage medium proposed in the embodiments of the present application specifically receive user sensitive data; based on the user sensitive data, confirm that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing flow, sink the first user sensitive data to the data storage system in real time; according to the second data processing flow, sink the second user sensitive data to the data storage system.

[0044] This application receives user sensitive data in real time, classifies the user sensitive data according to preset conditions, and performs different data processing flows on the classified user sensitive data. It can realize parallel business processing for different users during the implementation of user sensitive data sinking, and ensure uninterrupted business processing while ensuring the smooth implementation of sensitive data sinking. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0046] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0047] Figure 1 A flowchart of the first embodiment of the method for processing user data of the present application is provided;

[0048] Figure 2 A flowchart of the second embodiment of the user data processing method of the present application is provided;

[0049] Figure 3 A flowchart of the third embodiment of the user data processing method of the present application is provided;

[0050] Figure 4 A flowchart of the fourth embodiment of the user data processing method of the present application is provided;

[0051] Figure 5 A flowchart of the fifth embodiment of the method for processing user data of the present application is provided;

[0052] Figure 6 This is a schematic diagram of the module structure of the user data processing device according to an embodiment of the present application;

[0053] Figure 7 Schematic diagram of the device structure of the hardware operating environment involved in the user data processing method in the embodiment of the present application.

[0054] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0055] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0056] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0057] The main solution of the embodiment of the present application is: receiving user sensitive data; based on the user sensitive data, confirming that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing flow, sinking the first user sensitive data to the data storage system in real time; according to the second data processing flow, sinking the second user sensitive data to the data storage system.

[0058] Technical terms involved in the embodiments of this application:

[0059] Data sinking: In the field of big data and cloud computing, data sinking refers to distributing data from centralized storage and processing systems to lower-level or edge devices for processing. The data sinking process can reduce the delay and cost of data transmission and improve the efficiency and real-time performance of data processing.

[0060] Due to the existing user data processing methods, in the process of implementing the user sensitive data sinking, due to the diversity of user types, in order to ensure the smooth implementation of sensitive data sinking, user sensitive data is often processed without distinguishing between users. As a result, there is a problem that while ensuring the smooth implementation of sensitive data sinking, it is impossible to ensure uninterrupted user business processing.

[0061] The present application provides a solution, which receives user sensitive data in real time, classifies the user sensitive data according to preset conditions, and performs different data processing flows on the classified user sensitive data. It can realize parallel business processing for different users during the implementation of user sensitive data sinking, and ensure uninterrupted business processing while ensuring the smooth implementation of sensitive data sinking.

[0062] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or a user data processing device capable of realizing the above functions, a data management platform, etc. The following takes the data management platform as an example to illustrate this embodiment and the following embodiments.

[0063] Based on this, the present application embodiment provides a user data processing method, referring to Figure 1 , Figure 1 This is a flowchart of the first embodiment of the user data processing method of the present application.

[0064] In this embodiment, the user data processing method is applied to a data management platform, and the user data processing method includes steps S110 to S140:

[0065] Step S110, receiving user sensitive data;

[0066] It should be noted that user sensitive data refers to data that may threaten the user's personal privacy and corporate trade secrets once it is leaked, tampered with or abused by an unauthorized third party. It includes but is not limited to the user's personal identity information (such as name, ID number, driver's license number, etc.), financial information (such as bank account number, credit card number, payment password, etc.), contact information (such as address, mobile phone number, work address, etc.), consumption preference information, user importance information, account information (such as system user account, password, login credentials, etc., account transaction information), etc.

[0067] Specifically, first, the data management platform needs to receive the user sensitive data generated by the business system so that it can subsequently process the received user sensitive data, such as data desensitization, data encryption storage, data access control, data security audit, etc., to ensure the security and confidentiality of the user's sensitive data and avoid the leakage of user sensitive data, causing losses to users and enterprises.

[0068] Step S120: based on the user sensitive data, confirm that the user sensitive data that meets the preset condition is the first user sensitive data, and the user sensitive data that does not meet the preset condition is the second user sensitive data;

[0069] It should be noted that the preset conditions are restrictive conditions set by relevant personnel based on actual user sensitive data processing needs.

[0070] In this embodiment, the preset condition may be that the user is in a user whitelist, or that the user is a newly added user, and the like.

[0071] Specifically, according to the preset conditions of the data management platform, the user sensitive data obtained above is screened and classified, the user sensitive data that meets the preset conditions is identified as the first user sensitive data, and then the user sensitive data that does not meet the preset conditions is identified as the second user sensitive data. It should be understood that the method of identification and classification is not limited in this embodiment, and it can be a common identification through tags.

[0072] In a feasible implementation manner, the step 120 may include steps A01 to A04:

[0073] Step A01, determining the user type and the user sinking gray value based on the user sensitive data;

[0074] It should be noted that the user sinking grayscale value is used to characterize the degree of data sinking completion or processing priority of user sensitive data, and can be obtained by processing any item of user sensitive data. For example, it can be uniformly set according to user importance information, and the sinking grayscale value of users with high importance is set to 0, so as to achieve priority data processing of user sensitive data with high importance.

[0075] In this embodiment, the user sinking gray value is determined based on the last two digits of the user's contact information (such as a mobile phone number or a landline number, etc.).

[0076] Specifically, the user sensitive data obtained above is analyzed to determine the corresponding user type, determine whether the user belongs to an existing user or a new user of the data management platform, and then the user sensitive data is processed to further determine the user sinking grayscale value.

[0077] Step A02, determining whether the user type is a preset user type, and whether the user sinking grayscale value is within a preset grayscale range;

[0078] Step A03: if both are true, confirm that the user sensitive data is the first user sensitive data;

[0079] Further, in step A04, if the user type is not a preset user type, or the user type is a preset user type and the user sinking grayscale value is not within the preset grayscale range, it is confirmed that the user sensitive data is second user sensitive data.

[0080] It is understandable that in order to ensure parallel business processing for existing users and new users of the business system, users can be screened and classified by user type and user sinking grayscale value, and user sensitive data of new users who need priority processing can be processed separately, while data processing for existing users can be carried out in parallel.

[0081] It should be noted that the preset user type refers to the user type that is pre-determined by relevant personnel based on the actual needs of user sensitive data processing, and the preset grayscale range refers to the grayscale value range that is pre-set by relevant personnel based on the actual needs of user sensitive data processing, which is used to determine whether user sensitive data needs to be processed first.

[0082] Specifically, the data management platform classifies the user sensitive data by determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range, and determines the user sensitive data that meets the above requirements as the first user sensitive data, and determines the user sensitive data that does not meet the above requirements as the second user sensitive data.

[0083] For example, the preset user type is a new user, and the preset grayscale range is 0-50. If the user type is a new user, and the user sinking grayscale value is within 0-50, it is confirmed that the user sensitive data is the first user sensitive data;

[0084] Further, if the user type belongs to an existing user and is not a newly added user, or the user type is a newly added user and the user sinking grayscale value is not within the range of 0-50, it is confirmed that the user sensitive data is the second user sensitive data.

[0085] In this implementation, by comprehensively considering the two conditions of whether the user is a preset user type and whether the user's sinking grayscale value is within the preset grayscale range, it is determined whether the data management platform needs to give priority to the received user sensitive data, thereby achieving uninterrupted processing of user data while also maintaining the smooth implementation of user data sinking.

[0086] Step S130: according to the first data processing flow, the first user sensitive data is sent to the data storage system in real time;

[0087] Step S140: According to the second data processing flow, the second user sensitive data is sent to the data storage system.

[0088] It should be noted that the first data processing process and the second data processing process are data processing processes pre-set on the data management platform by relevant personnel based on experience or actual user sensitive data processing needs, including but not limited to real-time data stream processing, timed or asynchronous data processing, and batch data processing of user sensitive data.

[0089] In this embodiment, the first data processing flow is to perform real-time data stream processing on user sensitive data, and the second data processing flow is to perform timed batch data processing on user sensitive data.

[0090] Specifically, the data management platform needs to perform real-time data sinking processing on the screened sensitive data of the first user, that is, input the sensitive data of the first user by calling the interface of the data storage system, and perform data encryption processing on the sensitive data of the first user. The data storage system refers to a database system for data storage at the bottom or edge, such as a local computer room.

[0091] The data management platform then divides the second user's sensitive data into batches, and sets a scheduled data processing task for each batch of the second user's sensitive data, so that the second user's sensitive data is regularly sent to the data storage system according to the batch order.

[0092] The present embodiment provides a user data processing method, which receives user sensitive data; based on the user sensitive data, confirms that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing flow, sinks the first user sensitive data to the data storage system in real time; according to the second data processing flow, sinks the second user sensitive data to the data storage system.

[0093] This application receives user sensitive data in real time, classifies the user sensitive data according to preset conditions, and performs different data processing flows on the classified user sensitive data. It can realize parallel business processing for different users during the implementation of user sensitive data sinking, and ensure uninterrupted business processing while ensuring the smooth implementation of sensitive data sinking.

[0094] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can refer to the above introduction, and will not be repeated later. Figure 2 , before the above step A02, it also includes steps S210 to S220:

[0095] Step S210, based on the user sensitive data, determining whether the user is in a preset user whitelist;

[0096] It should be noted that the preset user whitelist is a user list table pre-set by relevant personnel based on actual user sensitive data processing requirements, which is used to determine whether user sensitive data needs to be processed first.

[0097] In this embodiment, the identity identification information such as the user's mobile phone number information or ID card information contained in the user's sensitive data is used to confirm whether the corresponding identity identification information is registered in the preset user whitelist, thereby determining whether the user is in the preset user whitelist.

[0098] Step S220: when the user is in the preset user whitelist, confirming that the user sensitive data is the first user sensitive data;

[0099] Further, when the user is not in the preset user whitelist, step A02 is executed: determining whether the user type is a preset user type, and whether the user sinking grayscale value is within a preset grayscale range.

[0100] It should be understood that when it is confirmed that the user is in the preset user whitelist, it means that the corresponding user sensitive data needs to be processed by the data management platform in priority. Step A02 in Example 1 can be skipped to directly determine the current user sensitive data as the first user sensitive data.

[0101] Then, when it is confirmed that the user is not in the preset user whitelist, it is necessary to execute step A02 in Example 1 to further judge the current user sensitive data and confirm whether priority processing is required, so as to determine whether the current user sensitive data is the first user sensitive data or the second user sensitive data. The specific steps can refer to Example 1.

[0102] It can be understood that in order to achieve load balancing of the data management platform, the preset grayscale range can be dynamically self-adjusted to ensure smooth implementation of data sinking of user sensitive data. Therefore, before the above step A02, step B01 is also included:

[0103] Step B01, dynamically adjusting the preset grayscale range based on the operation status of data sinking of the data management platform within a preset time.

[0104] In this embodiment, the data management platform dynamically adjusts the preset grayscale range based on the data sinking operation status within a preset period of time, such as the number of data sinking exceptions, the amount of data sinking tasks, the running speed of the data management platform for data sinking, the maximum concurrency limit of the data management platform, and resource usage.

[0105] The present embodiment provides a user data processing method, which receives user sensitive data; determines the user type and the user sinking gray value based on the user sensitive data; determines whether the user is in a preset user white list based on the user sensitive data; when the user is in the preset user white list, confirms that the user sensitive data is first user sensitive data; when the user is not in the preset user white list, determines whether the user type is a preset user type, and whether the user sinking gray value is within a preset gray range; if both are true, confirms that the user sensitive data is first user sensitive data; if the user type is not a preset user type, or the user type is a preset user type, and the user sinking gray value is not within a preset gray range, confirms that the user sensitive data is second user sensitive data; according to the first data processing process, sinks the first user sensitive data to the data storage system in real time; according to the second data processing process, sinks the second user sensitive data to the data storage system.

[0106] Through the above scheme, this embodiment sets a preset user whitelist, comprehensively considers the user type and the user sinking grayscale value to determine whether the corresponding user sensitive data needs to be processed first, thereby realizing the classification and identification of user sensitive data, so as to perform parallel data processing on different categories of user sensitive data, so as to achieve load balancing on the data management platform and ensure uninterrupted data processing.

[0107] Based on the first embodiment and / or the second embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those in the first embodiment and / or the second embodiment can refer to the above description, and will not be described in detail later. Figure 3 , the data management platform includes a cloud database, and the step S140 includes steps S310-S320:

[0108] Step S310, encrypting the second user's sensitive data to obtain second user encrypted data, and storing the second user encrypted data in the cloud database;

[0109] Step S320: based on a preset timed task mechanism, the second user encrypted data is sent to a data storage system.

[0110] It should be understood that the processing priority of the second user's sensitive data obtained above is lower than that of the first user's sensitive data, so the second user's sensitive data needs to be encrypted and temporarily stored to prevent loss or leakage of user sensitive data.

[0111] Specifically, the data management platform first encrypts the sensitive data of the second user, for example, by using encryption algorithms such as MD5 (Message-Digest Algorithm 5), SHA (Secure Hash Algorithm), AES (Advanced Encryption Standard), DES (Data Encryption Standard), RSA (Rivest-Shamir-Adleman), and ECC (Elliptic Curve Cryptography), and obtains the encrypted data of the second user, and stores the encrypted data of the second user in the cloud database associated with the data management platform.

[0112] Then, based on the preset scheduled task mechanism, a scheduled data sinking task is set for the second user's encrypted data. At the same time, by setting the maximum task quantity of the data sinking task, the data management platform traverses the second user's encrypted data according to the maximum task quantity to determine the batch of task processing, and sinks the data to the data storage system asynchronously through the interface in a scheduled and batch manner.

[0113] Furthermore, because the users corresponding to the second user sensitive data in this embodiment include existing users and new users who do not meet the preset grayscale range, and the existing users in the business system are often far greater than the new users, before step S310, the data management platform can set a data sinking record table to register the user sensitive data sinking tasks corresponding to the new users who do not meet the preset grayscale range, so that the data management platform can easily find the user sensitive data sinking tasks for the new users who do not meet the preset grayscale range through the data sinking record table instead of through a full database query.

[0114] The present embodiment provides a user data processing method, which receives user sensitive data; based on the user sensitive data, confirms that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing flow, sinks the first user sensitive data to the data storage system in real time; encrypts the second user sensitive data to obtain second user encrypted data, and stores the second user encrypted data to the cloud database; based on a preset scheduled task mechanism, sinks the second user encrypted data to the data storage system.

[0115] Through the above scheme, this embodiment performs periodic batch data sinking processing on the classified second user sensitive data, so that the data management platform can realize parallel business processing for different users during the implementation of user sensitive data sinking, thereby ensuring smooth implementation of sensitive data sinking and uninterrupted business processing.

[0116] Based on the first embodiment and / or the second embodiment and / or the third embodiment of the present application, in the fourth embodiment of the present application, the same or similar contents as those in the first embodiment, the second embodiment and / or the third embodiment can refer to the above description and will not be described in detail later. Figure 4 , the data management platform includes a cloud database, and after the above step S130, further includes steps S410 to S440:

[0117] Step S410: when the data is successfully transferred to the cloud, the sensitive data of the first user is desensitized to obtain the desensitized data of the first user, and the desensitized data of the first user is stored in the cloud database;

[0118] It should be understood that after the first user's sensitive data is successfully sunk to the data storage system according to the first data processing process, in order to avoid leakage of the first user's sensitive data on the data management platform, it is necessary to desensitize the first user's sensitive data, such as by data masking, data encryption, pseudo data generation and other methods to obtain desensitized data of the first user's sensitive data, that is, the first user desensitized data.

[0119] Then, in order to facilitate the data management platform to use the user data in real time, the first user's anonymized data is stored in the cloud database associated with the data management platform.

[0120] Step S420: when data sinking fails, encrypt the first user sensitive data to obtain first user encrypted data;

[0121] Step S430, storing the encrypted data of the first user in the cloud database, and performing a sinking failure record on the sensitive data of the first user to obtain a sinking failure record result;

[0122] Step S440: based on the preset timed task mechanism and the failure record result of the download, the first user encrypted data is downloaded to the data storage system again.

[0123] It is understandable that when the first user's sensitive data fails to be downlinked to the data storage system according to the first data processing flow, it may be beyond the processing capacity of the data management platform. At this time, the task failure retry mechanism can be activated to perform data downlink retry processing on the first user's sensitive data that failed to be processed.

[0124] In this embodiment, after the first user sensitive data fails to be downloaded to the data storage system, the first user sensitive data to which the corresponding data has failed to be downloaded is retried with a delay.

[0125] First, the sensitive data of the first user needs to be encrypted, for example, using encryption algorithms such as MD5, SHA, AES, DES, RSA, ECC, etc. to encrypt the data and obtain the encrypted data of the first user. Then, the encrypted data of the first user needs to be stored in the cloud database associated with the data management platform. At the same time, the data sinking needs to be recorded and the sinking failure record result needs to be obtained. The sinking failure record result record includes but is not limited to the time when the data sinking failure occurred, the user information of the first user's encrypted data corresponding to the data sinking failure, and the storage path.

[0126] Finally, when retrying the sensitive data of the first user whose data sinking failed, determine the corresponding first user encrypted data that needs to be retried based on the sinking failure record result, and combine with the preset scheduled task mechanism to set the scheduled data sinking task for the first user encrypted data to be retried and all the second user encrypted data, so as to realize the scheduled and batch asynchronous sinking of data to the data storage system through the interface.

[0127] The present embodiment provides a user data processing method, which receives user sensitive data; based on the user sensitive data, confirms that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing flow, sinks the first user sensitive data to the data storage system in real time; when the data is successfully sunk, the first user sensitive data is desensitized to obtain the first user desensitized data, and the first user desensitized data is stored in the cloud database; when the data sinking fails, the first user sensitive data is encrypted to obtain the first user encrypted data; the first user encrypted data is stored in the cloud database, and the sinking failure record of the first user sensitive data is recorded to obtain the sinking failure record result; based on the preset scheduled task mechanism and the sinking failure record result, the first user encrypted data is sunk to the data storage system again; according to the second data processing flow, the second user sensitive data is sunk to the data storage system.

[0128] Through the above-mentioned scheme, this embodiment can improve the security and confidentiality of user sensitive data by desensitizing the user sensitive data after setting the data sinking successfully, and retrying the sinking of user sensitive data after setting the data sinking fails, while ensuring the smooth implementation and uninterrupted processing of data sinking.

[0129] Based on the first embodiment and / or the second embodiment and / or the third embodiment and / or the fourth embodiment of the present application, in the fifth embodiment of the present application, the same or similar contents as those in the first embodiment, the second embodiment, the third embodiment and / or the fourth embodiment can refer to the above description and will not be described in detail later. Figure 5 , the data management platform includes a cloud database, and after the above step S140, further includes steps S510 to S550:

[0130] Step S510: Based on the user's sensitive data usage requirements, query and confirm whether the corresponding user sensitive data in the cloud database has been sunk;

[0131] Specifically, when the data management platform receives user sensitive data usage requirements from relevant personnel, it first queries the corresponding encrypted user sensitive data in its associated cloud database, and confirms whether the user sensitive data obtained from the query is data that has been successfully sunk.

[0132] In this embodiment, it is determined whether the data has been sunk by confirming whether the data obtained by the query has a preset identifier.

[0133] Step S520: when the user sensitive data has been sunk, judging whether the complete user sensitive data is needed according to the user sensitive data usage requirements;

[0134] Step S530: If yes, query the corresponding complete sensitive data of the user in the data storage system according to the sensitive data of the user to obtain the required data;

[0135] Step S540: if not, determining that the user sensitive data is demand data;

[0136] Then, when it is confirmed that the encrypted user sensitive data has been sunk, the data stored in the cloud database is desensitized data. The data management platform needs to evaluate the user's sensitive data usage needs and further determine whether relevant personnel need to use the complete user sensitive data.

[0137] When relevant personnel need to use complete user sensitive data, the data management platform needs to query the data storage system to obtain the corresponding complete user sensitive data as the required data and provide it to the relevant personnel.

[0138] When relevant personnel do not need to use complete user sensitive data, the encrypted user sensitive data can be directly provided to the relevant personnel as required data.

[0139] Step S550: When the user sensitive data is not sunk, the user sensitive data is decrypted and desensitized to obtain the required data.

[0140] It can be understood that when it is confirmed that the encrypted user sensitive data has not been sunk, the data stored in the cloud database at this time is the encrypted user's complete sensitive data. The user sensitive data obtained by the query can be decrypted and desensitized to obtain the required data and provide it to relevant personnel.

[0141] It should be understood that when it is confirmed that the encrypted user sensitive data has not been sunk, the data management platform can also evaluate the user's sensitive data usage needs, and further determine whether relevant personnel need to use the complete user sensitive data, thereby deciding whether data desensitization is required.

[0142] The present embodiment provides a user data processing method, which receives user sensitive data; based on the user sensitive data, confirms that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing process, sinks the first user sensitive data to the data storage system in real time; according to the second data processing process, sinks the second user sensitive data to the data storage system; based on the user sensitive data usage requirements, inquires and confirms whether the corresponding user sensitive data in the cloud database has been sunk; when the user sensitive data has been sunk, determines whether the complete user sensitive data is needed according to the user sensitive data usage requirements; if so, inquires the corresponding user complete sensitive data in the data storage system according to the user sensitive data to obtain the required data; if not, determines that the user sensitive data is the required data; when the user sensitive data has not been sunk, decrypts and desensitizes the user sensitive data to obtain the required data.

[0143] Through the above scheme, this embodiment queries the corresponding user sensitive data according to the user sensitive data usage requirements, determines whether the user sensitive data has been sunk, and evaluates whether the complete user sensitive data needs to be used, and then decides to associate the cloud database or data storage system to obtain the required data, thereby realizing the business use of the user sensitive data.

[0144] This application also provides a user data processing device, please refer to Figure 6 , the user data processing device is applied to the data management platform, and the user data processing device includes:

[0145] A receiving module 10, used for receiving user sensitive data;

[0146] A determination module 20, configured to determine, based on the user sensitive data, that the user sensitive data that meets the preset conditions is the first user sensitive data, and that the user sensitive data that does not meet the preset conditions is the second user sensitive data;

[0147] The data sinking module 30 is used to sink the first user sensitive data to the data storage system in real time according to the first data processing process; and sink the second user sensitive data to the data storage system according to the second data processing process.

[0148] The user data processing device provided in the present application adopts the user data processing method in the above embodiment, which can solve the technical problem of how to achieve uninterrupted processing of sensitive data of different users.

[0149] Compared with the prior art, the beneficial effects of the user data processing device provided in the present application are the same as the beneficial effects of the user data processing method provided in the above embodiment, and other technical features in the user data processing device are the same as the features disclosed in the above embodiment method, which will not be repeated here.

[0150] The present application provides a user data processing device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the user data processing method in the above-mentioned embodiment.

[0151] Reference below Figure 7 , which shows a schematic diagram of the structure of a user data processing device suitable for implementing an embodiment of the present application. The user data processing device in the embodiment of the present application may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The user data processing device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0152] like Figure 7As shown, the user data processing device may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the user data processing device are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the user data processing device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows a user data processing device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or provided instead.

[0153] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0154] The user data processing device provided in the present application adopts the user data processing method in the above embodiment, which can solve the technical problem of how to achieve uninterrupted processing of sensitive data of different users.

[0155] Compared with the prior art, the beneficial effects of the user data processing device provided by the present application are the same as the beneficial effects of the user data processing method provided by the above embodiment, and other technical features in the user data processing device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0156] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0157] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0158] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, wherein the computer-readable program instructions are used to execute the user data processing method in the above-mentioned embodiment.

[0159] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0160] The computer-readable storage medium may be included in the user data processing device; or may exist independently without being installed in the user data processing device.

[0161] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the user data processing device, the user data processing device: receives user sensitive data; based on the user sensitive data, confirms that the user sensitive data that meets the preset conditions is the first user sensitive data, and the user sensitive data that does not meet the preset conditions is the second user sensitive data; according to the first data processing process, sinks the first user sensitive data to the data storage system in real time; according to the second data processing process, sinks the second user sensitive data to the data storage system.

[0162] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0163] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0164] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0165] The readable storage medium provided in the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned user data processing method, and can solve the technical problem of how to achieve uninterrupted processing of sensitive data of different users.

[0166] Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the present application are the same as the beneficial effects of the user data processing method provided in the above embodiment, and will not be elaborated here.

[0167] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.

Claims

1. A user data processing method, characterized in that: The method is applied to a data management platform, the data management platform includes a cloud database, and the method includes: Receive sensitive user data; Based on the user sensitive data, confirm that the user sensitive data that meets the preset condition is the first user sensitive data, and the user sensitive data that does not meet the preset condition is the second user sensitive data; According to the first data processing flow, the first user sensitive data is stored in a data storage system in real time; According to the second data processing flow, sinking the second user sensitive data to the data storage system; The step of confirming, based on the user sensitive data, that the user sensitive data that meets the preset condition is the first user sensitive data and the user sensitive data that does not meet the preset condition is the second user sensitive data includes: Based on the user sensitive data, determine the user type and the user sinking grayscale value; Determine whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range, wherein the user sinking grayscale value is used to characterize the degree of data sinking completion or processing priority of user sensitive data; If both are true, confirm that the user sensitive data is the first user sensitive data; If the user type is not a preset user type, or if the user type is a preset user type and the user sinking grayscale value is not within the preset grayscale range, confirming that the user sensitive data is second user sensitive data; Before the step of determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range, the method includes: Dynamically adjust the preset grayscale range based on the operation status of data sinking of the data management platform within a preset time; Before the step of determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range, the step further includes: Based on the user sensitive data, determine whether the user is in a preset user whitelist; When the user is in the preset user whitelist, confirming that the user sensitive data is the first user sensitive data; When the user is not in the preset user whitelist, the steps are executed: determining whether the user type is a preset user type, and whether the user sinking grayscale value is within a preset grayscale range; The step of sinking the second user sensitive data to the data storage system according to the second data processing flow includes: Encrypting the second user's sensitive data to obtain second user encrypted data, and storing the second user's encrypted data in the cloud database; Based on a preset timed task mechanism, the encrypted data of the second user is sent to a data storage system; Wherein, after the step of sinking the first user sensitive data to the data storage system in real time according to the first data processing flow, the method further includes: When the data is successfully transferred, the sensitive data of the first user is desensitized to obtain the desensitized data of the first user, and the desensitized data of the first user is stored in the cloud database; When the data sinking fails, encrypting the first user's sensitive data to obtain the first user's encrypted data; The encrypted data of the first user is stored in the cloud database, and a sinking failure record is made for the sensitive data of the first user to obtain a sinking failure record result; Based on the preset timing task mechanism and the failure record result of the sinking, the first user encrypted data is re-sunk to the data storage system.

2. The method according to claim 1, characterized in that The method further comprises: Based on the user's sensitive data usage requirements, query and confirm whether the corresponding user sensitive data in the cloud database has been sunk; When the user sensitive data has been sunk, judging whether the complete user sensitive data is needed according to the user sensitive data usage requirements; If so, query the corresponding user complete sensitive data in the data storage system according to the user sensitive data to obtain the required data; If not, determining that the user sensitive data is demand data; When the user sensitive data is not sunk, the user sensitive data is decrypted and desensitized to obtain the required data.

3. A user data processing device, characterized in that: The user data processing device is applied to a data management platform, the data management platform includes a cloud database, and the user data processing device includes: A receiving module, used for receiving user sensitive data; A determination module, configured to determine, based on the user sensitive data, that the user sensitive data that meets a preset condition is first user sensitive data, and that the user sensitive data that does not meet the preset condition is second user sensitive data; A data sinking module, configured to sink the first user sensitive data to a data storage system in real time according to a first data processing flow; and sink the second user sensitive data to a data storage system according to a second data processing flow; The determination module is further used to determine the user type and the user sinking gray value based on the user sensitive data; determine whether the user type is a preset user type and whether the user sinking gray value is within a preset gray range, wherein the user sinking gray value is used to characterize the degree of data sinking completion or processing priority of the user sensitive data; if both are true, confirm that the user sensitive data is the first user sensitive data; if the user type is not the preset user type, or the user type is the preset user type and the user sinking gray value is not within the preset gray range, confirm that the user sensitive data is the second user sensitive data; The determination module is further configured to dynamically adjust the preset grayscale range based on the operation of data sinking of the data management platform within a preset time before the step of determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range; The determination module is further configured to determine whether the user is in a preset user whitelist based on the user sensitive data before the step of determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range; when the user is in the preset user whitelist, confirm that the user sensitive data is the first user sensitive data; when the user is not in the preset user whitelist, execute the step of: determining whether the user type is a preset user type and whether the user sinking grayscale value is within a preset grayscale range; The data sinking module is further used to encrypt the second user's sensitive data to obtain the second user's encrypted data, and store the second user's encrypted data in the cloud database; based on a preset timed task mechanism, sink the second user's encrypted data to the data storage system; The data sinking module is also used for, after the step of sinking the first user sensitive data to the data storage system in real time according to the first data processing flow, further including: when the data is successfully sunk, the first user sensitive data is desensitized to obtain the first user desensitized data, and the first user desensitized data is stored in the cloud database; when the data sinking fails, the first user sensitive data is encrypted to obtain the first user encrypted data; the first user encrypted data is stored in the cloud database, and the sinking failure record of the first user sensitive data is recorded to obtain the sinking failure record result; based on the preset scheduled task mechanism and the sinking failure record result, the first user encrypted data is re-sunk to the data storage system.

4. A user data processing device, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the user data processing method according to any one of claims 1 to 2.

5. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the user data processing method according to any one of claims 1 to 2 are implemented.

Images