User information storage control method, device, equipment and storage medium

Abstract

The present invention relates to the technical field of data processing, and discloses a user information storage control method, including: performing standardized processing on user data, extracting user information in a preset format from a standard format file; generating a mapping subtable according to the mapping identifiers of desensitized data and sensitive fields; dividing the non-sensitive fields in the user information into regularized field information and non-regularized field information, mapping and storing the divided regularized field information and non-regularized field information according to a predetermined information coding mapping table, so as to generate a storage mapping table corresponding to the non-sensitive field; associating the user unique identity code in the user information with the corresponding mapping subtable and storage mapping table to generate a mapping master table, and storing the mapping subtable, mapping master table and storage mapping table in the same storage area, or respectively storing them in a plurality of different storage areas. The present invention can improve data storage security and reduce storage capacity.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a user information storage control method, device, equipment and storage medium. Background Art

[0002] At present, users usually install multiple applications on the client side. When using the application, in order to distinguish and verify the user's identity, the application usually requires the user to upload user information. Since the storage channels of various user information are often different, the user needs to manually search for his or her own user information through multiple channels to enter it, which is inefficient and prone to errors. In addition, most of the user information required by different applications is the same, such as name, address, mobile phone number, and ID card.

[0003] The existing user information storage control technology requires repeated input of the same information in multiple applications when uploading user information, resulting in a large number of repeated operations. In addition, the information acquisition method is complicated and cumbersome each time the user needs to obtain user information. The original data is stored in the server, which makes the data easy to leak and the original data storage capacity space is larger, thereby making the data storage security lower and the storage capacity higher. Summary of the invention

[0004] The present invention provides a user information storage control method, device, equipment and storage medium, the main purpose of which is to solve the problem of low data storage security and high storage capacity.

[0005] To achieve the above object, the present invention provides a user information storage control method, comprising: Receiving user information of each user sent by the user terminal, performing standardization processing on each of the user information to obtain a corresponding standard format file, and extracting user information in a preset format from the standard format file using a multimodal information acquisition model; Desensitizing the sensitive fields in the user information to obtain desensitized data, and generating a mapping subtable according to the desensitized data and the mapping identifier of the sensitive fields; The non-sensitive fields in the user information are divided into regularized field information and non-regularized field information, and the divided regularized field information and non-regularized field information are mapped and stored according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields; The user unique identity code in the user information is associated with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and the mapping sub-table, the mapping main table and the storage mapping table are stored in the same storage area, or respectively stored in multiple different storage areas.

[0006] Optionally, after receiving the original user information decryption request with the user's unique identity code sent by the user terminal, directly or after the authority verification is passed, the mapping sub-table and storage mapping table corresponding to the user's unique identity code are determined according to the mapping main table, and the original user information of the sensitive fields and non-sensitive fields corresponding to the user's unique identity code are fed back to the user terminal.

[0007] Optionally, the extracting the user information in a preset format from each of the standard format files using the multimodal information collection model includes: Utilizing the multimodal information collection model to receive the input standard format file and user information extraction instructions, wherein the user information extraction instructions include extraction content and a corresponding preset format; When the file type corresponding to the standard format file is a unique file type, extracting deep features of the standard format file using the multimodal information acquisition model to obtain structured file features; When the standard format file is a file set including files of multiple file types, the multimodal information acquisition model is used to extract the deep features of each file in the file set respectively, and the features extracted from each file are fused to obtain structured file features; According to the user information extraction instruction, extracted content in a preset format is obtained from the file feature as user information in a preset format.

[0008] Optionally, before desensitizing the sensitive fields in the user information, the method further includes: Returning the user information in the preset format to the user terminal; The user terminal generates and displays a user information display and operation interface with a confirmation operation control and a modification operation control, so that the user can issue a confirmation instruction for the displayed user information in the preset format based on the confirmation operation control, or the user can modify and provide feedback on the displayed user information in the preset format based on the modification operation control; When the confirmation instruction is received from the user end, the user information in the preset format is used as the data to be desensitized; or, when the modified user information is received from the user end, the modified user information is used as the data to be desensitized.

[0009] Optionally, generating a mapping subtable according to the desensitized data and the mapping identifier of the sensitive field includes: Identify the desensitization type corresponding to the desensitized data, and determine the desensitization attribute corresponding to the desensitized data according to the desensitization type; Creating a mapping structure corresponding to the desensitization type according to the desensitization attribute and the mapping identifier of the sensitive field; Generate a mapping format corresponding to the desensitization type according to the mapping structure, and generate a mapping sub-table corresponding to the desensitization type according to the mapping format and the mapping identifier; The attribute data of the desensitizing attribute corresponding to the desensitizing type is stored in the mapping subtable.

[0010] Optionally, before mapping and storing the divided regularized field information and non-regularized field information according to the predetermined information coding mapping table, the method further includes: Calculate the repetition of regularized field information and non-regularized field information in the pre-acquired historically stored user information; Filter the regularized field information to be encoded and the non-regularized field information to be encoded in the regularized field information and the non-regularized field information according to the repetition degree; The regularized field information to be encoded and the non-regularized field information to be encoded are field encoded, and the encoded regularized field information to be encoded and the non-regularized field information to be encoded are collected into an information encoding mapping table.

[0011] Optionally, the mapping and storing the divided regularized field information and the non-regularized field information according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive field includes: Querying the regularized information code corresponding to the regularized field information and the non-regularized information code corresponding to the non-regularized field information in the information code mapping table; Mapping and storing the regularized information code and the regularized field information to obtain a regularized storage mapping table corresponding to the regularized field information; Mapping and storing the irregular information code and the irregular field information to obtain an irregular storage mapping table; The regularized storage mapping table and the irregular storage mapping table are aggregated into a storage mapping table corresponding to a non-sensitive field.

[0012] In order to solve the above problem, the present invention further provides a user information storage control device, the device comprising: The data collection module is used to receive user information of each user sent by the user terminal, perform standardization processing on each of the user information to obtain a corresponding standard format file, and extract user information in a preset format from each of the standard format files using a multimodal information collection model; A sensitive data mapping module, used to desensitize the sensitive fields in the user information to obtain desensitized data, and generate a mapping subtable according to the desensitized data and the mapping identifier of the sensitive field; A field information mapping module, used to divide the non-sensitive fields in the user information into regularized field information and non-regularized field information, and map and store the divided regularized field information and non-regularized field information according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields; The data storage module is used to associate the user's unique identity code in the user information with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and store the mapping sub-table, the mapping main table and the storage mapping table in the same storage area, or store them in multiple different storage areas respectively.

[0013] In order to solve the above problem, the present invention further provides an electronic device, the electronic device comprising: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor. When the computer program is executed by the at least one processor, the above-mentioned user information storage control method is implemented.

[0014] In order to solve the above problem, the present invention also provides a computer-readable storage medium, in which at least one computer program is stored. When the at least one computer program is executed by a processor in an electronic device, the above user information storage control method is implemented.

[0015] The embodiment of the present invention obtains user information uniformly through an information collection application based on a multimodal information collection model, and can convert various types and styles of user data uploaded by users into user information in a standard format, which is convenient for subsequent information calls and unified maintenance, and convenient for user information storage; data desensitization is performed on sensitive fields, and a mapping subtable is generated. The desensitization process can ensure that sensitive data will not be leaked during storage and transmission, reducing the risk of data leakage; a mapping master table is generated, and desensitized data and mapping identifiers are stored. Desensitized data and mapping information are stored separately and associated through the master table to ensure that the data remains intact and available after desensitization; information is divided into regularized and non-regularized parts, which helps to optimize and process different types of data respectively, and reduce unnecessary duplicate information storage; the mapping table is separated and stored in a cloud database and expired information is regularly detected, which improves the accuracy of user information. Therefore, the user information storage control method, electronic device and non-volatile computer-readable storage medium proposed in the present invention can improve data storage security and reduce storage capacity. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic diagram of a flow chart of a user information storage control method provided by an embodiment of the present invention; Figure 2 A functional module diagram of a user information storage control device provided by an embodiment of the present invention; Figure 3 A schematic diagram of the structure of a computer device in one embodiment of the present invention; Figure 4 FIG. 4 is another schematic diagram of the structure of a computer device in one embodiment of the present invention.

[0017] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0018] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0019] The embodiment of the present application provides a user information storage control method. The execution subject of the user information storage control method includes but is not limited to at least one of the electronic devices such as a server, a terminal, etc. that can be configured to execute the method provided by the embodiment of the present application. In other words, the user information storage control method can be executed by software or hardware installed on a terminal device or a server device, and the software can be a blockchain platform. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc. The server can be an independent server, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.

[0020] Reference Figure 1 FIG. 1 is a flow chart of a user information storage control method provided by an embodiment of the present invention. In this embodiment, the user information storage control method includes: S1. Receive user information of each user sent by the user terminal, standardize each of the user information to obtain a corresponding standard format file, and use a multimodal information acquisition model to extract user information in a preset format from each of the standard format files.

[0021] In an embodiment of the present invention, the user end communicates with the server end through an installed information collection app (i.e., an information collection application), and receives user information uploaded by the user through a data upload interface provided by the information collection app; the server end includes a preprocessing module, a multimodal information collection model, and a cloud database.

[0022] In an embodiment of the present invention, the user data may be a text file, an image file or a voice file in any format. The user data is preprocessed by a preprocessing module to obtain a standard format file, and the standard format file refers to the input data format corresponding to the multimodal information acquisition model.

[0023] In an embodiment of the present invention, the standardized processing of the user data to obtain a standard format file includes: identifying the format of the user data, converting the user data into a file in a standard format, and the standard format file is the input data format corresponding to the multimodal information acquisition model.

[0024] In detail, the multimodal information collection model (for example, NExT-GPT, MM-LLM and other models) can identify and extract information files, such as text files in word or txt format, image files in jpg or png format, and audio files in mp3 or WAV format. For example, a user opens the data upload interface on the information collection app on the user side and uploads the user data to the server side. The server side identifies the file type of the user data through a preprocessing module (for example, there are many preprocessing modules on the market that can perform file type identification, such as Libmagic, Mime-Detective, file-type, etc.), and converts the format of the user data according to the file format that the multimodal information collection model can identify and extract information: when the file type is a text file, convert the user data into a txt text file; when the file type is an image file, convert the user data into a png image file; when the file type is an audio file, convert the user data into a wav audio file.

[0025] In the embodiment of the present invention, the extracting the user information in a preset format from each of the standard format files using the multimodal information collection model includes: Utilizing the multimodal information collection model to receive the input standard format file and user information extraction instructions, wherein the user information extraction instructions include extraction content and a corresponding preset format; When the file type corresponding to the standard format file is a unique file type, extracting deep features of the standard format file using the multimodal information acquisition model to obtain structured file features; When the standard format file is a file set including files of multiple file types, the multimodal information acquisition model is used to extract the deep features of each file in the file set respectively, and the features extracted from each file are fused to obtain structured file features; According to the user information extraction instruction, extracted content in a preset format is obtained from the file feature as user information in a preset format.

[0026] In detail, the user information extraction instruction is a text described in natural language, the user data in the preset format is a string in JSON format, and the user uses the information collection APP on the user side to upload user information in any format to the server side. The server side pre-processes the user information and inputs it into the multimodal information collection model to extract user information in the preset format.

[0027] For example, the user information input by the user is the following document: "I am Zhang X, an 18-year-old boy. I hope to show you my unique personality and abilities here. My mobile phone number is: 187XXXXXXXX, QQ number: 371XXXXX First of all, I would like to talk about my personality. I consider myself lively and cheerful, always full of a positive attitude towards life. This enables me to easily integrate into various social occasions and establish good interpersonal relationships with people. This personality trait is also reflected in my hobbies. I love sports, especially badminton, table tennis and basketball. These sports make me happy, not only exercise my body, but also cultivate my teamwork and leadership skills. As a class sports committee member, I have successfully organized many sports events, which has exercised my organizational and coordination skills. In addition to sports, I am also keen on volunteer work. I have participated in a volunteer program to help primary school students improve their reading skills. This experience not only made me more concerned about social issues, but also taught me patience and responsibility. I believe that through volunteer work, we can improve the community and society and benefit more people. In the future, I hope to continue to develop my skills and personality traits. I plan to continue to delve into the field of sports, perhaps becoming a sports coach to pass on my enthusiasm to more people. At the same time, I also hope to continuously improve myself and make more contributions to society through learning and volunteer work. Thank you for listening. "And uploaded the front and back images of the ID card.

[0028] Specifically, the server converts the above document into a txt file, converts the ID card image into a png file, inputs the txt file and the png file into the multi-modal information collection model, and extracts the user information according to the instruction "Please extract the user's name, age, mobile phone number, QQ, ID card number, ID card validity period, gender, personality traits, hobbies, job title, volunteer experience, volunteer work lessons, future plans, etc. in the preset JSON format". The text data in the preset format obtained by extraction is: "{ "Name": "Zhang X", "Age": 18, "Mobile phone number": "187XXXXXXXX", "QQ": "371XXXXX", "ID card number": "330122XXXXXXXXXXXX", "ID card validity period": "2008.10.28 - 2028.10.28", "Gender": "Male", "Personality traits": "Lively and cheerful, positive attitude towards life", "Hobbies": "Badminton, table tennis and basketball", "Job title": "Class sports commissary", "Volunteer experience": "Helping primary school students improve their reading ability", "Volunteer work lessons": "Patience and sense of responsibility", "Future plans": "Deeply engage in the sports field, become a sports coach, learn and do volunteer work, and make more contributions to society"}".

[0029] Furthermore, in order to prevent data from being stolen during storage, prevent sensitive information from being illegally accessed, leaked or misused, it is necessary to perform data desensitization on the data and store the desensitized data in a blurred manner to ensure the security of the data during storage.

[0030] S2. Perform data desensitization on the sensitive fields in the user information to obtain desensitized data, and generate a mapping sub-table according to the desensitized data and the mapping identifier of the sensitive field.

[0031] It should be noted that the types of the sensitive fields can be determined in advance, which generally refer to the privacy information that can point to a specific user. For example, name, phone number, ID card number, bank card number, the specific house number in the address (for example, "ABC in Building ABC, XX Road, XX Street, XX District, XX City, XX Province, XX Country", the specific house number "ABC" in this address points to a specific user, so "ABC" can be determined as a sensitive field), etc.

[0032] In the embodiment of the present invention, in order to ensure the accuracy of the user information, before performing data desensitization, the user information in the preset format can be fed back to the user side for confirmation, and then data desensitization is performed after confirmation.

[0033] In the embodiment of the present invention, before performing data desensitization on the sensitive fields in the user information, it further includes: Returning the user information in the preset format to the user terminal; The user terminal generates and displays a user information display and operation interface with a confirmation operation control and a modification operation control, so that the user can issue a confirmation instruction for the displayed user information in the preset format based on the confirmation operation control, or the user can modify and provide feedback on the displayed user information in the preset format based on the modification operation control; When the confirmation instruction is received from the user end, the user information in the preset format is used as the data to be desensitized; or, when the modified user information is received from the user end, the modified user information is used as the data to be desensitized.

[0034] In detail, the user end displays and confirms the user data in the preset format fed back by the server end on the information confirmation interface of the information collection app. The information confirmation interface is an interface for the information collection app installed by the user end to display the user data in the preset format for the user to confirm or modify.

[0035] In the embodiment of the present invention, data desensitization refers to processing sensitive information in user information to prevent leakage or abuse of sensitive data, protect privacy and confidentiality, and ensure that sensitive information will not be exposed.

[0036] In an embodiment of the present invention, the data desensitizing of the sensitive fields in the user information to obtain desensitized data includes: identifying the mask position of the sensitive data corresponding to the sensitive field; replacing the sensitive data corresponding to the mask position with a preset desensitizing symbol to obtain the desensitized data.

[0037] In detail, sensitive fields include but are not limited to name, ID number, mobile phone number, and bank card number. For the data in each sensitive field, it is necessary to clarify which parts need to be desensitized. For example, for a mobile phone number, it may be necessary to hide the middle digits (for example, 139****5678); for an ID number, the middle digits may be hidden (for example, 330**********1234), and then use the preset desensitizing symbols to replace certain parts of the sensitive data. According to the identified mask position, the preset desensitizing symbols are used to replace the corresponding parts of the sensitive data. For example, for a bank card number 1234 5678 9012 3456, it can be converted to 1234 **** **** 3456, where the mask part "****" represents the desensitized part, so that the sensitive data corresponding to the sensitive field are all desensitized to obtain the desensitized data corresponding to the sensitive data, so as to ensure the security of the data storage process.

[0038] Furthermore, in order to be able to restore the original data when needed (if there is legal authorization or demand) and to ensure the traceability and compliance of data processing, it is necessary to record the relationship between the original sensitive data and the desensitized data during the processing of the desensitized data.

[0039] In the embodiment of the present invention, the mapping subtable refers to a mapping relationship between the original data and the desensitized data, so as to ensure the traceability and compliance of data processing.

[0040] In the embodiment of the present invention, the generating of the mapping sub-table according to the mapping identifier of the desensitized data and the sensitive field includes: Identify the desensitization type corresponding to the desensitized data, and determine the desensitization attribute corresponding to the desensitized data according to the desensitization type; Creating a mapping structure corresponding to the desensitization type according to the desensitization attribute and the mapping identifier of the sensitive field; Generate a mapping format corresponding to the desensitization type according to the mapping structure, and generate a mapping sub-table corresponding to the desensitization type according to the mapping format and the mapping identifier; The attribute data of the desensitizing attribute corresponding to the desensitizing type is stored in the mapping subtable.

[0041] In detail, the desensitized field type corresponding to the desensitized data is identified, and the desensitized types include but are not limited to name, ID number, mobile phone number, and bank card number, and the desensitized attributes corresponding to the desensitized data are determined one by one according to each desensitized type, and the desensitized attributes refer to the desensitized field type, original data, desensitized data, and desensitization rules, wherein the original data refers to the sensitive data in the original user information; the desensitized data refers to the data after the sensitive data in the user information is desensitized; the desensitization rules include but are not limited to partial hiding and middle part hiding, thereby creating a mapping structure corresponding to each desensitized type based on the desensitized attributes and the mapping identifiers corresponding to the sensitive fields, and the mapping structure is to clarify the original data, desensitized data and related desensitization rules, and then generate a mapping format according to the mapping structure, including the naming of the field, data type, storage method, etc., thereby generating a mapping subtable corresponding to each desensitized field type.

[0042] Exemplarily, if the desensitized field type is name, a name mapping table is constructed, and the mapping format is mapped with the mapping identifier. For example, if the name mapping ID is 1, the original data is Zhang San, the desensitized data is Zhang*, and the desensitization rule is partially hidden; if the name mapping ID is 2, the original data is Li San, the desensitized data is Li*, and the desensitization rule is partially hidden, thereby obtaining a mapping subtable corresponding to the name field. Similarly, the mapping subtables corresponding to all sensitive fields are constructed based on the field mapping ID and the desensitization attributes, thereby obtaining a mapping subtable corresponding to each sensitive field.

[0043] Furthermore, directly storing the user's sensitive data (such as name, ID number, mobile phone number, etc.) in the user information table has a high risk of leakage. Therefore, it is necessary to separate the sensitive data from the user information by generating a mapping main table. Even if the attacker obtains the user information table, he cannot directly obtain the user's sensitive information. The sensitive information is stored in the mapping sub-table, reducing the risk of leakage.

[0044] S3. Divide the non-sensitive fields in the user information into regularized field information and non-regularized field information, and map and store the divided regularized field information and non-regularized field information according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields.

[0045] It should be noted that the non-sensitive fields refer to fields other than sensitive fields, and usually refer to ordinary information that cannot be pointed to a specific user, such as interests, personality, living habits, and field information in the address other than the specific residence number (for example, "XX Country XX Province XX City XX District XX Street XX Road XX Building ABC", the field information in the address other than the specific residence number "ABC" except the specific residence number "ABC" "XX Country XX Province XX City XX District XX Street XX Road XX Building" cannot point to a specific user, therefore, "XX Country XX Province XX City XX District XX Street XX Road XX Building" can be determined as a non-sensitive field), etc.

[0046] In an embodiment of the present invention, the non-sensitive field may be an address, hobbies, personality, living habits, etc. The regularized field information refers to data with a clear format and specification. Normalization refers to structured information that can be described in a unified manner by dividing the data into multiple tables and ensuring that the tables are associated through foreign keys to avoid redundancy and data inconsistency; the non-regularized field information refers to text data without a fixed format or structure. Multiple field information is merged and stored in one table. There may be redundant or repeated data. The non-sensitive fields in the user information are divided into regularized field information and non-regularized field information.

[0047] Furthermore, in order to reduce the consumption of storage space, it is necessary to optimize the user information with high repetition. Therefore, it is necessary to calculate the repetition corresponding to the regular field information and the irregular field information after division, and then optimize the storage of the user information according to the repetition.

[0048] In the embodiment of the present invention, the information coding mapping table is determined based on analysis of historically stored user information.

[0049] In the embodiment of the present invention, before mapping and storing the divided regularized field information and non-regularized field information according to the predetermined information coding mapping table, the method further includes: Calculate the repetition of regularized field information and non-regularized field information in the pre-acquired historically stored user information; Filter the regularized field information to be encoded and the non-regularized field information to be encoded in the regularized field information and the non-regularized field information according to the repetition degree; The regularized field information to be encoded and the non-regularized field information to be encoded are field encoded, and the encoded regularized field information to be encoded and the non-regularized field information to be encoded are collected into an information encoding mapping table.

[0050] In detail, the repetition refers to the number of times the information attribute in the user information appears, which measures the frequency or proportion of the user information being repeated. For example, in a data set, if the same information appears repeatedly in multiple records, it means that the repetition of the information is high. Then the repetition of the regularized field information and the non-regularized field information is calculated separately, that is, for the regularized field information, the repetition is determined by the ratio of the total number of occurrences of each data item in the data set to the total size of the data set. For example, if there is an address field in the regularized field information, the repetition is calculated by counting the number of times each address appears in the data set. For example, if there are a total of 5 records in the data set, and the xx address appears 3 times, then the repetition of the xx address is 0.6. The repetition of the regularized field information is usually high, because the regularized data items often have certain standardized and shared characteristics, and appear repeatedly in multiple records; for the non-regularized field information, the frequency of occurrence of each data needs to be calculated. For example, there is an interest field in the user table, and playing basketball appears 3 times, watching movies appears 4 times, and there are 5 users in total, then the repetition of playing basketball is 0.6, and the repetition of watching movies is 0.8.

[0051] Specifically, fields suitable for encoding are selected based on repetition and regularity. Regularized fields (such as name, gender, date of birth, etc.) are often selected first. For irregular fields, some text fields with high frequency of occurrence can be selected for encoding, and then the encoding method of each field can be determined. Regularized fields can be mapped using methods such as digital encoding and range encoding; irregular fields can use keyword mapping, hash value mapping, etc., and specific codes are assigned according to field characteristics. For example, the gender field is assigned codes "001" and "002", the hobby field can map "travel, photography" to "005", and some common words in self-introduction can be mapped to "006", thereby obtaining an information encoding mapping table.

[0052] Furthermore, the regularized field information and the non-regularized field information may be uniformly mapped and stored according to a predetermined information coding mapping table.

[0053] In an embodiment of the present invention, the storage mapping table refers to a structure for efficiently searching and storing data. It reduces data duplication, improves storage efficiency, and accelerates the query process by associating data with an index or code. The mapping table includes a mapping key and a mapping value. The mapping key is a code or identifier used to uniquely identify each data item, and the mapping value is the real data corresponding to the mapping key.

[0054] In an embodiment of the present invention, the mapping and storing of the divided regularized field information and the non-regularized field information according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive field includes: Querying the regularized information code corresponding to the regularized field information and the non-regularized information code corresponding to the non-regularized field information in the information code mapping table; Mapping and storing the regularized information code and the regularized field information to obtain a regularized storage mapping table corresponding to the regularized field information; Mapping and storing the irregular information code and the irregular field information to obtain an irregular storage mapping table; The regularized storage mapping table and the irregular storage mapping table are aggregated into a storage mapping table corresponding to a non-sensitive field.

[0055] In detail, a regularized field refers to a field with a relatively fixed format and can be mapped according to certain standards. For example, gender, age, date of birth, etc., if the regularized field mapping table includes field names such as gender, date of birth, age, etc., and the corresponding mapping rules are male / female, year-month-day, date of birth calculation, then the corresponding storage code is 001=male, 002=female, date of birth is year-month-day, etc., and for the mapping of non-regularized fields, if the field name is hobbies, the corresponding storage code is 001 = travel, 002 = photography, 003 = sports, the field name is address, the corresponding storage code is 010001 = Beijing, 010002 = Shanghai, the field name is occupation, and the corresponding storage code is 001 = programmer, 002 = designer.

[0056] Specifically, the regularized fields (for example, gender, date of birth, etc.) and their corresponding codes are stored in a regularized storage mapping table, which records the actual value of each regularized field and the corresponding coding information; for non-regularized fields (for example, hobbies, self-introduction, etc.), we also map and store their information with the codes to generate a non-regularized storage mapping table, which records the actual value of each non-regularized field and the corresponding coding information.

[0057] For example, the "hobby code" of user 1001 is "001, 002", indicating that the user's hobbies include "travel" and "photography"; his "self-introduction code" is "001", indicating that the user introduces himself as "optimistic"; the address code "010001" represents "Beijing", and the occupation code "001" represents "programmer".

[0058] Furthermore, in order to improve the security of data storage and reduce storage space, different mapping tables need to be stored separately or uniformly to reduce table complexity and optimize storage performance.

[0059] S4. Associate the user unique identity code in the user information with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and store the mapping sub-table, the mapping main table and the storage mapping table in the same storage area, or store them in multiple different storage areas respectively.

[0060] In the embodiment of the present invention, the mapping master table is a master table used to store the relationship between different data tables. It is usually used to associate data of multiple sub-tables and integrate these data into a unified structure to facilitate data management, query, maintenance or analysis.

[0061] In detail, the user's unique identity code is a code used to represent the user's identity, which can be the user's ID number. The mapping main table contains the user's unique identity code and the encoding information of multiple fields. The encoding information of each field is associated through the mapping sub-table (regularized storage mapping table and non-regularized storage mapping table). The user ID in each sub-table (regularized and non-regularized) is associated with the corresponding field code, and then the codes of all these fields are collected into a main table.

[0062] Specifically, according to the user's unique identification code (user ID), the encoding information of each user's sensitive information is extracted from the mapping sub-table, and according to the user's unique identification code (user ID), the encoding information of each user (such as gender encoding, date of birth encoding, age encoding) is extracted from the regularized storage mapping table, and according to the user's unique identification code (user ID), the encoding information of each user (such as hobby encoding, self-introduction encoding, address encoding, occupation encoding) is extracted from the non-regularized storage mapping table, and then each user ID and the encoding information of all related fields are collected in the same row to form a mapping main table.

[0063] Furthermore, the mapping sub-table, the mapping main table and the storage mapping table are stored in the same storage area, or are stored in multiple different storage areas respectively, that is, the mapping sub-table, the mapping main table and the storage mapping table are stored in the same storage area, which means that all data tables (sub-tables, main tables, etc.) are stored in the same database or storage system, which may be the same physical disk, the same database instance or the same data warehouse; the mapping sub-table, the mapping main table and the storage mapping table are stored in different storage areas or database instances respectively, which may be physically separated different disks, different servers, or in different database systems.

[0064] Furthermore, an expiration time field is added to each mapping table to identify the expiration time of user information. A scheduled task is used to regularly execute database queries, detect expired data, and clean up or mark it as expired. Once data expiration is detected, if the data is no longer needed, the expired record can be deleted directly; if you do not want to completely delete the data, you can choose to add a "status" field to the record, such as the status field, and set it to "expired", so that historical data can be retained but it will no longer participate in active queries. Information will be updated for expired user information, so that the data stored in the cloud database changes in real time, and synchronous data storage is achieved.

[0065] In an embodiment of the present invention, after receiving the original user information decryption request with the user's unique identity code sent by the user terminal, the mapping sub-table and storage mapping table corresponding to the user's unique identity code are determined according to the mapping main table directly or after the authority verification is passed, and the original user information of the sensitive fields and non-sensitive fields corresponding to the user's unique identity code are fed back to the user terminal.

[0066] In detail, the original user information fed back may change in real time. When the user information expires, an information update reminder is sent to the user terminal corresponding to the expired user information, and the receiving user terminal updates the expired user information based on the information update reminder feedback to update the expired user information, and stores the updated user information in the mapping table corresponding to the updated user information in the cloud database.

[0067] Specifically, the receiving user terminal sends an information update instruction according to the information update reminder, and feeds back expired user information to the user terminal; receives updated user information sent by the user terminal, and updates the expired user information according to the updated user information; receives the user data re-uploaded by the user terminal, and uses the multimodal information collection model to extract user information in a preset format from the re-uploaded user data to update the expired user information.

[0068] Furthermore, when an information update instruction actively sent by the user end is received, the newly created user information uploaded by the user end is obtained; the newly created user data in a preset format is extracted from the newly created user information using a preprocessing module and a multimodal information acquisition model, and the user information in the cloud database is updated according to the newly created user data; when the information in the cloud database is updated, a newly created user portrait is generated according to the updated user information, and the newly created user portrait is stored in the cloud database.

[0069] The embodiment of the present invention obtains user information uniformly through an information collection application based on a multimodal information collection model, and can convert various types and styles of user data uploaded by users into user information in a standard format, which is convenient for subsequent information calls and unified maintenance, and convenient for user information storage; data desensitization is performed on sensitive fields, and a mapping subtable is generated. The desensitization process can ensure that sensitive data will not be leaked during storage and transmission, reducing the risk of data leakage; a mapping master table is generated, and desensitized data and mapping identifiers are stored. Desensitized data and mapping information are stored separately, and are associated through the master table to ensure that the data remains intact and available after desensitization; information is divided into regularized and non-regularized parts, which helps to optimize and process different types of data respectively, and reduce unnecessary duplicate information storage; the mapping table is separated and stored in a cloud database and expired information is regularly detected, which improves the accuracy of user information. Therefore, the user information storage control method, device, equipment and medium proposed by the present invention can solve the problem of low data storage security and high storage capacity.

[0070] like Figure 2 , which is a functional module diagram of a user information storage control device provided by an embodiment of the present invention.

[0071] The user information storage control device 100 of the present invention can be installed in an electronic device. According to the functions to be implemented, the user information storage control device 100 may include a data acquisition module 101, a sensitive data mapping module 102, a field information mapping module 103 and a data storage module 104. The module of the present invention may also be referred to as a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, and is stored in the memory of the electronic device.

[0072] In this embodiment, the functions of each module / unit are as follows: The data collection module 101 is used to receive user information of each user sent by the user terminal, perform standardization processing on each user information to obtain a corresponding standard format file, and extract user information in a preset format from each standard format file using a multimodal information collection model; The sensitive data mapping module 102 is used to desensitize the sensitive fields in the user information to obtain desensitized data, and generate a mapping sub-table according to the desensitized data and the mapping identifier of the sensitive field; The field information mapping module 103 is used to divide the non-sensitive fields in the user information into regularized field information and non-regularized field information, and map and store the divided regularized field information and non-regularized field information according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields; The data storage module 104 is used to associate the user's unique identity code in the user information with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and store the mapping sub-table, the mapping main table and the storage mapping table in the same storage area, or store them in multiple different storage areas respectively.

[0073] In detail, each module in the user information storage control device 100 in the embodiment of the present invention is used in the same manner as described above. Figure 1 The user information storage control method described in the present invention has the same technical means and can produce the same technical effects, so it will not be repeated here.

[0074] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 3 As shown. The computer device includes a processor, a memory, a network interface and a database connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile and / or volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external client via a network connection. When the computer program is executed by the processor, it implements the functions or steps of a user information storage control method service side.

[0075] In one embodiment, a computer device is provided. The computer device may be a client, and its internal structure diagram may be as follows: Figure 4As shown. The computer device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external server through a network connection. When the computer program is executed by the processor, it realizes the functions or steps of the client side of a user information storage control method.

[0076] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the following steps when executing the computer program: Receiving user information of each user sent by the user terminal, performing standardization processing on each of the user information to obtain a corresponding standard format file, and extracting user information in a preset format from each of the standard format files using a multimodal information acquisition model; Desensitizing the sensitive fields in the user information to obtain desensitized data, and generating a mapping subtable according to the desensitized data and the mapping identifier of the sensitive fields; The non-sensitive fields in the user information are divided into regularized field information and non-regularized field information, and the divided regularized field information and non-regularized field information are mapped and stored according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields; The user unique identity code in the user information is associated with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and the mapping sub-table, the mapping main table and the storage mapping table are stored in the same storage area, or respectively stored in multiple different storage areas.

[0077] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented: Receiving user information of each user sent by the user terminal, performing standardization processing on each of the user information to obtain a corresponding standard format file, and extracting user information in a preset format from each of the standard format files using a multimodal information acquisition model; Desensitizing the sensitive fields in the user information to obtain desensitized data, and generating a mapping subtable according to the desensitized data and the mapping identifier of the sensitive fields; The non-sensitive fields in the user information are divided into regularized field information and non-regularized field information, and the divided regularized field information and non-regularized field information are mapped and stored according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields; The user unique identity code in the user information is associated with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and the mapping sub-table, the mapping main table and the storage mapping table are stored in the same storage area, or respectively stored in multiple different storage areas.

[0078] It should be noted that the above functions or steps that can be implemented by the computer-readable storage medium or computer device can refer to the relevant descriptions on the server side and the client side in the aforementioned method embodiment. To avoid repetition, they will not be described one by one here.

[0079] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0080] In the several embodiments provided by the present invention, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation.

[0081] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0082] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0083] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0084] Therefore, no matter from which point of view, the embodiments should be regarded as illustrative and non-restrictive, and the scope of the present invention is not limited only according to the above description, and it is intended that all changes within the meaning and scope of equivalent elements within the scope of protection are included in the present invention.

[0085] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0086] In addition, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in the system can also be implemented by one unit or device through software or hardware. The words first, second, etc. are used to indicate names, and do not indicate any particular order.

[0087] Finally, it should be noted that if software tools or components not owned by the patent applicant appear in the embodiments of the present application, they are merely used to illustrate that a wide range of software tools or components can be selected during the actual implementation of the technical solution disclosed in the present application, and do not mean that the patent applicant actually used these example software tools or components; the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention is described in detail with reference to the preferred embodiments, ordinary technicians in this field should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A user information storage control method, characterized in that: The method comprises: Receiving user information of each user sent by the user terminal, performing standardization processing on each of the user information to obtain a corresponding standard format file, and extracting user information in a preset format from each of the standard format files using a multimodal information acquisition model; Desensitizing the sensitive fields in the user information to obtain desensitized data, and generating a mapping subtable according to the desensitized data and the mapping identifier of the sensitive fields; The non-sensitive fields in the user information are divided into regularized field information and non-regularized field information, and the divided regularized field information and non-regularized field information are mapped and stored according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields; The user unique identity code in the user information is associated with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and the mapping sub-table, the mapping main table and the storage mapping table are stored in the same storage area, or respectively stored in multiple different storage areas.

2. The user information storage control method according to claim 1, characterized in that: The method further comprises: After receiving the original user information decryption request with the user's unique identity code sent by the user end, directly or after the authority verification is passed, the mapping sub-table and storage mapping table corresponding to the user's unique identity code are determined according to the mapping main table, and the original user information of the sensitive fields and non-sensitive fields corresponding to the user's unique identity code are fed back to the user end.

3. The user information storage control method according to claim 1, characterized in that: The extracting the user information in a preset format from each of the standard format files using the multimodal information collection model includes: Utilizing the multimodal information collection model to receive the input standard format file and user information extraction instructions, wherein the user information extraction instructions include extraction content and a corresponding preset format; When the file type corresponding to the standard format file is a unique file type, extracting deep features of the standard format file using the multimodal information acquisition model to obtain structured file features; When the standard format file is a file set including files of multiple file types, the multimodal information acquisition model is used to extract the deep features of each file in the file set respectively, and the features extracted from each file are fused to obtain structured file features; According to the user information extraction instruction, extracted content in a preset format is obtained from the file feature as user information in a preset format.

4. The user information storage control method according to claim 1, characterized in that: Before desensitizing the sensitive fields in the user information, the method further includes: Returning the user information in the preset format to the user terminal; The user terminal generates and displays a user information display and operation interface with a confirmation operation control and a modification operation control, so that the user can issue a confirmation instruction for the displayed user information in the preset format based on the confirmation operation control, or the user can modify and provide feedback on the displayed user information in the preset format based on the modification operation control; When the confirmation instruction is received from the user end, the user information in the preset format is used as the data to be desensitized; or, when the modified user information is received from the user end, the modified user information is used as the data to be desensitized.

5. The user information storage control method according to claim 1, characterized in that: The generating a mapping sub-table according to the desensitized data and the mapping identifier of the sensitive field includes: Identify the desensitization type corresponding to the desensitized data, and determine the desensitization attribute corresponding to the desensitized data according to the desensitization type; Creating a mapping structure corresponding to the desensitization type according to the desensitization attribute and the mapping identifier of the sensitive field; Generate a mapping format corresponding to the desensitization type according to the mapping structure, and generate a mapping sub-table corresponding to the desensitization type according to the mapping format and the mapping identifier; The attribute data of the desensitizing attribute corresponding to the desensitizing type is stored in the mapping subtable.

6. The user information storage control method according to claim 1, characterized in that: Before mapping and storing the divided regularized field information and non-regularized field information according to the predetermined information coding mapping table, the method further includes: Calculate the repetition of regularized field information and non-regularized field information in the pre-acquired historically stored user information; Filter the regularized field information to be encoded and the non-regularized field information to be encoded in the regularized field information and the non-regularized field information according to the repetition degree; The regularized field information to be encoded and the non-regularized field information to be encoded are field encoded, and the encoded regularized field information to be encoded and the non-regularized field information to be encoded are collected into an information encoding mapping table.

7. The user information storage control method according to claim 6, characterized in that: The mapping and storing the divided regularized field information and the non-regularized field information according to the predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive field includes: Querying the regularized information code corresponding to the regularized field information and the non-regularized information code corresponding to the non-regularized field information in the information code mapping table; Mapping and storing the regularized information code and the regularized field information to obtain a regularized storage mapping table corresponding to the regularized field information; Mapping and storing the irregular information code and the irregular field information to obtain an irregular storage mapping table; The regularized storage mapping table and the irregular storage mapping table are aggregated into a storage mapping table corresponding to a non-sensitive field.

8. A user information storage control device, used to implement the user information storage control method according to any one of claims 1 to 7, characterized in that: The device comprises: The data collection module is used to receive user information of each user sent by the user terminal, perform standardization processing on each of the user information to obtain a corresponding standard format file, and extract user information in a preset format from each of the standard format files using a multimodal information collection model; A sensitive data mapping module, used to desensitize the sensitive fields in the user information to obtain desensitized data, and generate a mapping subtable according to the desensitized data and the mapping identifier of the sensitive field; A field information mapping module, used to divide the non-sensitive fields in the user information into regularized field information and non-regularized field information, and map and store the divided regularized field information and non-regularized field information according to a predetermined information coding mapping table to generate a storage mapping table corresponding to the non-sensitive fields; The data storage module is used to associate the user's unique identity code in the user information with the corresponding mapping sub-table and storage mapping table to generate a mapping main table, and store the mapping sub-table, the mapping main table and the storage mapping table in the same storage area, or store them in multiple different storage areas respectively.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and when the computer program is executed by the at least one processor, the user information storage control method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the user information storage control method according to any one of claims 1 to 7 is implemented.

Images