Numerical data de-identification and reverse reduction method, medium and equipment
By performing segmented permutation, addition and reverse calculation processing on numerical data, the problem of irreversibility after de-identification of numerical data in the prior art is solved, efficient and secure management of data is achieved, and the confidentiality and security of data are enhanced.
Patent Information
- Application Number
- CN202411818993.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-11
- Publication Date
- 2025-04-04
AI Technical Summary
The data after the existing numerical data is deidentified is irreversible, and the data retains identifiable data types, and data sharing and data exchange cannot be performed.
By dividing the numerical data into two left and right sections and exchanging positions, selecting the number of the specified position and its adjacent numbers for addition operations, the result replaces the number of the specified position, and combining inverse operations and fill-up processing, the data is reversible de-identification.
Reversible operations of numerical data are realized, hiding data type information, increasing data confidentiality and security, and facilitating data storage, sharing and public operations.
Smart Images

Figure CN119760769A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of data security, and specifically relates to a method, medium and device for de-identifying and reversely restoring numerical data. Background Art
[0002] With the continuous evolution of the information process, the value of data has become increasingly prominent, and large model technologies have sprung up. However, data security risks and personal information leakage incidents are also increasing. In response to this challenge, the state has successively promulgated the "Data Security Law of the People's Republic of China" and the "Personal Information Protection Law of the People's Republic of China", as well as more than ten national standards related to data security, aiming to regulate data operations and management activities.
[0003] In the national standard "GB / T 37964-2019 Information Security Technology Personal Information De-identification Guidelines", the relevant requirements and methods for data de-identification are elaborated in detail, especially for the processing of numerical data (identifiers), and a variety of technical means such as suppression shielding, partial shielding, reversible encoding, and data synthesis are proposed.
[0004] The applicant analyzed the de-identification processing method of numerical data (identifiers) and found that after the data was processed by suppression shielding and partial shielding, the de-identified data was irreversible. The de-identified data could still identify the data type, which could not meet the de-identification requirements in some scenarios that required confidentiality.
[0005] Therefore, the problem that the present invention aims to solve is that the data is irreversible after de-identification of numerical data, the data retains identifiable data types, and data sharing and data exchange are impossible. Summary of the invention
[0006] Existing de-identification processing methods still have deficiencies in some aspects, such as the data is irreversible after de-identification of numerical data, the data retains identifiable data types, and data sharing and data exchange are impossible. In order to solve this technical problem, the present invention proposes a method for de-identification and reverse restoration of numerical data, which can not only perform reversible operations, but also further hide the type information of the data, thereby greatly increasing the confidentiality of the data. This processing method enables the data to have stronger defense capabilities when facing targeted cracking, and effectively protects the security of the data. At the same time, the method also greatly facilitates the storage, sharing and public operation of data, meeting the needs of the information age for efficient and secure data management.
[0007] According to one aspect of the present invention, a method for de-identifying and reversely restoring numerical data is provided, comprising:
[0008] Step 1: Divide the first numerical data into two segments, the left and the right, and exchange their positions to form replaced numerical data;
[0009] Step 2: Select a number at a specified position and the first number adjacent to it to perform an operation, and replace the number at the specified position with the result after the operation to generate second numerical data;
[0010] Step 3: According to the de-identification strategy, reverse calculation and processing are performed from back to front to find the number and adjacent numbers at the specified position;
[0011] Step 4: Analyze whether padding is needed according to the operation. If yes, take the digit after padding and the adjacent digits and use the reverse operation value to replace the digit at the specified position. If no, take the digit at the specified position and the adjacent digits and use the reverse operation value to replace the digit at the specified position.
[0012] Step 5: Reversely cut the replaced numerical data into two parts, and then replace the left and right parts to restore the original data.
[0013] The above-mentioned method for de-identifying and reversely restoring numerical data also includes: before step 1, it also includes: analyzing whether the length of the numerical data is suitable for de-identification by this method, and if not, supplementing fixed-length digital data in front of or after the data to generate new numerical data; and, restoring the original data in step 5 includes: removing the supplemented fixed-length digital data to restore the original data.
[0014] The above-mentioned method for de-identifying and reversely restoring numerical data also includes: in step 2, selecting the number at the specified position and the first number adjacent to it to perform an operation includes: selecting the number at the specified position and performing an addition operation on the first number to its right.
[0015] The above-mentioned method for de-identifying and reversely restoring numerical data also includes: step 1 can be repeated N times, where N is an integer not less than 2.
[0016] The above-mentioned method for de-identifying and reversely restoring numerical data also includes: in step 4, whether padding is needed according to the operation analysis includes: after the operation, determining whether padding operation is needed according to the size relationship between the number at the specified position and its adjacent numbers.
[0017] The above-mentioned method for de-identifying and reversely restoring numerical data also includes: step 4 can be repeated M times, where M is an integer not less than 2.
[0018] The above-mentioned method for de-identifying and reversely restoring numerical data also includes: the fixed-length digital data is a random number of fixed length.
[0019] The above-mentioned method for de-identifying and reversely restoring numerical data also includes: the number at the specified position is the number corresponding to the specified subscript serial number.
[0020] According to another aspect of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the method according to any one of claims 1 to 8 when being executed.
[0021] According to another aspect of the present invention, there is provided a computer device, comprising a processor, a memory and a computer program stored in the memory, wherein the processor implements the method described in any one of claims 1 to 8 when executing the computer program.
[0022] The present invention provides a method for de-identification and reverse restoration of numerical data. Compared with the traditional method, the present invention replaces the data in segments, selects the numbers in the specified position, performs addition operation with the adjacent numbers, and replaces the results with the selected numbers, thereby hiding the authenticity and characteristics of the data and being able to perform reversible operations. Not only can reversible operations be performed, but the type information of the data can also be further hidden, thereby greatly increasing the confidentiality of the data. This processing method enables the data to have stronger defense capabilities when facing targeted cracking, and effectively protects the security of the data. At the same time, the method also greatly facilitates the storage, sharing and public operation of data, meets the needs of efficient and secure data management in the information age, and ensures the availability and accuracy of data while protecting personal privacy. In addition, the method of the present invention can also adapt to data sets of different sizes, whether it is a large-scale database or a small-scale data set, and can effectively perform de-identification processing. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The accompanying drawings, which are incorporated into the specification and constitute a part of the specification, illustrate embodiments of the present invention and are used to explain the principles of the present invention together with the relevant text description. In these drawings, similar reference numerals are used to represent similar elements. The drawings described below are some embodiments of the present invention, but not all embodiments. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without paying creative work.
[0024] Figure 1 A flow chart of a method for de-identifying numerical data provided by an embodiment of the present invention is shown.
[0025] Figure 2 A flow chart of a method for de-identifying and reversely restoring numerical data provided by an embodiment of the present invention is shown.
[0026] Figure 3The invention is a block diagram of a computer device according to an exemplary embodiment. DETAILED DESCRIPTION
[0027] In order to make the purpose, technical scheme and advantages of the embodiments of the present invention clearer, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention. It should be noted that the embodiments in this application and the features in the embodiments can be combined with each other arbitrarily without conflict.
[0028] Existing de-identification processing methods still have deficiencies in some aspects, such as the irreversibility of numerical data after de-identification, the retention of identifiable data types, and the inability to share and exchange data. This embodiment aims to solve the above problems through a new method for de-identification and reverse restoration of numerical data, improve the confidentiality and security of data, and meet the needs of efficient and secure data management in the information age.
[0029] An embodiment of the present invention provides a method for de-identifying and reversely restoring numerical data, comprising:
[0030] Step 1: Divide the first numerical data into two segments, swap their positions, and form the replaced numerical data. For example, divide 12876954 into two segments, 128 and 76954, and replace them to 76954128. By dividing the first numerical data into two segments, the structure of the original data is broken, the complexity and unpredictability of the data are increased, and the security of the original data is effectively protected. This replacement operation makes the data present a new arrangement and combination visually, improves the degree of data obfuscation, and greatly enhances the security and privacy protection of the data.
[0031] In addition, by repeatedly executing step 1, the security of the data can be further improved. Preferably, this step can be repeated N times, where N is an integer not less than 2. This multiple replacement strategy makes the complexity and unpredictability of the data reach a higher level, providing a strong guarantee for the secure storage and transmission of data. At the same time, this replacement method is efficient and easy to use, and can quickly improve the security of the data without adding additional computing burden, laying a solid foundation for subsequent data processing and analysis.
[0032] Step 2: Select the number at the specified position and the first number adjacent to it for operation, and replace the number at the specified position with the result after the operation to generate the second numerical data. For example, in 76954128, the number 5 with the subscript 3 is added to the first number 4 adjacent to the right to get 9, and 5 is replaced by 9 to generate a new data 76994128. Through specific operations and replacement operations, the effective de-identification of numerical data is achieved, further enhancing the security and privacy protection capabilities of the data.
[0033] Preferably, in step 2, selecting the number at the designated position and the first number adjacent to it to perform an operation includes: selecting the number at the designated position and the first number on its right to perform an addition operation. By selecting the first number on the right to perform the addition operation, this embodiment also increases the randomness and unpredictability of the data to a certain extent. Since the result of the addition operation depends on the value of the selected number and its adjacent numbers, even for the same original data, the result of each processing may be different. This randomness makes the data more difficult to be cracked or analyzed, thereby further protecting the security and privacy of the original data.
[0034] Step 3: According to the de-identification strategy, reverse operation is performed from back to front to find the number and adjacent numbers at the specified position. Specifically, according to the de-identification strategy, in the process of reverse operation from back to front, the system will find the number at the specified position and the adjacent numbers. For example, 76994128, the number at the specified position is 9, and the adjacent number is 4; for another example, 000128000, the number at the specified position is 2, and the adjacent number is 8.
[0035] Step 4: Analyze whether padding is required based on the operation. If yes, take the padded digit and the adjacent digit and use the reverse operation value to replace the digit at the specified position.
[0036] Determining whether padding is needed through operation analysis can flexibly adjust the data processing method according to the actual situation. Specifically, in one embodiment, we compare the first number and the second number in the operation. If the first number is greater than the second number, then no padding operation is required. For example, in the data 76994128, if the number at the specified position is 9 and the adjacent number is 4, since 9 is greater than 4, no padding is required.
[0037] On the contrary, if the first number is smaller than the second number, then padding is required. Take the data 000128000 as an example. If the number at the specified position is 2 and the adjacent number is 8, since 2 is smaller than 8, padding is required. After padding, we will use the reverse operation value to replace the number at the specified position, thereby further disrupting the data arrangement and improving its security and obfuscation.
[0038] Through this flexible processing method, step 4 can not only adjust the data processing method according to the actual situation, but also effectively increase the complexity and unpredictability of the data, providing a safer guarantee for subsequent data processing. When it is necessary to fill in the position, the number after filling and the adjacent number are replaced with the reverse operation value, such as using 12-8=4 to replace 12. The numerical data after replacement changes significantly and becomes 00048000. This change not only increases the complexity of the data, but also makes the data more difficult to crack.
[0039] When no padding is required, step 4 uses the reverse operation value to replace the number at the specified position and the adjacent number, for example, 9-4=5 replaces 9, and the replaced numerical data becomes 76954128. This processing method can also effectively disrupt the arrangement of the original data and increase the degree of data obfuscation.
[0040] Preferably, step 4 can be repeated M times, where M is an integer not less than 2. By repeatedly performing this step multiple times, the complexity and security of the data can be made to a higher level, thereby more effectively protecting the original data from being illegally obtained or tampered with. This multiple replacement strategy provides a more solid guarantee for the secure storage and transmission of data.
[0041] Step 5: Reversely cut the replaced numerical data into two parts, then replace the left and right parts to restore the original data. For example: 76954128 is reversely cut into 76954 and 128, and the left and right parts are replaced to 12876954.
[0042] Preferably, before step 1, it also includes: analyzing whether the length of the numerical data is suitable for de-identification by the method, and if not, supplementing fixed-length digital data in front of or after the data to generate new numerical data; and, restoring the original data in step 5 includes: removing the supplemented fixed-length digital data to restore the original data. Through this preprocessing, it can be ensured that numerical data of different lengths can be effectively de-identified, which broadens the scope of application of the method and improves the flexibility of data processing. This step is crucial to the practicality and security of the entire numerical data de-identification and reverse restoration method.
[0043] Preferably, the fixed-length digital data is a random number of fixed length. The introduction of such random numbers further enhances the security and unpredictability of the data, thereby significantly improving the practicality and security of the entire numerical data de-identification and reverse restoration method.
[0044] Preferably, the number at the specified position is the number corresponding to the subscript number specified in the data processing process. Through the specified subscript number, we can accurately locate and operate specific numbers in the data, thereby achieving accurate processing and control of the data, and at the same time, local processing of the data can be achieved instead of global processing of the entire data. This local processing method can not only reduce the complexity of data processing, but also better protect the privacy and security of the data. Because global processing may cause the overall structure of the data to be destroyed, local processing can achieve accurate processing of specific data while protecting the integrity of the data.
[0045] In the specific embodiment, we further verified the effectiveness and practicality of the numerical data de-identification and reverse restoration method of the present invention through three groups of experiments.
[0046] In the first set of experiments, we selected 20 mobile phone numbers as experimental objects. The de-identification strategy was set to no padding, the cutting position was set to 3, and the conversion positions were specified to 8, 4, and 3. During the experiment, we used Python to implement the numerical data de-identification and reverse restoration procedures of this method. The following code shows the identification strategy.
[0047]
[0048] The following are detailed experimental results. The experimental results show that the de-identified data can be successfully reversed and restored, verifying the correctness of this method.
[0049]
[0050] In the second set of experiments, we used 20 pieces of ID card number data for testing. The de-identification strategy was set to no padding, the cut position was 5, and the conversion positions were specified as 8, 4, and 12. The following code shows the identification strategy.
[0051]
[0052] The following are detailed experimental results. The experimental results show that this method also has good effects when processing ID card number data, and can accurately de-identify and reverse restore the data.
[0053]
[0054] To further verify the versatility and practicality of this method, in the third set of experiments, we randomly selected 20 digital data for testing. In this experiment, we set the padding position to 10, the cutting position to 5, and the conversion positions to 8 and 4. The following code shows the tokenization strategy.
[0055]
[0056] The following are detailed experimental results, which once again prove the effectiveness and practicality of this method. The de-identified data can be accurately restored to the original data.
[0057]
[0058] Through the verification of three sets of experiments, we have fully proved the correctness and practicality of the numerical data de-identification and reverse restoration method proposed in this invention. In addition, we have also explored more debugging and expansion of this method, such as adjusting the cutting position, changing the operation method, and performing dictionary conversion for text data. These expansions bring greater application space to this method.
[0059] Figure 1 The method steps and process of the numerical data de-identification part in the embodiment of the present invention are mainly shown. It can be clearly seen from the figure that the method first performs data preprocessing and segmented replacement, and specifies operation steps and replacement operations to finally generate replaced numerical data. Through this series of orderly steps, the process realizes the data de-identification processing process from data input to result output.
[0060] Figure 2 It mainly shows the method steps and process of the reverse restoration part after the numerical data is de-identified in the embodiment of the present invention. First, according to the preset de-identification strategy, the system will perform reverse operation processing from back to front to locate and obtain the number at the specified position and its adjacent numbers. Next, the obtained numbers are analyzed to determine whether they need to be filled. If filling is required, the system will perform the corresponding filling operation, and take the filled numbers and adjacent numbers, and use the reverse operation value to replace the numbers at the specified position; if filling is not required, the numbers and adjacent numbers at the specified position are directly replaced. Finally, the replaced numerical data is reversely cut into two left and right sections, and the left and right are replaced, and the fixed-length numerical data supplemented in the preprocessing stage is eliminated to restore the original data.
[0061] This series of steps together constitutes a complete data processing flow, which achieves accurate processing and restoration of specific data through unique de-identification and reverse operation technology. This method has wide application value in the field of data security.
[0062] In summary, the method for de-identification and reverse restoration of numerical data in an embodiment of the present invention can provide the following advantages: it generates new numerical data through innovative preprocessing, segmented replacement and specified operation steps for the secure storage, sharing and de-identification processing requirements of numerical data before disclosure. This method not only ensures the security of the data, but also meets the data protection requirements in different scenarios by flexibly adjusting the degree of de-identification. More importantly, through a specific reverse operation strategy, the de-identified data can be accurately restored to the original data, thereby ensuring data security while maintaining the integrity and availability of the data.
[0063] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed, implements the steps of the method for de-identifying and reversely restoring numerical data provided by an embodiment of the present invention.
[0064] Figure 3 3 is a block diagram of a computer device 300 for a method of de-identifying and reversing numerical data according to an exemplary embodiment. For example, the computer device 300 may be provided as a server. Figure 3 The computer device 300 includes a processor 301, and the number of processors can be set to one or more as needed. The computer device 300 also includes a memory 302 for storing instructions that can be executed by the processor 301, such as application programs. The number of memories can be set to one or more as needed. The application programs stored therein can be one or more. The processor 301 is configured to execute instructions to execute the above-mentioned numerical data de-identification and reverse restoration method.
[0065] It should be understood by those skilled in the art that the embodiments of this article can be provided as methods, devices (equipment), or computer program products. Therefore, this article can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this article can adopt the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program codes. Computer storage media include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules or other data), including but not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, disk storage or other magnetic storage device, or any other medium that can be used to store desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that communication media generally contain computer-readable instructions, data structures, program modules or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.
[0066] This document is described with reference to flowcharts and / or block diagrams of methods, apparatuses (devices) and computer program products according to the embodiments of this document. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0067] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 Functions specified in one or more boxes
[0068] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0069] In this article, the term "comprises", "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, so that an article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such article or device. In the absence of more restrictions, the elements defined by the sentence "comprising..." do not exclude the presence of other identical elements in the article or device comprising the elements.
[0070] Although the preferred embodiments of this invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of this invention.
[0071] Obviously, those skilled in the art can make various changes and modifications to this article without departing from the spirit and scope of this article. Thus, if these modifications and variations of this article fall within the scope of the claims and their equivalents, then the intention of this article also includes these modifications and variations.
Claims
1. A method for de-identifying and reversely restoring numerical data, characterized in that: The following steps are involved: Step 1: Divide the first numerical data into two segments, the left and the right, and exchange their positions to form replaced numerical data; Step 2: Select a number at a specified position and the first number adjacent to it to perform an operation, and replace the number at the specified position with the result after the operation to generate second numerical data; Step 3: According to the de-identification strategy, reverse calculation and processing are performed from back to front to find the number and adjacent numbers at the specified position; Step 4: Analyze whether padding is needed according to the operation. If yes, take the digit after padding and the adjacent digits and use the reverse operation value to replace the digit at the specified position. If no, take the digit at the specified position and the adjacent digits and use the reverse operation value to replace the digit at the specified position. Step 5: Reversely cut the replaced numerical data into two parts, and then replace the left and right parts to restore the original data.
2. The method according to claim 1, wherein: Before step 1, it also includes: analyzing whether the length of the numerical data is suitable for de-identification by the present method; if not, supplementing fixed-length digital data in front of or after the data to generate new numerical data; and, restoring the original data in step 5 includes: removing the supplemented fixed-length digital data to restore the original data.
3. The method according to claim 1 or 2, wherein: In step 2, selecting the number at the specified position and the first number adjacent to it to perform an operation includes: selecting the number at the specified position and performing an addition operation on the first number to its right.
4. The method according to claim 3, wherein: Step 1 may be repeated N times, where N is an integer not less than 2.
5. The method according to claim 3, wherein: In step 4, determining whether padding is required based on the operation analysis includes: after the operation, determining whether padding is required based on the size relationship between the number at the specified position and its adjacent numbers.
6. The method according to claim 3, wherein: Step 4 may be repeated M times, where M is an integer not less than 2.
7. The method according to claim 3, wherein: Fixed-length numeric data is a random number of fixed length.
8. The method according to claim 3, wherein: The number at the specified position is the number corresponding to the specified subscript number.
9. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed, the method according to any one of claims 1 to 8 is implemented.
10. A computer device comprising a processor, a memory and a computer program stored in the memory, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Telephone number whitening and reverse whitening methods
CN105005743A
A recoverable lightweight desensitization method for reserved digital types
CN109039586A
Identity card number encryption method and device, equipment and medium
CN116049841A
Data publishing method, data receiving method, equipment and storage medium
CN118656873A
Systems and methods for de-identification of personal data
US20100042583A1