Marriage registration system data reconstruction method, device and terminal equipment
By clustering and deduplication of the data in the marriage registration system, and adding data identifiers for compression and reconstruction, the problem of increasing storage costs of the marriage registration system is solved, and more efficient data processing and storage is achieved.
Patent Information
- Application Number
- CN202011567358.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-12-25
- Publication Date
- 2024-12-31
- Estimated Expiration
- 2040-12-25
AI Technical Summary
With the increase of population, the demand for storage capacity of marriage registration systems has increased, resulting in an increase in storage costs. How to effectively process data in marriage registration systems to reduce storage costs has become an urgent problem.
By obtaining the registration source data of the marriage registration system, performing clustering and deduplication processing, building fingerprint calculation rules, adding data identifiers for compression and reconstruction after deduplication processing, realizing effective data storage and query.
This method not only reduces the storage cost of the marriage registration system, but also improves the data processing speed and supports subsequent data storage and query processes.
Smart Images
Figure CN112699108B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the field of data processing technology, and more specifically, relates to a marriage registration system data reconstruction method, device and terminal equipment. Background Art
[0002] As a civil affairs system, the marriage registration system has a large amount of data. On this basis, with the continuous increase in my country's population, the proportion of marriage registration personnel is still rising, resulting in an increasing demand for the storage capacity of the marriage registration system and an increasing storage cost.
[0003] Therefore, how to effectively process the data in the marriage registration system to reduce the storage cost of the data in the marriage registration system has become an urgent problem that technical personnel in this field need to solve. Summary of the invention
[0004] The purpose of the present invention is to provide a marriage registration system data reconstruction method, device and terminal equipment to solve the problem of increasing storage cost of the marriage registration system due to the increase in the number of registered population.
[0005] A first aspect of an embodiment of the present invention provides a method for reconstructing data of a marriage registration system, comprising:
[0006] Obtain the registration source data of the target marriage registration system;
[0007] Performing clustering processing on the registered source data to obtain multiple data classes;
[0008] Construct fingerprint calculation rules corresponding to each data class, and perform deduplication processing on each data class based on the fingerprint calculation rules corresponding to each data class to obtain registration source data after deduplication processing;
[0009] A data identifier is added to the registration source data after the deduplication processing, and the registration source data after the deduplication processing is compressed and reconstructed based on the data identifier to obtain the reconstructed registration source data.
[0010] A second aspect of an embodiment of the present invention provides a marriage registration system data reconstruction device, comprising:
[0011] A data acquisition module is used to acquire the registration source data of the target marriage registration system;
[0012] A clustering processing module, used for performing clustering processing on the registered source data to obtain multiple data classes;
[0013] A deduplication processing module is used to construct fingerprint calculation rules corresponding to each data class, and perform deduplication processing on each data class based on the fingerprint calculation rules corresponding to each data class to obtain the registration source data after deduplication processing;
[0014] The compression and reconstruction module is used to add a data identifier to the registration source data after the deduplication processing, and compress and reconstruct the registration source data after the deduplication processing based on the data identifier to obtain the reconstructed registration source data.
[0015] According to a third aspect of an embodiment of the present invention, a terminal device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned marriage registration system data reconstruction method when executing the computer program.
[0016] According to a fourth aspect of an embodiment of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned marriage registration system data reconstruction method are implemented.
[0017] The beneficial effects of the marriage registration system data reconstruction method, device and terminal device provided by the embodiments of the present invention are:
[0018] On the one hand, before deduplication, the present invention clusters each registration source data based on the similarity of each registration source data, and then performs deduplication processing based on multiple data classes obtained by clustering processing. Different from the prior art solution of directly deduplicating each registration source data, the batch processing solution provided by the present invention has a more thorough deduplication processing and a higher processing efficiency. On the other hand, the present invention adds data identifiers to each registration source data after deduplication processing, introduces the data identifiers into the compression and reconstruction of each registration source data, and compresses and reconstructs each registration source data, which not only reduces the storage cost of the marriage registration system, but also because each registration source data is marked by the data identifier, it better supports the subsequent data storage and data query processes, and improves the data processing speed of the marriage registration system. In other words, the present invention effectively reduces the storage cost of the marriage registration system from the two aspects of deduplication processing and data reconstruction. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0020] Figure 1 A schematic diagram of a process flow of a marriage registration system data reconstruction method provided by an embodiment of the present invention;
[0021] Figure 2A structural block diagram of a marriage registration system data reconstruction device provided by an embodiment of the present invention;
[0022] Figure 3 A schematic block diagram of a terminal device provided in one embodiment of the present invention. DETAILED DESCRIPTION
[0023] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0024] Please refer to Figure 1 , Figure 1 A flowchart of a marriage registration system data reconstruction method provided by an embodiment of the present invention, the method comprising:
[0025] S101: Acquire the registration source data of the target marriage registration system.
[0026] S102: Clustering the registered source data to obtain multiple data classes.
[0027] In this embodiment, the registered source data may be clustered based on a clustering algorithm to obtain multiple data classes.
[0028] S103: Construct fingerprint calculation rules corresponding to each data class, and perform deduplication processing on each data class based on the fingerprint calculation rules corresponding to each data class to obtain deduplication-processed registration source data.
[0029] In this embodiment, the fingerprint calculation rule corresponding to a data class is the extraction rule of the target field corresponding to the data class. The target field is a field used to determine whether there are duplicates in each registered source data in the data class. Accordingly, constructing the fingerprint calculation rule corresponding to each data class can be described in detail as follows: setting the extraction rule of the target field corresponding to each data class.
[0030] S104: adding a data identifier to the registration source data after the deduplication processing, and compressing and reconstructing the registration source data after the deduplication processing based on the data identifier to obtain the reconstructed registration source data.
[0031] In this embodiment, the registration source data after deduplication processing may be compressed and reconstructed based on an existing reconstruction algorithm to obtain reconstructed registration source data.
[0032] It can be concluded from the above that the embodiments of the present invention have the following effects: on the one hand, before deduplication, the present invention performs clustering processing on each registration source data based on the similarity of each registration source data, and then performs deduplication processing based on multiple data classes obtained by clustering processing. Different from the prior art solution of directly deduplicating each registration source data, the batch processing solution provided by the present invention has more thorough deduplication processing and higher processing efficiency. On the other hand, the present invention adds data identifiers to each registration source data after deduplication processing, introduces the data identifiers into the compression and reconstruction of each registration source data, and compresses and reconstructs each registration source data, which not only reduces the storage cost of the marriage registration system, but also because each registration source data is marked by the data identifier, it better supports the subsequent data storage and data query processes, and improves the data processing speed of the marriage registration system. In other words, the present invention effectively reduces the storage cost of the marriage registration system from the two aspects of deduplication processing and data reconstruction.
[0033] Optionally, as a specific implementation of the marriage registration system data reconstruction method provided in an embodiment of the present invention, adding a data identifier to the registration source data after deduplication processing includes:
[0034] The data identification range corresponding to each data class is determined based on the average usage frequency of each data class.
[0035] A data identifier is added to each registration source data after the deduplication processing based on the data class to which each registration source data after the deduplication processing belongs and the data identifier range corresponding to each data class.
[0036] In this embodiment, the average usage frequency of a certain data class refers to the average access frequency of each registered source data in the certain data class.
[0037] In this embodiment, the method for determining the data identifier of each registration source data can be described in detail as follows:
[0038] Taking each data class as a unit, each registration source data in each data class is sorted according to the access frequency of each registration source data.
[0039] For a certain registration source data, based on the sorting sequence number of the registration source data in the data class to which it belongs, a data identifier is selected from the data identifier range corresponding to the data class to which it belongs as the data identifier of the registration source data.
[0040] Optionally, as a specific implementation of the marriage registration system data reconstruction method provided in an embodiment of the present invention, the marriage registration system data reconstruction method may further include:
[0041] The compressed and reconstructed registration source data are stored based on the data identifier of each reconstructed registration source data.
[0042] In this embodiment, the data identifier of each registration source data is determined by the access frequency of each registration source data. The storage of each compressed and reconstructed registration source data based on the data identifier of each reconstructed registration source data can be described in detail as follows:
[0043] Storing various registered source data belonging to the same data class into a continuous storage space;
[0044] For each registration source data belonging to the same data class, the storage order of each registration source data is determined according to the data identifier corresponding to each registration source data (wherein, the registration source data with a higher access frequency has a higher storage position at the front).
[0045] Optionally, as a specific implementation of the marriage registration system data reconstruction method provided in an embodiment of the present invention, clustering is performed on the registration source data table to obtain multiple data classes, including:
[0046] S41: Generate a data network based on the association relationship between each registration source data, wherein each registration source data corresponds to a node of the data network, and the association relationship between each registration source data corresponds to the connection relationship between each node of the data network.
[0047] S42: Calculate the degree centrality index of each undivided node, take the undivided node with the largest degree centrality index as the central node of the current data class, and determine the remaining nodes in the current data class based on the similarity between the remaining divided nodes and the central node of the current data class.
[0048] Among them, the unclassified node refers to the node that is not classified into any data class.
[0049] S43: Repeat step S42 until all nodes are classified into a certain data class, and obtain multiple initially divided data classes. Merge each initially divided data class based on the similarity between each initially divided data class, and obtain multiple data classes.
[0050] In this embodiment, the data classes after each initial division are merged based on the similarity between the data classes after each initial division, and the multiple data classes obtained can be described in detail as follows:
[0051] After the initial division, the data classes are calculated in pairs, and the similarity between each two data classes is calculated. If the similarity between two data classes is less than a preset threshold, the two data classes are merged. Repeat the above merging steps to obtain multiple merged data classes.
[0052] Optionally, as a specific implementation of the marriage registration system data reconstruction method provided by an embodiment of the present invention, for a certain data class, deduplication processing is performed on the data class based on the fingerprint calculation rule corresponding to the data class, including:
[0053] Based on the fingerprint calculation rules corresponding to the data class, the target fields of each registered source data in the data class are extracted, and the registered source data with repeated target fields are deleted to achieve deduplication processing of the data class.
[0054] Optionally, as a specific implementation of the marriage registration system data reconstruction method provided in an embodiment of the present invention, the registration source data after deduplication processing is compressed and reconstructed based on the data identifier to obtain the reconstructed registration source data, including:
[0055] A pseudo-random number corresponding to each registration source data is generated based on the data identifier of each registration source data.
[0056] The measurement matrix corresponding to each data class is determined according to the pseudo-random number corresponding to each registration source data and the data class to which each registration source data belongs.
[0057] Based on the measurement matrix corresponding to each data class and a preset sparse basis, each registration source data is compressed and reconstructed to obtain the reconstructed registration source data.
[0058] In this embodiment, the measurement matrix corresponding to each data class is determined according to the pseudo-random number corresponding to each registration source data and the data class to which each registration source data belongs, which can be described in detail as follows:
[0059] The pseudo-random numbers corresponding to each registration source data belonging to the same data class are combined to obtain the measurement matrix corresponding to each data class. The measurement matrix corresponding to each data class is also the measurement matrix corresponding to the registration source data in each data class, that is, the measurement matrix corresponding to each registration source data belonging to the same data class is the same. Among them, the combination order of the pseudo-random numbers corresponding to each registration source data in the same data class is determined by the data identifier corresponding to each registration source data (for example, the size order of the data identifier corresponding to each registration source data in the same data class can be used as the combination order of the pseudo-random numbers corresponding to each registration source data in the same data class).
[0060] Corresponding to the marriage registration system data reconstruction method in the above embodiment, Figure 2 This is a structural block diagram of a data reconstruction device for a marriage registration system provided by an embodiment of the present invention. For ease of description, only the parts related to the embodiment of the present invention are shown. Figure 2 The marriage registration system data reconstruction device 20 includes: a data acquisition module 21, a clustering processing module 22, a deduplication processing module 23, and a compression reconstruction module 24.
[0061] The data acquisition module 21 is used to acquire the registration source data of the target marriage registration system.
[0062] The clustering processing module 22 is used to perform clustering processing on the registered source data to obtain multiple data classes.
[0063] The deduplication processing module 23 is used to construct fingerprint calculation rules corresponding to each data class, and perform deduplication processing on each data class based on the fingerprint calculation rules corresponding to each data class to obtain registration source data after deduplication processing.
[0064] The compression and reconstruction module 24 is used to add data identifiers to the registration source data after deduplication processing, and compress and reconstruct the registration source data after deduplication processing based on the data identifier to obtain reconstructed registration source data.
[0065] Optionally, as a specific implementation of the marriage registration system data reconstruction device provided in an embodiment of the present invention, adding a data identifier to the registration source data after deduplication processing includes:
[0066] The data identification range corresponding to each data class is determined based on the average usage frequency of each data class.
[0067] A data identifier is added to each registration source data after the deduplication processing based on the data class to which each registration source data after the deduplication processing belongs and the data identifier range corresponding to each data class.
[0068] Optionally, as a specific implementation of the marriage registration system data reconstruction device provided in an embodiment of the present invention, the compression and reconstruction module 24 may further perform the following steps:
[0069] The compressed and reconstructed registration source data are stored based on the data identifier of each reconstructed registration source data.
[0070] Optionally, as a specific implementation of the marriage registration system data reconstruction device provided by an embodiment of the present invention, clustering is performed on the registration source data table to obtain multiple data classes, including:
[0071] S41: Generate a data network based on the association relationship between each registration source data, wherein each registration source data corresponds to a node of the data network, and the association relationship between each registration source data corresponds to the connection relationship between each node of the data network.
[0072] S42: Calculate the degree centrality index of each undivided node, take the undivided node with the largest degree centrality index as the central node of the current data class, and determine the remaining nodes in the current data class based on the similarity between the remaining divided nodes and the central node of the current data class.
[0073] Among them, the unclassified node refers to the node that is not classified into any data class.
[0074] S43: Repeat step S42 until all nodes are classified into a certain data class, and obtain multiple initially divided data classes. Merge each initially divided data class based on the similarity between each initially divided data class, and obtain multiple data classes.
[0075] Optionally, as a specific implementation of the marriage registration system data reconstruction device provided by an embodiment of the present invention, the fingerprint calculation rule corresponding to a certain data class is the extraction rule of the target field corresponding to the data class.
[0076] The target field is used to determine whether there are duplicate fields in each registered source data in the data class. Accordingly, the fingerprint calculation rules corresponding to each data class include:
[0077] Set the extraction rules for the target fields corresponding to each data class.
[0078] Optionally, as a specific implementation of the marriage registration system data reconstruction device provided by an embodiment of the present invention, for a certain data class, deduplication processing is performed on the data class based on the fingerprint calculation rule corresponding to the data class, including:
[0079] Based on the fingerprint calculation rules corresponding to the data class, the target fields of each registered source data in the data class are extracted, and the registered source data with repeated target fields are deleted to achieve deduplication processing of the data class.
[0080] Optionally, as a specific implementation of the marriage registration system data reconstruction device provided in an embodiment of the present invention, the registration source data after deduplication processing is compressed and reconstructed based on the data identifier to obtain the reconstructed registration source data, including:
[0081] A pseudo-random number corresponding to each registration source data is generated based on the data identifier of each registration source data.
[0082] The measurement matrix corresponding to each data class is determined according to the pseudo-random number corresponding to each registration source data and the data class to which each registration source data belongs.
[0083] Based on the measurement matrix corresponding to each data class and a preset sparse basis, each registration source data is compressed and reconstructed to obtain the reconstructed registration source data.
[0084] See also Figure 3 , Figure 3 A schematic block diagram of a terminal device provided by an embodiment of the present invention. Figure 3The terminal 300 in the embodiment shown may include: one or more processors 301, one or more input devices 302, one or more output devices 303 and one or more memories 304. The processors 301, input devices 302, output devices 303 and memories 304 communicate with each other via a communication bus 305. The memory 304 is used to store computer programs, which include program instructions. The processor 301 is used to execute the program instructions stored in the memory 304. The processor 301 is configured to call the program instructions to perform the following operations to perform the functions of the modules / units in the above-mentioned device embodiments, such as Figure 2 The functions of modules 21 to 24 are shown.
[0085] It should be understood that in the embodiment of the present invention, the processor 301 may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.
[0086] The input device 302 may include a touch panel, a fingerprint sensor (for collecting the user's fingerprint information and fingerprint direction information), a microphone, etc., and the output device 303 may include a display (LCD, etc.), a speaker, etc.
[0087] The memory 304 may include a read-only memory and a random access memory, and provide instructions and data to the processor 301. A portion of the memory 304 may also include a non-volatile random access memory. For example, the memory 304 may also store information about the device type.
[0088] In a specific implementation, the processor 301, input device 302, and output device 303 described in the embodiment of the present invention can execute the implementation methods described in the first and second embodiments of the marriage registration system data reconstruction method provided in the embodiment of the present invention, and can also execute the implementation methods of the terminal described in the embodiment of the present invention, which will not be repeated here.
[0089] In another embodiment of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, wherein the program instructions are executed by a processor to implement all or part of the processes in the above-mentioned embodiment method, and may also be completed by instructing the relevant hardware through the computer program, wherein the computer program may be stored in a computer-readable storage medium, and wherein the computer program may be executed by the processor to implement the steps of the above-mentioned various method embodiments. Among them, the computer program includes computer program code, and the computer program code may be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the contents contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electric carrier signal and telecommunication signal.
[0090] The computer-readable storage medium may be an internal storage unit of the terminal of any of the foregoing embodiments, such as a hard disk or memory of the terminal. The computer-readable storage medium may also be an external storage device of the terminal, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the terminal. Further, the computer-readable storage medium may also include both an internal storage unit of the terminal and an external storage device. The computer-readable storage medium is used to store computer programs and other programs and data required by the terminal. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.
[0091] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.
[0092] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the terminals and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.
[0093] In the several embodiments provided in the present application, it should be understood that the disclosed terminals and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces or units, or it can be an electrical, mechanical or other form of connection.
[0094] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.
[0095] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0096] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.
Claims
1. A marriage registration system data reconstruction method, characterized in that: include: Obtain the registration source data of the target marriage registration system; Performing clustering processing on the registered source data to obtain multiple data classes; Construct fingerprint calculation rules corresponding to each data class, and perform deduplication processing on each data class based on the fingerprint calculation rules corresponding to each data class to obtain registration source data after deduplication processing; adding a data identifier to the registration source data after the deduplication processing, and compressing and reconstructing the registration source data after the deduplication processing based on the data identifier to obtain the reconstructed registration source data; The clustering process is performed on the registered source data to obtain multiple data classes, including: S41: generating a data network based on the association relationship between each registration source data; wherein each registration source data corresponds to a node of the data network, and the association relationship between each registration source data corresponds to the connection relationship between each node of the data network; S42: Calculate the degree centrality index of each undivided node, take the undivided node with the largest degree centrality index as the central node of the current data class, and determine the remaining nodes in the current data class based on the similarity between the remaining divided nodes and the central node of the current data class; Among them, unclassified nodes refer to nodes that are not classified into any data class; S43: Repeat step S42 until all nodes are classified into a certain data class, and obtain multiple initially divided data classes; merge each initially divided data class based on the similarity between each initially divided data class, and obtain multiple data classes; The data classes after each initial division are merged based on the similarity between the data classes after each initial division to obtain multiple data classes, including: Perform pairwise calculations on the data classes after the initial division and calculate the similarity between every two data classes; If the similarity between two data classes is less than a preset threshold, the two data classes are merged; Repeat the above merging steps to obtain multiple merged data classes.
2. The marriage registration system data reconstruction method according to claim 1, characterized in that: The step of adding a data identifier to the registration source data after the deduplication process includes: Determine the data identification range corresponding to each data class based on the average usage frequency of each data class; A data identifier is added to each registration source data after the deduplication processing based on the data class to which each registration source data after the deduplication processing belongs and the data identifier range corresponding to each data class.
3. The marriage registration system data reconstruction method according to claim 2, characterized in that: Also includes: The compressed and reconstructed registration source data are stored based on the data identifier of each reconstructed registration source data.
4. The marriage registration system data reconstruction method according to claim 1, characterized in that: The fingerprint calculation rule corresponding to a data class is the extraction rule of the target field corresponding to the data class; The target field is a field used to determine whether there are duplicates in each registered source data in the data class; accordingly, the fingerprint calculation rules corresponding to each data class are constructed including: Set the extraction rules for the target fields corresponding to each data class.
5. The marriage registration system data reconstruction method according to claim 4, characterized in that: For a certain data class, deduplication processing is performed on the data class based on the fingerprint calculation rules corresponding to the data class, including: Based on the fingerprint calculation rules corresponding to the data class, the target fields of each registered source data in the data class are extracted, and the registered source data with repeated target fields are deleted to achieve deduplication processing of the data class.
6. The marriage registration system data reconstruction method according to claim 1, characterized in that: The compressing and reconstructing the registration source data after deduplication processing based on the data identifier to obtain the reconstructed registration source data includes: Generate a pseudo-random number corresponding to each registration source data based on the data identifier of each registration source data; Determine the measurement matrix corresponding to each data class according to the pseudo-random number corresponding to each registration source data and the data class to which each registration source data belongs; Based on the measurement matrix corresponding to each data class and a preset sparse basis, each registration source data is compressed and reconstructed to obtain the reconstructed registration source data.
7. A marriage registration system data reconstruction device, characterized in that: include: A data acquisition module is used to acquire the registration source data of the target marriage registration system; A clustering processing module, used for performing clustering processing on the registered source data to obtain multiple data classes; A deduplication processing module is used to construct fingerprint calculation rules corresponding to each data class, and perform deduplication processing on each data class based on the fingerprint calculation rules corresponding to each data class to obtain the registration source data after deduplication processing; A compression and reconstruction module, used for adding a data identifier to the registration source data after the deduplication processing, and compressing and reconstructing the registration source data after the deduplication processing based on the data identifier to obtain the reconstructed registration source data; The clustering process is performed on the registration source data table to obtain multiple data classes, including: S41: generating a data network based on the association relationship between each registration source data; wherein each registration source data corresponds to a node of the data network, and the association relationship between each registration source data corresponds to the connection relationship between each node of the data network; S42: Calculate the degree centrality index of each undivided node, take the undivided node with the largest degree centrality index as the central node of the current data class, and determine the remaining nodes in the current data class based on the similarity between the remaining divided nodes and the central node of the current data class; Among them, unclassified nodes refer to nodes that are not classified into any data class; S43: Repeat step S42 until all nodes are classified into a certain data class, and obtain multiple initially divided data classes; merge each initially divided data class based on the similarity between each initially divided data class, and obtain multiple data classes; The data classes after each initial division are merged based on the similarity between the data classes after each initial division to obtain multiple data classes, including: Perform pairwise calculations on the data classes after the initial division and calculate the similarity between every two data classes; If the similarity between two data classes is less than a preset threshold, the two data classes are merged; Repeat the above merging steps to obtain multiple merged data classes.
8. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.