A user duplicate elimination method, system and computer readable recording medium

Abstract

The present invention provides a method and system for deduplication of users, and relates to the field of mobile communications. The method comprises: issuing a statistical request to request the number of users to be counted; issuing a desensitization level confirmation request according to the statistical request to request the confirmed desensitization level to be sent; confirming the request according to the desensitization level and sending the confirmed desensitization level; determining the desensitization level for calculation according to the confirmed desensitization level, and extracting trajectory data from the blockchain according to the desensitization level for calculation to perform deduplication calculation and obtain the number of users. In the present invention, accurate deduplication statistics can be performed on mobile terminal users across operators.

Description

Technical Field

[0001] The present invention relates to the field of mobile communications, and in particular to a user deduplication method, system and computer-readable recording medium. Background Art

[0002] Statistics on the number of mobile terminal users play an important role in production and life. For example, in scenarios such as national population census, urban planning, business surveys, and market research, statistics based on mobile terminal users can comprehensively analyze the distribution, migration, employment, residence, and travel patterns of the population. Compared with traditional methods such as household registration statistics, door-to-door / street interviews, statistics have significant advantages such as high efficiency, good real-time performance, good authenticity, and support for global statistical analysis rather than sampling.

[0003] At present, one-person-multiple-number services are very common in the services provided by various telecom operators. The penetration rate of mobile terminals in developed cities such as Beijing has long exceeded 100%, and it is common for a natural person user to use multiple SIM cards at the same time, for example, using multiple mobile terminals, or having two SIM cards in a mobile terminal, or using multiple smart devices such as smart bracelets and smart watches. One-person-multiple-number services not only occur within one operator, but also across operators. For example, due to differences in tariffs, coverage, marketing activities, etc., a natural person user often uses SIM cards from multiple different operators at the same time.

[0004] Statistics on the number of mobile terminal users often require user deduplication technology, especially for mobile terminal users across operators, user deduplication technology will face greater challenges. For example, if the number of mobile terminal users is only counted on the network side, mobile terminal users using the one-person-multiple-number service will be counted as multiple users, resulting in statistical deviation. Therefore, it is necessary to identify and eliminate multiple other mobile terminal numbers of the same natural person user by using user deduplication technology. However, in the cross-operator scenario, information interaction between different operators faces problems such as privacy protection and asset leakage, making it more difficult to count the number of mobile terminal users.

[0005] In the prior art, there are the following two solutions for performing user deduplication based on relevant information of mobile terminal users.

[0006] Solution 1: Deduplication based on user identity information

[0007] In this scheme, mobile terminal numbers registered under the same user ID card are identified as the same user.

[0008] The technical defects of this solution are as follows:

[0009] This is not in line with the reality. For example, a natural person user can use his or her ID card to apply for a SIM card for his or her family. In addition, this solution also has the risk of user privacy being leaked, as operators often do not provide sensitive information such as user ID numbers to other operators that are competitors.

[0010] Solution 2: De-duplication based on user displacement trajectory.

[0011] In this solution, if the movement trajectories of two mobile terminal numbers are basically the same, such as staying at the same base station for multiple times and in the same time period, it is considered that the users of these two numbers are the same natural person.

[0012] The technical defects of this solution are as follows:

[0013] Not applicable to cross-operator scenarios. Figure 1 Schematic diagram of user displacement trajectories of different operators in the prior art. Figure 1 As shown, since the number, deployment location, and coverage area of ​​base stations of different operators may not be exactly the same, it is impossible to make a one-to-one judgment based on the base stations that the user's displacement trajectory passes through.

[0014] In addition, judging from the longitude and latitude of the trajectory is not feasible. From the network side, the user trajectory is mainly reflected in the continuous process of staying at each base station and switching between different base stations. Therefore, the user trajectory recorded on the network side is an ordered collection of a series of location points and the time period of stay at the point. The coordinates of each location point are the longitude and latitude of the base station where it stays. On the one hand, the base stations of different operators are deployed in different locations, which will result in different longitude and latitude of the stay points of the same natural person user in different operators' networks. On the other hand, the location of the base station is the core secret of the operator and it is not convenient to provide it to competitors. Summary of the invention

[0015] The present invention provides a method and system for deduplication of mobile terminal users and a computer-readable recording medium, which are used to solve the current problem that it is impossible to accurately perform deduplication calculation of users across operators.

[0016] In order to solve the above-mentioned technical problems, the present invention is achieved as follows:

[0017] According to a first aspect of the present invention, a method for user deduplication is provided, the method comprising:

[0018] Send a statistics request to count the number of users;

[0019] According to the statistical request, a desensitization level confirmation request is issued, requesting to send the confirmed desensitization level;

[0020] According to the redistribution level confirmation request, the confirmed redistribution level is sent;

[0021] The desensitization level for calculation is determined according to the confirmed desensitization level, and the trajectory data is extracted from the blockchain for deduplication calculation according to the desensitization level for calculation to obtain the number of users.

[0022] Optionally, before the step of issuing a statistical request, the original trajectory data of the user is obtained from the operator's big data platform, the original trajectory data is subjected to multi-level desensitization processing to obtain desensitized trajectory data, and the desensitized trajectory data is uploaded to the blockchain.

[0023] Optionally, the trajectory data after the multi-level desensitization processing is subjected to hierarchical encryption processing to obtain hierarchically encrypted trajectory data, and the hierarchically encrypted trajectory data is uploaded to the blockchain.

[0024] Optionally, the trajectory data after multi-level desensitization processing includes at least trajectory data after first-level desensitization processing and trajectory data after second-level desensitization processing. For the trajectory data after the first-level desensitization processing, the first encryption key is used for encryption processing, and for the trajectory data after the second-level desensitization processing, the second encryption key is used for encryption processing.

[0025] Optionally, a decryption key corresponding to the hierarchically encrypted trajectory data is stored and provided, wherein the decryption key includes a first decryption key corresponding to the first encryption key and a second decryption key corresponding to the second encryption key.

[0026] Optionally, a request is sent to the operator's on-chain node, requesting the decryption key corresponding to the desensitization level for calculation, and the decryption key corresponding to the desensitization level for calculation is sent to the deduplication statistics node respectively; the hierarchically encrypted trajectory data is obtained from the blockchain according to the statistical request, and the hierarchically encrypted trajectory data is decrypted using the decryption key corresponding to the desensitization level for calculation to obtain the decrypted trajectory data.

[0027] Optionally, the blockchain stores the trajectory data provided by the operator, and based on the statistical request, extracts the trajectory data corresponding to the statistical request.

[0028] Optionally, the statistical request includes the operator name, the predetermined time range, and the predetermined geographical range.

[0029] Optionally, a deduplication algorithm based on the same trajectory data is used to perform deduplication calculation, wherein if the movement trajectories of two mobile terminal numbers belonging to different operators are substantially the same, it is considered that the users of the two mobile terminal numbers are the same natural person.

[0030] According to a second aspect of the present invention, a user deduplication system is provided, the system comprising a statistics department node, a deduplication calculation node, an operator on-chain node and a blockchain, wherein:

[0031] The statistics department node is used to send a statistics request to the deduplication calculation node to request the number of users;

[0032] The deduplication calculation node is used to send a desensitization level confirmation request to the operator's on-chain node according to the statistical request, requesting the operator's on-chain node to send the confirmed desensitization level;

[0033] The operator's on-chain node is used to send the confirmed desensitization level to the deduplication calculation node according to the desensitization level confirmation request;

[0034] The deduplication calculation node is used to determine the desensitization level for calculation according to the confirmed desensitization level, and extract the trajectory data from the blockchain according to the desensitization level for calculation to perform deduplication calculation, obtain the number of mobile users, and send the number of mobile users to the statistical department node.

[0035] Optionally, the operator's on-chain node includes a desensitization module and a transmission module, wherein:

[0036] The desensitization module is used to obtain the original trajectory data of users from the operator's big data platform, perform multi-level desensitization processing on the original trajectory data, and obtain the desensitized trajectory data;

[0037] The transmission module is used to upload the desensitized trajectory data to the blockchain.

[0038] Optionally, the operator's on-chain node includes an encryption module, wherein:

[0039] An encryption module, used for performing hierarchical encryption processing on the trajectory data after the multi-level desensitization processing to obtain hierarchical encrypted trajectory data;

[0040] The transmission module is used to upload the hierarchically encrypted trajectory data to the blockchain.

[0041] Optionally, the trajectory data after multi-level desensitization processing includes at least trajectory data after first-level desensitization processing and trajectory data after second-level desensitization processing. The encryption module uses a first encryption key to encrypt the trajectory data after the first-level desensitization processing, and the encryption module uses a second encryption key to encrypt the trajectory data after the second-level desensitization processing.

[0042] Optionally, the operator's on-chain node includes a key management module, wherein:

[0043] The key management module is used to store and provide decryption keys corresponding to the hierarchically encrypted trajectory data, wherein the decryption keys include a first decryption key corresponding to the first encryption key and a second decryption key corresponding to the second encryption key.

[0044] Optionally, the deduplication calculation node includes an interaction module, an acquisition module, a decryption module and a calculation module, wherein:

[0045] An interaction module, used to send a request to the operator's on-chain node, requesting a decryption key corresponding to the calculation desensitization level, and obtaining the decryption key corresponding to the calculation desensitization level from the operator's on-chain node;

[0046] The acquisition module obtains the hierarchically encrypted trajectory data from the blockchain;

[0047] A decryption module, which uses a decryption key corresponding to the calculation desensitization level to decrypt the hierarchically encrypted trajectory data to obtain decrypted trajectory data;

[0048] The calculation module performs deduplication calculation on the decrypted trajectory data to obtain the number of mobile users.

[0049] Optionally, the blockchain includes a storage module and an extraction module, wherein:

[0050] A storage module, used to store the trajectory data provided by the operator;

[0051] The extraction module is used to extract the trajectory data corresponding to the statistical request according to the statistical request.

[0052] Optionally, the statistical request includes the operator name, the predetermined time range, and the predetermined geographical range.

[0053] Optionally, the deduplication calculation node uses a deduplication algorithm based on the same trajectory data to perform deduplication calculation, wherein if the movement trajectories of two mobile terminal numbers belonging to different operators are basically the same, it is considered that the users of the two mobile terminal numbers are the same natural person.

[0054] According to a third aspect of the present invention, there is provided a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the user deduplication method described in the first aspect are implemented.

[0055] In the embodiment of the present invention, accurate deduplication statistics can be performed on mobile terminal users across operators, thereby protecting the core assets of operators and user privacy. By utilizing the tamper-proof characteristics of blockchain, important data such as user trajectory data and the desensitization level of statistical departments can be protected. In addition, user statistics with different desensitization levels can be implemented for different types of statistical departments, such as government regulatory departments, commercial advertising agencies, etc. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0057] Figure 1 A schematic diagram of user displacement trajectories of different operators in the prior art;

[0058] Figure 2 It is a structural block diagram of a mobile terminal user duplicate elimination system according to a specific embodiment of the present invention;

[0059] Figure 3 It is a structural block diagram of a carrier uplink node according to an embodiment of the present invention;

[0060] Figure 4 A structural block diagram of a blockchain according to an embodiment of the present invention;

[0061] Figure 5 is a structural block diagram of a duplicate removal calculation node according to an embodiment of the present invention;

[0062] Figure 6 is a flow chart of a method for deduplication of users according to an embodiment of the present invention;

[0063] Figure 7 The present invention is a flowchart of a method for deduplication of mobile terminal users according to a specific embodiment of the present invention. DETAILED DESCRIPTION

[0064] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0065] Figure 2 FIG. 1 is a structural block diagram of a mobile terminal user duplicate sorting system according to an embodiment of the present invention. Figure 2 As shown, the mobile terminal user deduplication system includes an operator A on-chain node 101A, an operator B on-chain node 101B, an operator C on-chain node 101C, an operator A big data platform 102A, an operator B big data platform 102B, an operator C big data platform 102C, a blockchain 103, a deduplication calculation node 104, a statistics department A node 105A, and a statistics department B node 105B, which are interconnected through a network.

[0066] In this embodiment, the operator A on-chain node 101A, the operator B on-chain node 101B, and the operator C on-chain node 101C correspond to the operator A, the operator B, and the operator C respectively, but the present invention is not limited to this, and the present invention is also applicable to more different operators.

[0067] In this embodiment, the statistics department A node and the statistics department B node are shown by way of example, but the present invention is not limited thereto, and the present invention is also applicable to more different statistics departments.

[0068] For the sake of ease of description, operator A's on-chain node 101A, operator B's on-chain node 101B, and operator C's on-chain node 101C are collectively referred to as operator on-chain nodes, operator A's big data platform 102A, operator B's big data platform 102B, and operator C's big data platform 102C are collectively referred to as operator big data platforms 102, and statistics department A node 105A and statistics department B node 105B are collectively referred to as statistics department nodes 105.

[0069] The statistics department node 105 sends a statistics request to the deduplication calculation node 104, requesting to count the number of mobile users.

[0070] The deduplication calculation node 104 sends a desensitization level confirmation request to the operator on-chain node 101 according to the statistical request, so as to request the operator on-chain node 101 to send the confirmed desensitization level.

[0071] The operator's on-chain node 101 receives the desensitization level confirmation request and sends the confirmed desensitization level to the deduplication calculation node 104 according to the request.

[0072] The deduplication calculation node 104 receives the confirmed desensitization level from the operator's on-chain node 101 and determines the desensitization level for calculation.

[0073] The deduplication calculation node 104 sends a request to the operator's on-chain node 101, requesting a decryption key corresponding to the desensitization level used for calculation.

[0074] The operator's on-chain node 101 sends a decryption key corresponding to the desensitization level used for calculation to the deduplication statistics node 104 .

[0075] The deduplication calculation node extracts the corresponding trajectory data from the blockchain 103 according to the statistical request, and decrypts the trajectory data using a decryption key corresponding to the desensitization level for calculation to obtain the decrypted trajectory data.

[0076] The deduplication calculation node 104 performs user deduplication calculation according to the decrypted trajectory data, obtains statistical results, and feeds back the statistical results to the statistical department node.

[0077] Figure 3 It is a structural block diagram of an operator on-chain node according to an embodiment of the present invention, wherein the operator on-chain node 101 includes: a desensitizing module 1011, an encryption module 1012, a transmission module 1013, a confirmation module 1014 and a key management module 1015.

[0078] The desensitization module 1011 is used to obtain the original trajectory data of the mobile user from the operator's big data platform, perform desensitization processing on the original trajectory data, and obtain desensitized trajectory data. Among them, the desensitization module 301 can perform multi-level desensitization processing on the original trajectory data according to actual conditions to obtain multi-level desensitized trajectory data. The multi-level desensitization processing may include different levels of desensitization processing such as first-level desensitization processing, second-level desensitization processing, ..., and N-th level desensitization processing.

[0079] The encryption module 1012 encrypts the trajectory data after the desensitization process to obtain the encrypted trajectory data. For the trajectory data after the multi-level desensitization process, a hierarchical encryption method can be used to obtain the hierarchically encrypted trajectory data. For example, for the trajectory data after the first level of desensitization process, the first encryption key is used for encryption, for the trajectory data after the second level of desensitization process, the second encryption key is used for encryption, and for the trajectory data after the Nth level of desensitization process, the Nth encryption key is used for encryption.

[0080] Transmission module 1013, uploading the encrypted trajectory data to the blockchain;

[0081] The confirmation module 1014 confirms the desensitization level of the statistical department, wherein the desensitization level corresponding to the type of the statistical department is confirmed.

[0082] The key management module 1015 stores and provides decryption keys corresponding to the encrypted trajectory data. For the hierarchically encrypted trajectory data, each encryption key has a corresponding decryption key, for example, a first decryption key corresponding to the first encryption key, a second decryption key corresponding to the second encryption key, and an Nth decryption key corresponding to the Nth encryption key.

[0083] Figure 4 103 is a structural block diagram of a blockchain according to an embodiment of the present invention, wherein the blockchain 103 includes: a storage module 1031, an extraction module 1032, and an allocation module 1033.

[0084] Storage module 1031, storing encrypted trajectory data provided by each operator;

[0085] The extraction module 1032 extracts the trajectory data corresponding to the statistical request according to the statistical request. For example, according to the operator name, the predetermined time range, and the predetermined geographical range included in the statistical request, the trajectory data corresponding to the operator and within the predetermined time range and the predetermined geographical range is extracted.

[0086] The allocation module 1033 allocates a desensitization level to the statistical department, wherein the desensitization level corresponding to the type of the statistical department is allocated.

[0087] Figure 5 104 is a structural block diagram of a duplicate removal computing node according to an embodiment of the present invention, wherein the duplicate removal computing node 104 includes: an interaction module 1041, an acquisition module 1042, a decryption module 1043, and a computing module 1044.

[0088] The interaction module 1041 interacts with the operator's on-chain node to obtain the desensitization level of the statistical department;

[0089] An acquisition module 1042 acquires encrypted trajectory data from the blockchain;

[0090] The decryption module 1043 obtains the decryption key corresponding to the encrypted trajectory data from the operator's uplink node, decrypts the encrypted trajectory data, and obtains the decrypted trajectory data;

[0091] The calculation module 1044 performs deduplication calculation on the mobile terminal users according to the decrypted trajectory data, identifies multiple mobile terminal numbers belonging to the same natural person user and different operators, and counts these mobile terminal numbers as the same natural person user.

[0092] See also Figure 6 , an embodiment of the present application provides a user duplicate elimination method, the method comprising:

[0093] Step 601: Send a statistics request to request the number of users;

[0094] Step 602: according to the statistical request, a desensitization level confirmation request is issued, requesting to send the confirmed desensitization level;

[0095] Step 603: Send the confirmed desensitization level according to the desensitization level confirmation request;

[0096] Step 604: Determine the desensitization level for calculation according to the confirmed desensitization level, and extract the trajectory data from the blockchain according to the desensitization level for calculation to perform deduplication calculation to obtain the number of users.

[0097] In the embodiment of the present application, before step 601, the method further includes:

[0098] The user's original trajectory data is obtained from the operator's big data platform, and the original trajectory data is subjected to multi-level desensitization processing to obtain the desensitized trajectory data, which is then uploaded to the blockchain.

[0099] In an embodiment of the present application, the method further includes:

[0100] The trajectory data after multi-level desensitization is subjected to hierarchical encryption to obtain hierarchical encrypted trajectory data, and the hierarchical encrypted trajectory data is uploaded to the blockchain.

[0101] In an embodiment of the present application, the trajectory data after multi-level desensitization processing includes at least trajectory data after first-level desensitization processing and trajectory data after second-level desensitization processing. For the trajectory data after the first-level desensitization processing, the first encryption key is used for encryption processing, and for the trajectory data after the second-level desensitization processing, the second encryption key is used for encryption processing.

[0102] In an embodiment of the present application, the method further includes:

[0103] Decryption keys corresponding to the hierarchically encrypted trajectory data are stored and provided, wherein the decryption keys include a first decryption key corresponding to the first encryption key and a second decryption key corresponding to the second encryption key.

[0104] In an embodiment of the present application, the method further includes:

[0105] Send a request to the operator's on-chain node, requesting the decryption key corresponding to the desensitization level for calculation, and send the decryption key corresponding to the desensitization level for calculation to the duplicate removal statistics node respectively;

[0106] According to the statistical request, the hierarchically encrypted trajectory data is obtained from the blockchain, and the hierarchically encrypted trajectory data is decrypted using the decryption key corresponding to the desensitization level for calculation to obtain the decrypted trajectory data.

[0107] In an embodiment of the present application, the blockchain stores the trajectory data provided by the operator, and extracts the trajectory data corresponding to the statistical request based on the statistical request.

[0108] In the embodiment of the present application, the statistical request includes the operator name, the predetermined time range, and the predetermined geographical range.

[0109] In an embodiment of the present application, the method further includes:

[0110] A deduplication algorithm based on the same trajectory data is used for deduplication calculation, wherein if the movement trajectories of two mobile terminal numbers belonging to different operators are basically the same, it is considered that the users of the two mobile terminal numbers are the same natural person.

[0111] In the embodiment of the present invention, accurate deduplication statistics can be performed on mobile terminal users across operators, thereby protecting the core assets of operators and user privacy. By utilizing the tamper-proof characteristics of blockchain, important data such as user trajectory data and the desensitization level of statistical departments can be protected. In addition, user statistics with different desensitization levels can be implemented for different types of statistical departments, such as government regulatory departments, commercial advertising agencies, etc.

[0112] Figure 7 is a flow chart of a method for deduplication of mobile terminal users according to a specific embodiment of the present invention.

[0113] Step 1: The statistics department node sends a statistics request to the deduplication calculation node to count the number of mobile users. The statistics request includes conditions such as the statistics department ID, desensitization level, predetermined time range, and predetermined geographical range. According to the multiple conditions included in the statistics request, the number of mobile users within the predetermined time range and the predetermined geographical range is counted.

[0114] Step 2: The deduplication calculation node sends a desensitization level confirmation request to the operator's on-chain node based on the statistical request, requesting the operator's on-chain node to send a confirmed desensitization level.

[0115] Step 3: The operator's on-chain node receives the desensitization level confirmation request and sends the confirmed desensitization level to the deduplication calculation node according to the request.

[0116] If the type of statistical department belongs to the national administrative department, a lower desensitization level may be allowed, and the desensitization level can even be set to 0, that is, the original trajectory data does not need to be desensitized.

[0117] If the statistical department is a commercial organization, enterprise or individual, a higher desensitization level is required, and each operator sends a confirmed desensitization level based on actual conditions.

[0118] For multiple operators, this method will perform the same steps as steps 2 and 3 for each operator, for example: Figure 6 In the example, steps 2 and 3 are performed for operator A, and steps 2' and 3' are performed for operator B. Figure 6 Not shown, if there are other operators, corresponding steps may also be performed for the other operators.

[0119] Step 4: The deduplication calculation node receives the confirmed desensitization level from the operator's on-chain node and determines the desensitization level for calculation.

[0120] In the present invention, step 4 does not limit the algorithm. For example, according to the desensitization levels respectively confirmed by operator A and operator B, the highest level (with the most stringent desensitization requirements) is selected as the desensitization level for calculation. Of course, the corresponding desensitization level can also be selected as the desensitization level for calculation according to actual needs.

[0121] Step 5: The deduplication calculation node sends a request to the operator's on-chain node, requesting a decryption key corresponding to the desensitization level used for calculation.

[0122] Step 6: The operator's on-chain node sends a decryption key corresponding to the desensitization level used for calculation to the deduplication statistics node.

[0123] For multiple operators, this method will perform the same steps as step 5 and step 6 for each operator, for example: Figure 6 In the example, steps 5 and 6 are performed for operator A, and steps 5' and 6' are performed for operator B. Figure 6 Not shown, if there are other operators, corresponding steps may also be performed for the other operators.

[0124] Step 7, the deduplication calculation node extracts the corresponding trajectory data from the blockchain according to the statistical request, and decrypts the trajectory data using the decryption key corresponding to the calculation desensitization level to obtain the decrypted trajectory data. The corresponding trajectory data includes the trajectory data of each operator corresponding to the conditions of the statistical request, for example, the trajectory data within the predetermined time range (from 0:00 on December 1, 2020 to 0:00 on December 12, 2020) and the predetermined regional range (China).

[0125] For multiple operators, this method will perform the same steps as step 7 for each operator, for example Figure 6 In the example, step 7 is performed for operator A and step 7' is performed for operator B. Figure 6 Not shown, if there are other operators, corresponding steps may also be performed for the other operators.

[0126] Step 8: The deduplication calculation node performs user deduplication calculation based on the decrypted trajectory data to obtain statistical results.

[0127] In step 8, the algorithm used for user deduplication calculation can adopt a deduplication algorithm based on the same trajectory data. Specifically, if the movement trajectories of two mobile terminal numbers belonging to different operators are basically the same, for example, the two mobile terminal numbers stay in the same location for multiple times in the same time period, and the number of times exceeds a predetermined threshold, then it is considered that the users of the two mobile terminal numbers are the same natural person.

[0128] When judging whether two mobile terminal numbers belonging to different operators reside in the same location, since the locations of base stations of different operators cannot completely overlap, according to an embodiment of the present invention, when the longitude and latitude of the locations of the two mobile terminal numbers are not completely equal, the judgment is performed using the following predetermined algorithm.

[0129] The predetermined algorithm may include the following algorithms. Of course, the present invention may also use other related algorithms.

[0130] Algorithm 1: The distance between the resident locations of the two mobile terminal numbers is less than a predetermined threshold, which can be set according to the layout of the operator's base stations. For example, for the base station layout in a dense urban area, the predetermined threshold can be set to 300 meters.

[0131] Algorithm 2: The distance between the resident locations of the two mobile terminal numbers is less than a predetermined multiple of the geographic coordinate scale corresponding to the desensitization level.

[0132] For example, when the predetermined multiple is 2, the side length of the square of the geographic coordinate scale when the desensitization level is 0 is set to 1, and the side length of the square of the geographic coordinate scale when the desensitization level is 1 is 2, and so on, the side length of the square of the geographic coordinate scale when the desensitization level is 2 is 4. Of course, the predetermined multiple can be set according to the layout of the operator's base station.

[0133] Algorithm 3: At a predetermined desensitization level, the resident locations of the two mobile terminal numbers overlap in a grid of the same geographic coordinate scale.

[0134] In step 8, considering the situation that a natural user has multiple mobile terminal numbers of multiple operators at the same time, any mobile terminal number X can be taken from operator A, and the trajectory data of the mobile terminal number X is used as a reference benchmark to analyze multiple mobile terminal numbers Y, Z, ..., N in operator B. If the trajectory of the mobile terminal number X is the same as the trajectory of the multiple mobile terminal numbers Y, Z, ..., N in operator B, it is confirmed that the mobile terminal number X belongs to the same natural person user as the multiple mobile terminal numbers Y, Z, ..., N in operator B, and these mobile terminal numbers are counted as the same natural person user during the deduplication calculation.

[0135] Step 9: The deduplication calculation node feeds back the statistical results to the statistical department node, wherein the statistical results have been deduplicated for users across operators.

[0136] The embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the above-mentioned user deduplication method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0137] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0138] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0139] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation modes, which are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are within the protection of the present invention.

Claims

1. A user deduplication method, characterized in that: The method comprises: Send a statistics request to count the number of users; According to the statistical request, a desensitization level confirmation request is issued, requesting to send the confirmed desensitization level; According to the redistribution level confirmation request, the confirmed redistribution level is sent; Determine the calculation desensitization level according to the confirmed desensitization level, and extract the trajectory data from the blockchain to perform duplicate calculation according to the calculation desensitization level to obtain the number of users; The method of extracting the trajectory data from the blockchain according to the calculation of the desensitization level and performing duplicate elimination calculation to obtain the number of users includes: Send a request to the operator's on-chain node, requesting the decryption key corresponding to the calculation desensitization level, and obtain the decryption key corresponding to the calculation desensitization level from the operator's on-chain node; Obtain hierarchically encrypted trajectory data from the blockchain; Decrypting the hierarchically encrypted trajectory data using a decryption key corresponding to the calculation desensitization level to obtain decrypted trajectory data; The decrypted trajectory data is deduplicated to obtain the number of users.

2. The method according to claim 1, characterized in that: Before the step of issuing a statistical request, the method further includes: The user's original trajectory data is obtained from the operator's big data platform, and the original trajectory data is subjected to multi-level desensitization processing to obtain the desensitized trajectory data, which is then uploaded to the blockchain.

3. The method according to claim 2, characterized in that The method further comprises: The trajectory data after multi-level desensitization is subjected to hierarchical encryption to obtain hierarchical encrypted trajectory data, and the hierarchical encrypted trajectory data is uploaded to the blockchain.

4. The method according to claim 3, characterized in that: The trajectory data after multi-level desensitization processing includes at least trajectory data after first-level desensitization processing and trajectory data after second-level desensitization processing. The trajectory data after the first-level desensitization processing is encrypted using a first encryption key, and the trajectory data after the second-level desensitization processing is encrypted using a second encryption key.

5. The method according to claim 3 or 4, characterized in that: The method further comprises: Decryption keys corresponding to the hierarchically encrypted trajectory data are stored and provided, wherein the decryption keys include a first decryption key corresponding to the first encryption key and a second decryption key corresponding to the second encryption key.

6. The method according to claim 1, characterized in that The blockchain stores the trajectory data provided by the operator and, based on the statistical request, extracts the trajectory data corresponding to the statistical request.

7. The method according to claim 1 or 6, characterized in that: The statistics request includes the operator name, the scheduled time range, and the scheduled geographical range.

8. The method according to claim 1, characterized in that: The method further comprises: A deduplication algorithm based on the same trajectory data is used for deduplication calculation, wherein if the movement trajectories of two mobile terminal numbers belonging to different operators are basically the same, it is considered that the users of the two mobile terminal numbers are the same natural person.

9. A user duplicate elimination system, characterized in that: The system includes a statistical department node, a deduplication calculation node, an operator on-chain node and a blockchain, wherein: The statistics department node is used to send a statistics request to the deduplication calculation node to request the number of users; The deduplication calculation node is used to send a desensitization level confirmation request to the operator's on-chain node according to the statistical request, requesting the operator's on-chain node to send the confirmed desensitization level; The operator's on-chain node is used to send the confirmed desensitization level to the deduplication calculation node according to the desensitization level confirmation request; The deduplication calculation node is used to determine the calculation desensitization level according to the confirmed desensitization level, and extract the trajectory data from the blockchain according to the calculation desensitization level to perform deduplication calculation, obtain the number of users, and send the number of mobile users to the statistics department node; The deduplication calculation node includes an interaction module, an acquisition module, a decryption module and a calculation module, wherein: An interaction module, used to send a request to the operator's on-chain node, requesting a decryption key corresponding to the calculation desensitization level, and obtaining the decryption key corresponding to the calculation desensitization level from the operator's on-chain node; The acquisition module obtains the hierarchically encrypted trajectory data from the blockchain; A decryption module, which uses a decryption key corresponding to the calculation desensitization level to decrypt the hierarchically encrypted trajectory data to obtain decrypted trajectory data; The calculation module performs duplicate elimination calculation on the decrypted trajectory data to obtain the number of users.

10. The system according to claim 9, characterized in that The operator's on-chain node includes a desensitization module and a transmission module, among which: The desensitization module is used to obtain the original trajectory data of the user from the operator's big data platform, perform multi-level desensitization processing on the original trajectory data, and obtain the desensitized trajectory data; The transmission module is used to upload the desensitized trajectory data to the blockchain.

11. The system according to claim 10, characterized in that The operator's on-chain node includes an encryption module, where: An encryption module, used for performing hierarchical encryption processing on the trajectory data after the multi-level desensitization processing to obtain hierarchical encrypted trajectory data; The transmission module is used to upload the hierarchically encrypted trajectory data to the blockchain.

12. The system according to claim 11, characterized in that The trajectory data after multi-level desensitization processing includes at least trajectory data after first-level desensitization processing and trajectory data after second-level desensitization processing. The encryption module uses a first encryption key to encrypt the trajectory data after the first-level desensitization processing, and the encryption module uses a second encryption key to encrypt the trajectory data after the second-level desensitization processing.

13. The system according to claim 11 or 12, characterized in that The operator's on-chain node includes a key management module, where: The key management module is used to store and provide decryption keys corresponding to the hierarchically encrypted trajectory data, wherein the decryption keys include a first decryption key corresponding to the first encryption key and a second decryption key corresponding to the second encryption key.

14. The system according to claim 10, characterized in that The blockchain includes a storage module and an extraction module, wherein: A storage module, used to store the trajectory data provided by the operator; The extraction module is used to extract the trajectory data corresponding to the statistical request according to the statistical request.

15. The system according to claim 9 or 14, characterized in that The statistics request includes the operator name, the scheduled time range, and the scheduled geographical range.

16. The system according to claim 9, characterized in that The deduplication calculation node uses a deduplication algorithm based on the same trajectory data to perform deduplication calculation, wherein if the movement trajectories of two mobile terminal numbers belonging to different operators are basically the same, it is considered that the users of the two mobile terminal numbers are the same natural person.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the user deduplication method according to any one of claims 1 to 8 are implemented.

Images