A network measurement data collection method and system
By collaborating with task publishers and platforms, and leveraging worker credibility and data perturbation handling, the issues of permissions and privacy in network measurement data collection were resolved, ensuring data accuracy and security.
Patent Information
- Application Number
- CN202111088794.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-16
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2041-09-16
AI Technical Summary
The collection of network measurement data faces issues of access control and the risk of privacy breaches, impacting internet optimization and security.
Task information is posted by task publishers. The platform recruits target workers based on task information and worker credibility. Target workers collect and perturb network measurement data. The platform then aggregates the data and sends it to the task publishers to ensure data accuracy and privacy.
It enables the effective collection of network measurement data, ensuring data accuracy and security, and avoiding data leakage issues.
Smart Images

Figure CN114021769B_ABST
Abstract
Description
Technical Field
[0001] One or more embodiments of the present specification relate to the field of network technology, and in particular, to a method and system for collecting network measurement data. Background Art
[0002] The Internet has become widely popular, and people have higher and higher requirements for the overall quality of network services. In order to build and maintain a robust, reliable, and stable Internet, network managers and researchers need to collaborate to discover and solve problems. The basis of research is to collect network measurement data. Some network measurement data is difficult to obtain because it requires authorization, and some network measurement data contains private data and has the risk of leakage, affecting network security. Therefore, the effective collection of network measurement data has become a limiting factor affecting Internet optimization. Summary of the invention
[0003] In view of this, an object of one or more embodiments of this specification is to provide a network measurement data collection method and system to solve the problem of collecting network measurement data.
[0004] Based on the above purpose, one or more embodiments of this specification provide a network measurement data collection method, including:
[0005] The task publisher publishes task information to the platform; wherein the task information includes task content, task quotation and deviation threshold;
[0006] The platform publishes task contents to workers according to the task information, and receives the task contents and task quotations from workers, so as to recruit target workers according to the task information, task contents and task quotations, calculate the privacy budget parameters of the target workers, and send the privacy budget parameters to the target workers;
[0007] The target worker collects network measurement data, performs perturbation processing on the network measurement data according to the privacy budget parameter, and then sends the perturbation processed network measurement data to the platform, so that the platform sends the perturbation processed network measurement data to the task publisher.
[0008] Optionally, before the task publisher publishes the task information to the platform, the following steps may also be performed:
[0009] The task publisher determines the task quotation and the deviation threshold with the goal of maximizing the utility function.
[0010] Optionally, the platform recruits target workers according to the task information, task content and task quotation, including:
[0011] The platform obtains the reputation of workers from the blockchain;
[0012] Recruiting target workers with the goal of maximizing profits based on the task information, task content, task quotation and worker credibility;
[0013] The privacy budget parameter of the target worker is calculated by calculating the privacy budget parameter according to the reputation of the target worker.
[0014] Optionally, recruiting target workers with the goal of maximizing profit is as follows: using a genetic algorithm to maximize profit and select target workers from all workers.
[0015] Optionally, the execution task quotation includes a fixed cost and a privacy cost; wherein the privacy cost is the cost of privacy data leaked in the collected network measurement data.
[0016] Optionally, the method further includes:
[0017] After the target worker performs the task, the platform performs a reputation evaluation on the target worker so as to update the reputation of the target worker according to the reputation evaluation.
[0018] Optionally, the credibility includes a direct evaluation of the target worker by a platform and an indirect evaluation of the target worker by other platforms.
[0019] Optionally, the target worker performs perturbation processing on the network measurement data according to the privacy budget parameter as follows:
[0020] Adding random noise to the network measurement data; wherein the random noise is determined according to a Laplace distribution parameter and a weight of a target worker, and the weight is determined according to a matching degree between the task content and the execution task content and the credibility of the target worker.
[0021] Optionally, the platform sending the disturbance-processed network measurement data to the task publisher includes:
[0022] The platform aggregates the disturbance-processed network measurement data and sends the aggregated network measurement data to the task publisher.
[0023] The embodiment of this specification also provides a network measurement data collection system, including:
[0024] The task publisher is used to publish task information to the platform; wherein the task information includes task content, task quotation and deviation threshold;
[0025] The platform is used to publish task content to workers according to the task information, and receive the workers' task content and task quotation, so as to recruit target workers according to the task information, task content and task quotation, calculate the privacy budget parameters of the target workers, and send the privacy budget parameters to the target workers;
[0026] The target worker is used to collect network measurement data, and after perturbation processing on the network measurement data according to the privacy budget parameter, send the perturbed network measurement data to the platform, so that the platform sends the perturbed network measurement data to the task publisher.
[0027] From the above description, it can be seen that in one or more embodiments of this specification, the network measurement data collection method and system provided by the task publisher publishes task information to the platform; the platform publishes the task content to the workers according to the task information, and receives the workers' execution task content and execution task quotation, so as to recruit target workers, calculate the privacy budget parameters of the target workers, and send the privacy budget parameters to the target workers; the target workers collect network measurement data, and after perturbation processing of the network measurement data according to the privacy budget parameters, send the perturbed network measurement data to the platform, and the platform sends the perturbed network measurement data to the task publisher. This specification can effectively collect network measurement data and ensure the accuracy and security of the collected network measurement data. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] In order to more clearly illustrate one or more embodiments of the present specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only one or more embodiments of the present specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0029] Figure 1 A schematic diagram of a method flow of one or more embodiments of this specification;
[0030] Figure 2 A schematic diagram of the system architecture of one or more embodiments of this specification;
[0031] Figure 3 A schematic diagram of data flow for one or more embodiments of this specification;
[0032] Figure 4 A schematic diagram of the structure of an electronic device according to one or more embodiments of the present specification. DETAILED DESCRIPTION
[0033] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.
[0034] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of this specification should be understood by people with ordinary skills in the field to which this disclosure belongs. The "first", "second" and similar words used in one or more embodiments of this specification do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0035] As described in the background technology section, network measurement data is difficult to obtain due to lack of network administrator privileges, or the available network measurement data contains private data (such as personal information, host information, network topology, etc.), which poses a security risk of data leakage.
[0036] Combination Figure 2 As shown in the figure, in some scenarios, task publishers can use blockchain technology to publish tasks to collect network measurement data to the platform. The platform recruits workers based on the tasks. After the workers complete the tasks, they transmit the collected network measurement data to the task publisher through the platform. However, the network measurement data collected by the workers can easily be analyzed for privacy data, and the recruitment of workers generally does not consider the workers' credibility, which affects the accuracy of the task results.
[0037] In view of this, the embodiment of this specification provides a network measurement data collection method, the task publisher determines the task information with the goal of maximizing the utility function, the platform recruits target workers based on the task information with the goal of maximizing profits combined with the workers' credibility, the target workers collect network measurement data and perform disturbance processing on the network measurement data, and the platform aggregates the disturbance-processed network measurement data of all target workers and transmits the task results to the task publisher. As a result, the network measurement data collected by the task publisher can not only ensure accuracy but also have privacy, avoiding data leakage problems.
[0038] like Figure 1-3 As shown, one or more embodiments of this specification provide a network measurement data collection method, including:
[0039] S101: The task publisher publishes task information to the platform; wherein the task information includes task content, task quotation and deviation threshold;
[0040] In this embodiment, the task publisher publishes task information for collecting network measurement data to the platform. The task information includes task content, task quotation and deviation threshold. Among them, the task content refers to the relevant information of the network measurement data to be collected, such as data type, data attribute, etc., the task quotation refers to the remuneration paid for collecting network measurement data, and the deviation threshold refers to the degree of distortion of network measurement data under the goal of maximizing the utility function.
[0041] S102: The platform publishes the task content to the workers according to the received task information, and receives the task content and task quotation from the workers, so as to recruit target workers according to the task information, task content and task quotation, calculate the privacy budget parameters of the target workers, and send the privacy budget parameters to the target workers;
[0042] In this embodiment, the platform receives the task information issued by the task publisher and issues the task content to the workers. After receiving the task content, the workers send the execution task content and the execution task quotation that they can complete to the platform. The platform matches the task content and the execution task content, determines the workers who can complete the task content, and calculates the profit that the platform can obtain based on the task quotation and the execution task quotation, and recruits target workers who can obtain a certain profit from the workers who can complete the task content. After determining the target worker to be recruited, the privacy budget parameters of the target worker are calculated and sent to the target worker. The target worker then collects network measurement data and performs perturbation processing on the network measurement data based on the privacy budget parameters to enhance the privacy of the network measurement data.
[0043] In some methods, the content of the worker's execution task refers to the relevant information of the network measurement data that can be collected, such as data type, data attribute, etc. The execution task quotation refers to the cost required to collect network measurement data, which includes fixed cost and privacy cost. The fixed cost includes the time cost required for data collection and data processing, and the resource cost required for hardware loss, resource occupation, etc. The privacy cost is the price of the private data leaked in the collected network measurement data, and the privacy cost is proportional to the amount of private data leaked.
[0044] S103: The target worker collects network measurement data, performs perturbation processing on the network measurement data according to the privacy budget parameter, and sends the perturbation processing network measurement data to the platform, so that the platform sends the perturbation processing network measurement data to the task publisher.
[0045] In this embodiment, after the platform recruits the target workers, the target workers collect network measurement data. Based on the collected network measurement data, the network measurement data is analyzed and mined according to the task content to obtain network measurement data matching the task content. Then, the matching network measurement data is perturbed using the privacy budget parameter to obtain network measurement data with a certain degree of privacy. The perturbed network measurement data is not easy to analyze to obtain privacy data. Finally, the perturbed network measurement data is sent to the platform, which uniformly processes the network measurement data collected by each target worker and transmits it to the task publisher, thereby completing the task of collecting network measurement data.
[0046] The network measurement data collection method provided in this embodiment includes a task publisher publishing task information to a platform; the platform publishes task content to workers based on the received task information, and receives the workers' task content and task quotation, so as to recruit target workers based on the task information, task content and task quotation, calculate the privacy budget parameters of the target workers, and send the privacy budget parameters to the target workers; the target workers collect network measurement data, and after perturbation processing of the network measurement data based on the privacy budget parameters, send the perturbed network measurement data to the platform, so that the platform sends the perturbed network measurement data to the task publisher. In the method of this embodiment, the task publisher publishes task information with task requirements, and the workers collect network measurement data that meets the task requirements. The network measurement data finally collected has privacy and can ensure accuracy.
[0047] In some embodiments, the task publisher determines the task price and deviation threshold with the goal of maximizing the utility function, and determines the task information with task requirements.
[0048] Specifically, through analysis, the task publisher wants to collect accurate network measurement data. The more accurate the data, the higher the satisfaction of the task publisher, and at the same time, the higher the reward required. Define the utility function to measure the balance between the benefits obtained and the costs paid. The utility function is expressed as:
[0049] U(t j )=S(t j )-C(t j ) (1)
[0050] Among them, S(t j ) represents the task publisher t j The satisfaction function, C(t j ) represents the task publisher t j The cost function of .
[0051]
[0052] in, For the task publisher t j The maximum tolerable distortion of network measurement data, θ j is the degree of distortion of network measurement data. The greater the distortion, the lower the satisfaction. j is the weight, which is determined by the task publisher t j The characteristics of are used to adjust the influence of satisfaction function and cost function on accuracy.
[0053]
[0054] Among them, β j represents a fixed parameter, which is related to the cost tolerance of the task publisher and has a value range of (0, 1). j The smaller it is, the higher the cost, that is, the higher the reward you need to pay.
[0055] According to formulas (2) and (3), the comprehensive expression of the utility function can be obtained:
[0056]
[0057]
[0058] The utility function U(t j ) for the degree of distortion θ j Find the first-order derivative and the second-order derivative and we get:
[0059]
[0060]
[0061] because The second-order derivative is less than zero for a convex function. The utility function U(t j ) has an optimal solution.
[0062] Among them, the maximum utility function U(t j ), which also minimizes (-U(t j ), then the objective function for determining the optimal solution is:
[0063]
[0064] The above objective function has a unique optimal solution under the KKT solution condition. Relaxing the constraints yields the Lagrangian function:
[0065]
[0066] The optimal solution satisfies the following conditions:
[0067]
[0068] In this way, the task publisher can determine the optimal degree of distortion by calculating the optimal solution of the utility function. and the corresponding costs Task Quote and deviation threshold
[0069] In some embodiments, the platform recruits target workers based on task information, task content, and task quotation, including:
[0070] The platform obtains workers’ reputation from the blockchain;
[0071] Recruit target workers with the goal of maximizing profits based on task information, task content, task quotation, and worker credibility;
[0072] The privacy budget parameters of the target worker are calculated as follows: According to the reputation of the target worker, the privacy budget parameters are calculated.
[0073] In this embodiment, in order to recruit suitable workers, the platform obtains the reputation of all workers recorded in the blockchain on the one hand. The higher the reputation, the better the credibility of the worker, and the higher the accuracy of the collected network measurement data. The platform can select workers with higher reputation to ensure the quality of the collected data; secondly, according to the published task content and the execution task content that the worker can execute, select workers who can complete the task content; thirdly, according to the published task quotation and the execution task quotation proposed by the worker to execute the task, select workers who can make the platform profitable. In summary, the platform needs to recruit suitable target workers from all workers based on the worker's reputation, the matching degree of the task content, and the cost and profit factors, and after selecting the target worker, calculate the target worker's privacy budget parameter according to the target worker's reputation, so that the target worker can perform perturbation processing on the collected network measurement data according to the privacy budget parameter.
[0074] Specifically, the task publisher publishes task information to the platform, which includes task content γ j , Deviation Threshold And task quotation After receiving the task information, the platform first jAnalyze and determine the data attributes of the network measurement data to be collected and the calculated labels (for example, if the task content is to determine whether it will rain tomorrow, the label 1 can indicate that it will rain, and the label 0 can indicate that it will not rain), and publish the task content including data attributes and labels to the workers. After receiving the task content, the workers send the data attributes of the network measurement data they can collect and the quotation for executing the task to the platform. The platform recruits target workers with the goal of maximizing profits based on the task information published by the task publisher and the content and quotation for executing the task published by the workers.
[0075] The worker's quotation for executing the task is:
[0076] In(w i )=hc i,j +pc i,j (10)
[0077] Among them, hc i,j Represents worker w i Complete the task content γ j Required fixed costs, pc i,j For workers i Complete the task content γ j The required privacy cost is expressed as:
[0078] pc i,j =ω i,j ε i,j (11)
[0079] Among them, ω i,j represents the cost of leaking unit private data, ε i,j The amount of data representing the leaked private data. The more noise is added to the network measurement data, the less private data is leaked and the lower the privacy cost.
[0080] Target worker execution task content γ j Finally, the collected network measurement data is analyzed and mined to obtain network measurement data that matches the task content published by the task publisher; then, noise is added to the matching network measurement data according to the privacy budget parameters to perturb the network measurement data and enhance data privacy; finally, the target worker transmits the perturbed network measurement data to the platform.
[0081] The platform performs unified aggregation processing based on the network measurement data collected by each target worker to obtain the completed task contentγ j The final task result r j , expressed as:
[0082]
[0083] Among them, f(.) is the aggregation function, r i,j For workers i The task results (collected network measurement data), q i,j Indicates the task content γ j , worker w i The normalized weight of the worker w i The credibility of the company is determined; For the task content γ j In the middle, workers i Noise added to the collected network measurement data. i,j is a binary function, x i,j ∈{0,1},x i,j =1 means worker w i To be selected to participate in the task content λ j The target worker, x i,j =0 means worker w i Not selected, W j represents the set of target workers, and W represents the set of workers.
[0084] The degree of distortion of the final task result is defined as:
[0085]
[0086] in, I is the total number of workers.
[0087] For the network measurement data collected by the target workers, based on differential privacy technology, random noise is added for disturbance processing to ensure the security of the privacy data contained in the network measurement data.
[0088] Proposition 1 on differential privacy result aggregation: Task-oriented γ j The aggregate function f j :[0,1] S →R satisfies the privacy budget parameter ε i,j Differential privacy must satisfy that for any pair of adjacent vectors and There is a difference in the result of the ith worker, and any set of aggregated results All satisfy the following inequality:
[0089] Pr[f j (d)∈O]≤exp(ε i,j )Pr[f j (d (i) )∈O] (14)
[0090] Among them, ε i,j is the privacy budget parameter.
[0091] For the aggregate function f j , adding random noise obtained from Laplace distribution to the aggregation function to achieve differential privacy. Since the aggregation function is obtained based on the network measurement data collected by each target worker, each target worker can first add random noise so that the aggregate noise obtained after aggregating the random noise of each target worker obeys the Laplace distribution, thereby achieving differential privacy of the aggregation function, that is, the final task result after platform aggregation processing achieves differential privacy. Among them, the aggregate noise can be expressed as:
[0092]
[0093] Proposition 2 about the privacy budget parameters and distortion degree of workers is given: the binary function x of all workers is known i,j and weight q i,j , in the aggregate function f j For the task content γ j , worker w i The privacy budget parameter is expressed as:
[0094]
[0095] The aggregate distortion level of all workers is expressed as:
[0096]
[0097] Among them, σ j is the Laplace distribution parameter.
[0098] The proof of Proposition 2 is: For the privacy budget parameter of the worker, in the aggregation function f j Next, if the vector d j If any element in changes, the aggregation function f j The impact of the output can be expressed as:
[0099]
[0100] The privacy budget parameters are:
[0101]
[0102] It can be seen that the privacy budget parameters assigned to the target worker are related to the target worker's weight (reputation) and the Laplace distribution parameters.
[0103] Aggregate distortion level for all workers:
[0104]
[0105] Equation transformation (μ) From Proposition 1, we know that is a product with a mean of zero and a variance of 2σ 2 is a Laplace random variable.
[0106] Assume the Laplace distribution parameters are:
[0107]
[0108] Then, worker w i The privacy budget parameter can be simplified as:
[0109]
[0110] The aggregate distortion level of all workers can be simplified to:
[0111]
[0112] Among them, formula (22) can represent the relationship between the selected target worker and the privacy budget parameter of the target worker; formula (23) can represent the relationship between the selected target worker and the aggregation distortion degree of the worker.
[0113] The objective function of maximizing profits established by the platform can be expressed as:
[0114]
[0115] st:
[0116] 1)
[0117] 2)
[0118] 3)
[0119] 4)
[0120] in, J is the number of task publishers, X′ j ={0} represents X′ j is a set of all zeros, and H is the set of task contents. Constraint 1) is used to ensure that the accuracy of the network measurement data obtained by the task publisher is within the deviation threshold; Constraint 2) is used to ensure that when the accuracy of the network measurement data is not within the deviation threshold, no worker will perform this task; Constraint 3) indicates that x i,j is a binary function; constraint 4) is used to ensure that each worker can only participate in one task (considering the time limit for completing the task content, each worker can only perform one task within a specific time interval). i,j is the mapping of constraint 2 to x i,jIf the selected worker meets the threshold of constraint 2, then x′ i,j =x i,j , if the threshold of constraint 2 is not met, then x′ i,j = 0. X is x i,j Zhang Cheng's matrix.
[0121] In some methods, a genetic algorithm is used to maximize profits and select target workers from all workers. Specifically, the platform has an initial population, and the individuals in the population are target workers. According to the objective function shown in formula (24), the profit that can be obtained by selecting the target workers is calculated; the population is subjected to genetic, crossover and mutation operations to generate a new population, and the profit that can be obtained by the target workers selected in the new population is calculated; it is calculated whether the difference between the maximum profit in the initial population and the new population reaches a preset threshold. If so, the target workers selected in the new population are used as the target workers finally selected by the platform.
[0122] After the platform selects the target worker, it calculates the privacy budget parameter ε assigned to the target worker according to formula (16): i,j After that, the platform will set the privacy budget parameter ε i,j , Laplace distribution parameter σ j And the selected parameter x i,j Send it to the target worker, the target worker collects network measurement data, according to the Laplace distribution shown in formula (25) Adding random noise to network measurement data The disturbed network measurement data is obtained and sent to the platform. The platform receives the network measurement data collected by all target workers, aggregates the network measurement data collected by each target worker according to formula (12), obtains the final task result, and sends the final task result to the task publisher, thereby completing the collection of network measurement data.
[0123]
[0124] That is, for the target worker, x i,j = 1, the random noise added to the network measurement data collected by the target worker is determined according to the Laplace distribution parameters and the weight of the target worker.
[0125] In some embodiments, after the target worker completes the task content, the platform performs a reputation evaluation on the target worker so as to update the reputation of the target worker according to the reputation evaluation.
[0126] Specifically, the platform evaluates the target worker’s creditworthiness as follows:
[0127]
[0128] in, For other platforms, target workers w i Indirect evaluation of is the platform’s direct evaluation of the target worker, and υ is the weight, which is used to adjust the influence of direct and indirect evaluations on the reputation evaluation.
[0129] The platform's direct evaluation of the target workers is:
[0130]
[0131] Among them, Ψ is the target worker w i The number of times you have participated in the tasks released by the platform within a period of time, 1≤ψ≤Ψ, θ ψ is the influencing parameter, θ ψ =z Ψ-ψ , z∈(0,1), To evaluate the credibility of the content of the ψth task.
[0132] From the platform's direct evaluation of the target worker shown in formula (27), it can be seen that the direct evaluation is the accumulated reputation over a period of time. The platform will give priority to workers who have recently conducted transactions and have a higher reputation.
[0133] Other platforms indirectly evaluated the target workers as follows:
[0134]
[0135]
[0136] Among them, M v For the target worker w i Execution Platform v The data attributes of the network measurement data collected by the published task content, M k For the target worker w i Execution Platform k Data attributes of network measurement data collected by the published task content, K is the number of platforms. The closer the task content performed by the target worker on different platforms is, the greater the impact of indirect reputation.
[0137] In some ways, in formula (12), worker w i The normalized weight q i,j Based on the matching degree between the published task content and the worker's task content, as well as the worker's credibility, we first calculate:
[0138]
[0139] Then the calculation result of formula (30) is normalized to obtain the weight. Used to calculate worker wi Collectible data attributes and task publishers j The similarity between the attributes of the data that need to be collected can measure the credibility of the worker in completing the task content because the worker's weight is related to the task content.
[0140] The network measurement data collection method provided in the embodiment of this specification is that the task publisher publishes the required network measurement data to the platform as task information, wherein the task publisher determines the task quotation and deviation threshold with the goal of maximizing the utility function. The platform receives the published task information, publishes the task content to the workers, obtains the workers' credibility from the blockchain, and receives the execution task content and execution task quotation of the network measurement data that the workers can collect. The platform recruits target workers with the goal of maximizing profits. The target workers collect network measurement data according to the task requirements, add random noise to the collected network measurement data, and then send the network measurement data with added noise to the platform. The platform aggregates the network measurement data of all target workers, and sends the aggregated network measurement data to the task publisher as the final task result, thereby completing the collection of network measurement data. Using the method of this specification, the accuracy and security of the collected data can be guaranteed.
[0141] It should be noted that the method of one or more embodiments of this specification can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of one or more embodiments of this specification, and the multiple devices will interact with each other to complete the described method.
[0142] It should be noted that the above is a description of a specific embodiment of the present specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0143] Combination Figure 2 As shown, the embodiment of this specification also provides a network measurement data collection system, including:
[0144] Task publisher, used to publish task information to the platform; task information includes task content, task quotation and deviation threshold;
[0145] The platform is used to publish task content to workers based on task information, and receive workers' task content and task quotation, so as to recruit target workers based on task information, task content and task quotation, calculate the privacy budget parameters of target workers, and send the privacy budget parameters to target workers;
[0146] The target worker is used to collect network measurement data, and after perturbation processing on the network measurement data according to the privacy budget parameters, the perturbed network measurement data is sent to the platform, so that the platform sends the perturbed network measurement data to the task publisher.
[0147] For the convenience of description, the above system is described by dividing the functions into various modules. Of course, when implementing one or more embodiments of this specification, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0148] The system of the above embodiment is used to implement the corresponding method in the above embodiment, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0149] Figure 4 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0150] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0151] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0152] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0153] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0154] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0155] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0156] The electronic device of the above embodiment is used to implement the corresponding method in the above embodiment, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0157] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0158] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. In line with the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of different aspects of one or more embodiments of the present specification as described above, which are not provided in detail for the sake of simplicity.
[0159] In addition, to simplify the description and discussion, and in order not to obscure one or more embodiments of the present specification, known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, devices may be shown in the form of block diagrams to avoid obscuring one or more embodiments of the present specification, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which one or more embodiments of the present specification will be implemented (i.e., these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it is apparent to those skilled in the art that one or more embodiments of the present specification may be implemented without these specific details or with variations in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.
[0160] Although the present disclosure has been described in conjunction with specific embodiments of the present disclosure, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0161] One or more embodiments of this specification are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of this specification should be included in the scope of protection of this disclosure.
Claims
1. A network measurement data collection method, characterized in that: include: The task publisher determines the task quotation and deviation threshold with the goal of maximizing the utility function, and publishes the task information to the platform; wherein the task information includes the task content, task quotation and deviation threshold; The platform publishes the task content to the workers according to the task information, and receives the task content and task quotation of the workers, so as to recruit the target workers according to the task information, the task content and the task quotation, calculate the privacy budget parameters of the target workers, and send the privacy budget parameters to the target workers, including: the platform obtains the reputation of the workers from the blockchain; recruits the target workers according to the task information, the task content, the task quotation and the reputation of the workers with the goal of maximizing profits; calculates the privacy budget parameters according to the reputation of the target workers; The target worker collects network measurement data, performs perturbation processing on the network measurement data according to the privacy budget parameter, and sends the perturbation processed network measurement data to the platform, so that the platform sends the perturbation processed network measurement data to the task publisher; Wherein, the utility function is: In the formula, U(t j ) is the task publisher t j The utility function of For the task publisher t j The maximum tolerable distortion of network measurement data, θ j is the degree of distortion of network measurement data, α j is the weight, β j It is a fixed parameter with a value range of (0, 1).
2. The method according to claim 1, characterized in that Recruiting target workers with the goal of maximizing profits is: using genetic algorithms to maximize profits and select target workers from all workers.
3. The method according to claim 1, characterized in that The task execution quotation includes a fixed cost and a privacy cost; wherein the privacy cost is the price of the private data leaked in the collected network measurement data.
4. The method according to claim 1, characterized in that: Also includes: After the target worker performs the task, the platform performs a reputation evaluation on the target worker so as to update the reputation of the target worker according to the reputation evaluation.
5. The method according to claim 4, characterized in that The reputation includes the platform's direct evaluation of the target worker and other platforms' indirect evaluation of the target worker.
6. The method according to claim 1, characterized in that The target worker performs perturbation processing on the network measurement data according to the privacy budget parameter as follows: Adding random noise to the network measurement data; wherein the random noise is determined according to a Laplace distribution parameter and a weight of a target worker, and the weight is determined according to a matching degree between the task content and the execution task content and the credibility of the target worker.
7. The method according to claim 1, characterized in that The platform sends the disturbance-processed network measurement data to the task publisher, including: The platform aggregates the disturbance-processed network measurement data and sends the aggregated network measurement data to the task publisher.
8. A network measurement data collection system, characterized in that: include: The task publisher is used to determine the task quotation and deviation threshold with the goal of maximizing the utility function, and publish the task information to the platform; wherein the task information includes the task content, task quotation and deviation threshold; The platform is used to publish task content to workers according to the task information, and receive the task content and task quotation of the workers, so as to recruit target workers according to the task information, task content and task quotation, calculate the privacy budget parameter of the target worker, and send the privacy budget parameter to the target worker, including: the platform obtains the reputation of the worker from the blockchain; recruits the target worker with the goal of maximizing profit according to the task information, task content, task quotation and worker reputation; and calculates the privacy budget parameter according to the reputation of the target worker; The target worker is used to collect network measurement data, and after perturbation processing on the network measurement data according to the privacy budget parameter, send the perturbation processed network measurement data to the platform, so that the platform sends the perturbation processed network measurement data to the task publisher; Wherein, the utility function is: In the formula, U(t j ) is the task publisher t j The utility function of For the task publisher t j The maximum tolerable distortion of network measurement data, θ j is the degree of distortion of network measurement data, α j is the weight, β j It is a fixed parameter with a value range of (0, 1).
