Reward distribution method and device for public test competition, electronic equipment and storage medium

Abstract

The invention provides a public test competition reward distribution method and device, electronic equipment and a storage medium. The method comprises the following steps: receiving registration information of a plurality of users; extracting and analyzing the registration information to obtain a capability value of a user corresponding to the registration information; classifying the capability values of the plurality of users to obtain a plurality of classes and a user corresponding to each class; and determining a reward allocation scheme based on the users of each grade and the capability values corresponding to the users of each grade, thereby solving the technical problem of unreasonable reward allocation of the public test competition in the prior art, and achieving the purpose of promoting the users to select test items matched with the own capabilities.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a reward distribution method, device, electronic device and storage medium for a crowd-testing competition. Background Art

[0002] Network security crowd testing is a model based on crowdsourcing. Through rewarding and posting notices, targeted requirements, etc., it encourages security testers to participate in testing projects and discover vulnerabilities in information technology products. Network security crowd testing business involves three parties: project parties, testers, and crowd testing platforms. Project parties submit project requirements on the crowd testing platform, and the crowd testing platform publishes crowd testing projects to attract testers to participate. Testers participate in the project and provide feedback. The crowd testing platform reviews and pays rewards.

[0003] In addition to regular crowd-testing projects, project owners will also hold competitions on the crowd-testing platform, requiring testers to complete the test within a specified time and receive corresponding honors and rewards based on the test results. However, judging from the current crowd-testing competition results, the reward setting for crowd-testing competitions has the following problems: insufficient incentives, and high-level testers are unwilling to participate in more difficult test projects. The existence of the above problems has led to unreasonable reward settings for crowd-testing competitions. Summary of the invention

[0004] In view of this, the purpose of this application is to propose a reward distribution method, device, electronic device and storage medium for a crowd-testing competition to overcome all or part of the deficiencies in the prior art.

[0005] Based on the above purpose, the present application provides a reward distribution method for a crowd-testing competition, including: receiving registration information of multiple users; refining and analyzing the registration information to obtain ability values ​​of users corresponding to the registration information; classifying the ability values ​​of the multiple users to obtain multiple categories and users corresponding to each category; determining a reward distribution plan based on the users in each category and the ability values ​​corresponding to the users in each category.

[0006] Optionally, the reward distribution scheme includes a single reward distribution scheme or a multiple reward distribution scheme, and the reward distribution scheme is determined based on the users in each category and the capability values ​​corresponding to the users in each category, including: in response to determining that the number of users corresponding to one of the categories is less than or equal to a predetermined number, based on the capability values ​​corresponding to the users in each category, determining the single reward distribution scheme; in response to determining that the number of users corresponding to all categories is greater than the predetermined number, based on the capability values ​​corresponding to the users in each category, determining the multiple reward distribution schemes.

[0007] Optionally, the single reward allocation plan is determined based on the ability values ​​corresponding to the users in each category, including: based on the ability values ​​corresponding to the users in each category, constructing a first objective function with the goal of maximizing the first revenue-labor ratio of the organizer of the crowd-testing competition, and constructing a first constraint condition corresponding to the first objective function; based on the first constraint condition, solving the first objective function to obtain the single reward allocation plan.

[0008] Optionally, the multi-reward allocation plan is determined based on the ability values ​​corresponding to each category of users, including: based on the ability values ​​corresponding to each category of users, a second objective function is constructed with the goal of maximizing the second revenue-labor ratio of the organizer of the crowd-testing competition, and a second constraint condition corresponding to the second objective function; based on the second constraint condition, the second objective function is solved to obtain the multi-reward allocation plan.

[0009] Optionally, the method comprises: determining the first objective function by the following formula: ,in, For the first labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer.

[0010] Optionally, the method further includes: determining the first constraint condition by using the following formula: ,in, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, .

[0011] Optionally, the method comprises: determining the second objective function by the following formula: ,in, For the second labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category Reward for the name, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer.

[0012] Optionally, the method further includes: determining the second constraint condition by the following formula: ,in, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, .

[0013] Based on the same inventive concept, the present application also provides a reward distribution device for a crowd-testing competition, including: a receiving module, configured to receive registration information of multiple users; an analysis module, configured to refine and analyze the registration information to obtain the ability value of the user corresponding to the registration information; a classification module, configured to classify the ability values ​​of the multiple users to obtain multiple categories and users corresponding to each category; a determination module, configured to determine a reward distribution plan based on the users in each category and the ability values ​​corresponding to the users in each category.

[0014] Based on the same inventive concept, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein the processor implements the method as described above when executing the computer program.

[0015] From the above, it can be seen that the reward distribution method, device, electronic device and storage medium for the crowd-testing competition provided by the present application include receiving registration information of multiple users. The registration information is refined and analyzed to obtain the ability value of the user corresponding to the registration information, and the user's ability is quantified to achieve the purpose of accurately determining the user's ability value. The ability values ​​of the multiple users are classified to obtain multiple categories and users corresponding to each category, so as to achieve the purpose of accurately archiving users. Based on the users in each category and the ability values ​​corresponding to the users in each category, a reward distribution plan is determined to make the reward distribution plan reasonable. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 A flowchart of a method for distributing rewards for a crowd-testing competition according to an embodiment of the present application; Figure 2 A flowchart of a method for distributing rewards for a crowd-testing competition according to another embodiment of the present application; Figure 3 A schematic diagram of the structure of a reward distribution device for a crowd-testing competition according to an embodiment of the present application; Figure 4 This is a schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the objectives, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0019] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be the usual meanings understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0020] As mentioned in the background technology section, network security crowd testing is a model based on crowdsourcing. Through rewarding and posting, targeted requirements, etc., it encourages security testers to participate in testing projects and discover vulnerabilities in information technology products. Network security crowd testing has the characteristics of collaboration and sharing, and can efficiently integrate testing requirements with testing talent resources, providing strong support for security testing of open source components, security software and hardware, WEB systems, mobile applications, etc. The network security crowd testing platform (hereinafter referred to as the crowd testing platform) has gathered a large number of security professionals through the Internet, realizing flexible task release, fast result feedback and excellent testing results. Relying on the crowd testing platform, the network security crowd testing industry has developed rapidly.

[0021] The network security crowd testing business involves three parties: project owners, testers, and crowd testing platforms. Project owners submit project requirements on the crowd testing platform, and the crowd testing platform publishes crowd testing projects to attract testers to participate. Testers participate in the project and provide feedback. The crowd testing platform reviews and pays rewards. At the same time, the crowd testing platform is also responsible for platform operations and test process audits. In addition to regular crowd testing projects, project owners will also hold competition projects on the crowd testing platform, namely crowd testing competitions. Crowd testing competitions include multiple test projects, requiring testers to complete the test within a specified time, and receive corresponding honors and rewards according to the ranking of test results. However, judging from the current crowd testing competition results, the reward setting of crowd testing competitions has the following problems: insufficient reward incentives, and high-level testers are unwilling to participate in more difficult test projects. In addition, there is also the problem of knowing little about the testers' testing capabilities and areas of expertise, and being unable to recommend suitable projects to participate in the competition. At present, the work on the above situation mainly focuses on the research work on project indicators, incentive factors, etc. of crowd testing projects, and lacks technical research work on the competition system of crowd testing competitions, resulting in unreasonable reward setting for crowd testing competitions.

[0022] In view of this, the present application embodiment proposes a reward distribution method for a crowd testing competition, referring to Figure 1 , including the following steps: Step 101, receiving registration information of multiple users.

[0023] In this step, the organizer publishes the network security crowd testing competition on the crowd testing platform, and the total reward for the crowd testing competition is predetermined. The crowd testing competition includes multiple test items. The activity stipulates that each user is only allowed to sign up for one test item. The crowd testing platform will then rank and award rewards based on the test scores of the testers. The network security crowd testing platform attracts users to sign up through targeted invitations or public calls. Users first pre-register. When registering, they need to fill in the registration form, which reflects the user's registration information. Through pre-registration, the purpose of surveying the user's capabilities can be achieved later. Receive the registration information of multiple users. For example, the registration information includes personnel information, technical expertise, and historical competition results.

[0024] Step 102: extract and analyze the registration information to obtain the capability value of the user corresponding to the registration information.

[0025] In this step, the users who participate in the registration have different abilities, and because the test items in the crowd-testing competition have different difficulties, it is beneficial for both the organizer and the user to register for the test items that match their abilities. The registration form of each user is refined and analyzed to determine the ability value corresponding to the registration form information. For example, when the user's registration information includes proficient technology and historical competition results, the proficient technology and historical competition results are weighted and analyzed to obtain the ability value of the user, wherein the greater the difficulty of the proficient technology, the greater the weight; the better the historical competition results, and the greater the difficulty of the historical competition corresponding to the historical competition results, the greater the weight of the historical competition results. When the user is proficient in more technologies, the greater the difficulty, and the user achieves relatively good results in relatively difficult historical competitions, it means that the user's ability is relatively strong, that is, the user's ability value is relatively large, and the ability value is used to characterize the user's ability score value for handling competition events. Through the refinement and analysis of the registration information, the user's ability is digitized to achieve the purpose of accurately determining the user's ability value.

[0026] Step 103: classify the capability values ​​of the plurality of users to obtain a plurality of categories and users corresponding to each category.

[0027] In this step, the user's ability value is classified to obtain multiple categories, so that users with similar abilities are classified into the same category. It should be noted that there are multiple test items in the crowd-testing competition, and since users are only allowed to sign up for one test item in the crowd-testing competition, all users can be classified according to the number of test items based on the ability value of each user, that is, the number of all categories is the same as the number of test items. It should be noted that the above classification method can be clustering. Since the test items have different difficulties, it is also necessary to divide users into different categories based on the ability value of each user. The category is related to the difficulty of the test item, and the ability value of the user corresponding to the category has a positive correlation with the difficulty of the test item, wherein the difficulty of the test item can be set by the user. The difficulty of the test items is arranged from small to large in sequence. The larger the sequence number, the greater the difficulty of the corresponding test item, and then the corresponding user's ability value is greater. Exemplarily, the difficulty of the test items is arranged from small to large in sequence, and the first-tier test items are the easiest. Each test item is set with a corresponding reward, and the reward increases with the increase of the difficulty of the test item. User The ability value is , , the ability values ​​are numbered from small to large, and the ability values ​​meet . No. Set the file user collection to , ,satisfy ,in, The total number of participants in the network security crowd-testing competition. By classifying the user's ability values, the purpose of accurately archiving users can be achieved.

[0028] Step 104: determine a reward distribution plan based on the users in each category and the capability values ​​corresponding to the users in each category.

[0029] In this step, users sign up for test projects that match their abilities, which is beneficial to both the organizer and the user. Therefore, it is necessary to determine the reward distribution plan based on the users in each category and the ability values ​​corresponding to the users in each category. The reward distribution plan comprehensively considers the abilities of users, making the reward distribution plan reasonable. Subsequently, when users formally register, they can sign up for test projects that match their abilities based on considerations of their own abilities and rewards, eliminating the problem that the network security crowd-testing competition system cannot facilitate users to adaptively select test projects that match their own testing abilities. It should be noted that the organizer can flexibly set the specific form of the reward. Exemplary, the reward is points.

[0030] This application uses the information discrimination theory to propose a competition system optimization method for network security crowd-testing competitions, so as to enable users to adaptively select appropriate test items and reasonably optimize the resources of crowd-testing competitions. Taking the information discrimination theory into consideration, a competition system optimization configuration method for network security crowd-testing competitions is designed, which reflects that through reasonable configuration of project difficulty, reward amount, etc., users can be encouraged to choose test items that suit their testing abilities, making crowd-testing competition resources more reasonable, and also allowing crowd-testing platforms to further understand the ability levels of users.

[0031] Through the above scheme, the registration information of multiple users is received. The registration information is refined and analyzed to obtain the ability value of the user corresponding to the registration information, and the user's ability is digitized to achieve the purpose of accurately determining the user's ability value. The ability values ​​of the multiple users are classified to obtain multiple categories and users corresponding to each category to achieve the purpose of accurately filing users. Based on the users in each category and the ability values ​​corresponding to the users in each category, a reward distribution plan is determined to make the reward distribution plan reasonable.

[0032] In some embodiments, the reward distribution scheme includes a single reward distribution scheme or a multiple reward distribution scheme, and the reward distribution scheme is determined based on the users in each category and the ability values ​​corresponding to the users in each category, including: in response to determining that the number of users corresponding to one of the categories is less than or equal to a predetermined number, based on the ability values ​​corresponding to the users in each category, determining the single reward distribution scheme; in response to determining that the number of users corresponding to all categories is greater than the predetermined number, based on the ability values ​​corresponding to the users in each category, determining the multiple reward distribution schemes. In this embodiment, if the number of users corresponding to one of the categories is less than or equal to the predetermined number, it means that the number of people who answer the test items matching the category is relatively small, and the number of people who receive the reward can be set to be relatively small. The predetermined number is determined based on historical experience, and illustratively, the predetermined number is 3. Therefore, based on the ability values ​​corresponding to the users of each category, a single reward allocation scheme is determined, wherein the single reward allocation scheme is that only one user receives a reward for each test item, and the specific reward is determined based on the ability values ​​corresponding to the users of each category. In the case where the number of users corresponding to all categories is greater than the predetermined number, it means that the number of people who answer the test items matching the category is relatively large, and the number of people who receive the reward can be set to be relatively large. Therefore, based on the ability values ​​corresponding to the users of each category, a multi-reward allocation scheme is determined, wherein the multi-reward allocation scheme is that multiple users receive rewards for each test item, and the specific reward of each user is determined based on the ability values ​​corresponding to the users of each category. The reward allocation scheme is determined by the users of each category and the ability values ​​corresponding to the users of each category, so that the reward allocation scheme is reasonable. This embodiment takes into account the single reward allocation scheme and the multiple reward allocation scheme for the network security crowd-testing competition. There are differences in the optimization configuration methods of different allocation schemes, which provides a more comprehensive reference for the allocation scheme of the crowd-testing platform.

[0033] In some embodiments, the single reward allocation plan is determined based on the ability values ​​corresponding to users in each category, including: based on the ability values ​​corresponding to users in each category, a first objective function is constructed with the goal of maximizing the first revenue-labor ratio of the organizer of the crowd-testing competition, and a first constraint condition corresponding to the first objective function is constructed; based on the first constraint condition, the first objective function is solved to obtain the single reward allocation plan. In this embodiment, the organizer holds a crowd-testing competition, hoping to harvest the maximum labor-collection ratio, and stipulates that when each user signs up for a test topic that matches his or her ability, the organizer has the maximum labor-collection ratio, wherein the labor-collection ratio represents the numerical value of the test topic event in the user's registration competition. The first labor-collection ratio of the organizer of the crowd-testing competition that maximizes the maximum first numerical value corresponding to each user signing up for a test topic event that matches his or her ability. In order to enable users to sign up for test items that match their abilities, it is necessary to reasonably allocate the rewards for each test item to attract users to sign up for test items that match their abilities. In the case where the reward allocation scheme is a single reward allocation scheme, based on the ability values ​​corresponding to users of each category, the first objective function is constructed with the goal of maximizing the first labor-collection ratio of the organizer of the crowd-testing competition, and the first constraint corresponding to the first objective function is constructed. The objective function not only defines the optimization goal, but also provides a direction for finding the optimal solution. Constraints play a vital role in the process of solving the objective function. They not only limit the solution space of the problem, but also guide the feasibility of the solution. In optimization theory, constraints are key factors in determining acceptable solutions. They are imposed on decision variables to ensure that the solution not only optimizes the objective function, but also meets specific requirements or restrictions. These conditions are usually expressed as a set of equations or inequalities. Based on the first constraint, the first objective function is solved to obtain the single reward distribution plan. The methods for solving the objective function mainly include intelligent optimization algorithms, machine learning algorithms, and direct calculation methods. The objective function can clearly express the goal of the optimization problem, quantify the organizer's collection-labor ratio, and find the optimal solution with the help of constraints, and accurately determine the single reward distribution plan.

[0034] In some embodiments, the multi-reward allocation plan is determined based on the ability values ​​corresponding to each category of users, including: based on the ability values ​​corresponding to each category of users, a second objective function is constructed with the goal of maximizing the second revenue-labor ratio of the organizer of the crowd-testing competition, and a second constraint condition corresponding to the second objective function is constructed; based on the second constraint condition, the second objective function is solved to obtain the multi-reward allocation plan. In this embodiment, the organizer holds a crowd-testing competition, expecting to harvest the maximum labor-collection ratio, and stipulates that when each user signs up for a test topic that matches his or her ability, the organizer has the maximum labor-collection ratio, wherein the labor-collection ratio represents the value of the test topic event in the user's registration competition. The second labor-collection ratio of the organizer of the crowd-testing competition that maximizes the maximum second value corresponding to each user signing up for a test topic event that matches his or her ability. In order to enable users to sign up for test items that match their abilities, it is necessary to reasonably allocate the rewards for each test item to attract users to sign up for test items that match their abilities. In the case where the reward allocation scheme is a multi-reward allocation scheme, based on the ability values ​​corresponding to users of each category, a second objective function is constructed with the goal of maximizing the second labor-collection ratio of the organizer of the crowd-testing competition, and a second constraint corresponding to the second objective function is constructed. The objective function not only defines the optimization goal, but also provides a direction for finding the optimal solution. Constraints play a vital role in the process of solving the objective function. They not only limit the solution space of the problem, but also guide the feasibility of the solution. In optimization theory, constraints are key factors in determining acceptable solutions. They are imposed on decision variables to ensure that the solution not only optimizes the objective function, but also meets specific requirements or restrictions. These conditions are usually expressed as a set of equations or inequalities. Based on the second constraint, the second objective function is solved to obtain the multi-reward distribution scheme. The methods for solving the objective function mainly include intelligent optimization algorithms, machine learning algorithms, and direct calculation methods. The objective function can clearly express the goal of the optimization problem, quantify the organizer's collection-labor ratio, and find the optimal solution with the help of constraints, and accurately determine the multi-reward distribution scheme.

[0035] In some embodiments, the method includes: determining the first objective function by the following formula: ,in, For the first labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer. In this embodiment, when the reward distribution scheme is a single reward distribution scheme, a first objective function is constructed. Therefore, in the first objective function, only the first place in each test item can be allocated a reward. It can be seen from the foregoing that the number of test items is the same as the number of file types, and the file category is related to the difficulty of the test items. The greater the difficulty of the test item, the greater the ability value of the user corresponding to the file category. Therefore, allocating rewards to test items is equivalent to allocating rewards to users of the file category that matches the above test items. The greater the difficulty of the test item, the more rewards there are. However, when the total reward for the crowd-testing competition is certain, how much reward is allocated to different test items needs to be determined by solving the objective function. In this embodiment, the first objective function is constructed. Therefore, the first objective function is constructed. User replies in the file category Therefore, users answer test items that match their abilities. When users answer test items that match their abilities, the effort they need to put in is relatively small, but the positive impact on the organizer is greater, i.e. The smaller, The larger the value, the more positive impact it will have on the organizer. You can select appropriate Function. The determination of the effort value is determined according to the needs of the user. For example, it can be obtained by looking up a table. The table can reflect the specific set value of the effort value when the user answers the test items that match his or her ability value; when the user answers the test items that exceed his or her ability value, the effort value increases with the increase of the difficulty of the test items, and the above effort value is greater than the above specific set value; when the user answers the test questions that are lower than his or her ability value, the effort value decreases with the decrease of the difficulty of the test items, and the above effort value is less than the above specific set value. Calculate the product of the ability value of each user in each category and the quantitative value of the positive impact on the organizer. Since it is the first objective function corresponding to the single reward allocation plan, there is only one reward in each category, and the above product is subtracted from the difference between the rewards corresponding to the above categories. Quantify the first collection-to-labor ratio, solve for the rewards in each category, and then attract users to sign up for test items that match their abilities.

[0036] In some embodiments, the method further includes: determining the first constraint condition by the following formula: ,in, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, . In this embodiment, users have expected utility for participating in the crowd-testing competition, that is, users hope to receive rewards. First, the expected utility of the user is determined. The expected utility of the single reward distribution is calculated by Only when users participate in test items that match their abilities can the organizer of the crowd-testing competition obtain the maximum labor-revenue ratio. Therefore, it is necessary to ensure that the expected utility of users answering test items that exceed their abilities is less than the expected utility of users answering test items that match their abilities, that is, , Description The difficulty of the questions corresponding to the first category is lower than that of the The difficulty of the questions corresponding to the file category. Considerations have been made from the perspectives of both users and organizers, reflecting the incentive mechanism of the network security crowd testing competition. Both testers and project parties want to obtain greater benefits with minimal consumption. In the same category, the probability of a user answering the question corresponding to the category to get the first place is proportional to the ability value. The greater the ability value, the greater the probability of getting the first place. The specific probability of getting the first place is determined according to user needs. For example, the probability value of getting the first place is calculated by an equation related to the ability value, or obtained from a pre-constructed data table. The table records the probability value of getting the first place for each ranking in each category. For example, when the user's ability value ranks first in the category, the probability value of getting the first place is 100%; when the user's ability value ranks second in the category, the probability value of getting the first place is 90%. Due to the first The difficulty of the questions corresponding to the first category is lower than that of the The difficulty of the questions corresponding to the file category, so the user The probability of winning the first place in the category is greater than The probability of winning the first place in the file category is Greater than ; The user replied to The effort required for the questions corresponding to the file category is less than that required for answering the The effort value required for the question corresponding to the file category, that is Less than Since the ability value of the same user is fixed, Less than In addition, The difficulty of the questions corresponding to the first category is lower than that of the The difficulty of the questions corresponding to the file category, therefore, Less than , ensuring that relatively difficult questions have relatively high rewards. as well as The solution of In addition, users hope to receive rewards, so the expected utility is greater than or equal to zero, that is, The constraints have a limiting effect on the objective function and are conducive to accurately finding the required solution to the objective function.

[0037] It should be noted that the objective function also needs to satisfy the deformation formula of the constraint condition. From the first constraint condition, it can be seen that the deformation formula of the first constraint condition includes: , , ,make , The above can be written as .Depend on , can be obtained , ,therefore, , . For the File and The difference in effort required for the project. To participate in File and The difference in expected rewards for the project. .

[0038] In some embodiments, the method includes determining the second objective function by the following formula: ,in, For the second labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category Reward for the name, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer. In this embodiment, when the reward distribution scheme is a multiple reward distribution scheme, a second objective function is constructed. Therefore, in the second objective function, multiple places in each test item can obtain rewards. It can be seen from the foregoing that the number of test items is the same as the number of file types, and the file category is related to the difficulty of the test items. The greater the difficulty of the test item, the greater the ability value of the user corresponding to the file category. Therefore, allocating rewards to test items is equivalent to allocating rewards to users of the file category that matches the above test items. The greater the difficulty of the test item, the more rewards there are. However, when the total reward of the crowd-testing competition is certain, how much reward is allocated to different test items needs to be determined by solving the objective function. In this embodiment, the second objective function is constructed. User replies in the file category Therefore, users answer test items that match their abilities. When users answer test items that match their abilities, the effort they need to put in is relatively small, but the positive impact on the organizer is greater, i.e. The smaller, The larger the value, the more positive impact it will have on the organizer. You can select appropriate Function. The determination of the effort value is determined according to the needs of the user. For example, it can be obtained by looking up a table. The table can reflect the specific set value of the effort value when the user answers the test items that match his or her ability value; when the user answers the test items that exceed his or her ability value, the effort value increases as the difficulty of the test items increases, and the above effort value is greater than the above specific set value; when the user answers the test questions that are lower than his or her ability value, the effort value decreases as the difficulty of the test items decreases, and the above effort value is less than the above specific set value. Calculate the product of the ability value of each user in each category and the quantitative value of the positive impact on the organizer. Since it is the second objective function corresponding to the multi-reward allocation plan, there are multiple rewards in each category. Calculate the sum of the rewards in the above categories, and then subtract the above sum from the above product to obtain the difference. Quantify the second collection-to-labor ratio, solve for multiple rewards in each category, and then attract users to sign up for test items that match their abilities.

[0039] In some embodiments, the method further includes: determining the second constraint condition by the following formula: , in, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, .

[0040] In this embodiment, users have expected utility for participating in the crowd-testing competition, that is, users hope to receive rewards. First, the expected utility of the user is determined. The expected utility of multiple reward allocations is calculated by Only when users participate in test items that match their abilities can the organizer of the crowd-testing competition obtain the maximum labor-revenue ratio. Therefore, it is necessary to ensure that the expected utility of users answering test items that exceed their abilities is less than the expected utility of users answering test items that match their abilities, that is, , Description The difficulty of the questions corresponding to the first category is lower than that of the The difficulty of the questions corresponding to the file category. Considerations have been made from the perspectives of both users and organizers, reflecting the incentive mechanism of the network security crowd testing competition. Both testers and project parties want to obtain greater benefits with minimal consumption. In the same category, the probability of a user answering the questions corresponding to the category to get a ranking is proportional to the ability value. The greater the ability value, the greater the probability of getting a ranking. The specific probability of getting a ranking is determined according to user needs. For example, the probability value of getting a ranking is calculated by an equation related to the ability value, or obtained from a pre-constructed data table. The table records the probability value corresponding to each ranking in each category. For example, when the user's ability value ranks first in the category, the probability value of getting the first place is 100%; when the user's ability value ranks second in the category, the probability value of getting the first place is 90%, and the probability value of getting the second place is 100%. Due to the The difficulty of the questions corresponding to the first category is lower than that of the The difficulty of the questions corresponding to the file category, so the user The probability of getting a ranking in the file category is greater than The probability value of obtaining the same ranking in the file category is Greater than ; The user replied to The effort required for the questions corresponding to the file category is less than that required for answering the The effort value required for the question corresponding to the file category, that is Less than Since the ability value of the same user is fixed, Less than In addition, The difficulty of the questions corresponding to the first category is lower than that of the The difficulty of the questions corresponding to the file category, therefore, Less than , ensuring that relatively difficult questions have relatively high rewards. as well as The solution of In addition, users hope to receive rewards, so the expected utility is greater than or equal to zero, that is, The constraints have a limiting effect on the objective function and are conducive to accurately finding the required solution to the objective function.

[0041] It should be noted that the objective function also needs to satisfy the deformation formula of the constraint condition. From the second constraint condition, it can be seen that the deformation formula of the second constraint condition includes: , , ,make , The above can be written as .Depend on , can be obtained , ,therefore, , . For the File and The difference in effort required for the project. To participate in File and The difference in expected rewards for the project. .

[0042] In another embodiment of the present application, Figure 2 As mentioned above, the organizer of the crowd-testing competition releases the network security crowd-testing competition, and users pre-register for the crowd-testing competition. The crowd-testing platform determines the reward distribution plan based on the pre-registration situation, where the reward distribution plan includes a single reward distribution plan and a multiple reward distribution plan. After determining the reward distribution plan, the test project rules and user registration parameters are officially released based on the reward distribution plan.

[0043] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.

[0044] It should be noted that the above describes some embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0045] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a reward distribution device for a crowd-testing competition.

[0046] refer to Figure 3 , the reward distribution device of the crowd testing competition includes: The receiving module 10 is configured to receive registration information of multiple users.

[0047] The analysis module 20 is configured to perform refined analysis on the registration information to obtain the capability value of the user corresponding to the registration information.

[0048] The classification module 30 is configured to classify the capability values ​​of the plurality of users to obtain a plurality of categories and users corresponding to each category.

[0049] The determination module 40 is configured to determine a reward distribution plan based on the users in each category and the capability values ​​corresponding to the users in each category.

[0050] The registration information of multiple users is received through the above device. The registration information is refined and analyzed to obtain the ability value of the user corresponding to the registration information, and the user's ability is digitized to achieve the purpose of accurately determining the user's ability value. The ability values ​​of the multiple users are classified to obtain multiple categories and users corresponding to each category to achieve the purpose of accurately filing the users. Based on the users in each category and the ability values ​​corresponding to the users in each category, a reward distribution plan is determined to make the reward distribution plan reasonable.

[0051] In some embodiments, the determination module 40 is further configured such that the reward distribution scheme includes a single reward distribution scheme or a multiple reward distribution scheme. In response to determining that the number of users corresponding to one of the categories is less than or equal to a predetermined number, the single reward distribution scheme is determined based on the ability values ​​corresponding to the users in each category. In response to determining that the number of users corresponding to all the categories is greater than the predetermined number, the multiple reward distribution scheme is determined based on the ability values ​​corresponding to the users in each category.

[0052] In some embodiments, the determination module 40 is further configured to construct a first objective function based on the ability values ​​corresponding to users in each category, with the goal of maximizing the first revenue-labor ratio of the organizer of the crowd-testing competition, and to construct a first constraint condition corresponding to the first objective function; based on the first constraint condition, the first objective function is solved to obtain the single reward distribution plan.

[0053] In some embodiments, the determination module 40 is further configured to construct a second objective function based on the ability values ​​corresponding to users in each category, with the goal of maximizing the second revenue-labor ratio of the organizer of the crowd-testing competition, and to construct a second constraint condition corresponding to the second objective function; based on the second constraint condition, the second objective function is solved to obtain the multi-reward distribution plan.

[0054] In some embodiments, the determination module 40 is further configured to determine the first objective function by the following formula: ,in, For the first labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer.

[0055] In some embodiments, the determination module 40 is further configured to determine the first constraint condition by the following formula: ,in, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, .

[0056] In some embodiments, the determination module 40 is further configured to determine the second objective function by the following formula: ,in, For the second labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category Reward for the name, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer.

[0057] In some embodiments, the determination module 40 is further configured to determine the second constraint condition by the following formula: ,in, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, .

[0058] For the convenience of description, the above device is described in terms of functions divided into various modules. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0059] The device of the above embodiment is used to implement the reward distribution method of the corresponding crowd-testing competition in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0060] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the reward distribution method for the crowd-testing competition as described in any of the above embodiments is implemented.

[0061] Figure 4 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.

[0062] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0063] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.

[0064] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0065] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.).

[0066] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010 , the memory 1020 , the input / output interface 1030 , and the communication interface 1040 ).

[0067] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.

[0068] The electronic device of the above embodiment is used to implement the reward distribution method of the corresponding crowd-testing competition in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0069] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the reward distribution method for the crowd-testing competition as described in any of the above embodiments.

[0070] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0071] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the reward distribution method for the crowd-testing competition as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0072] Based on the same concept, corresponding to any of the above-mentioned embodiment methods, the present application also provides a computer program product, including computer program instructions. When the computer program instructions are executed on a computer, the computer executes the reward distribution method for the crowd-testing competition as described in any of the above embodiments, which has the beneficial effects of the corresponding method embodiments and will not be repeated here.

[0073] It should be noted that the embodiments of the present application can be further described in the following manner: It is understandable that before using the technical solutions of each embodiment of the present disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the user's authorization will be obtained.

[0074] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can independently choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0075] As an optional but non-limiting implementation, in response to receiving the user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0076] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0077] A person skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0078] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power / ground connections to the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device may be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present application are to be implemented (that is, these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or with changes in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0079] Although the present application has been described in conjunction with specific embodiments of the present application, many alternatives, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the discussed embodiments.

[0080] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the present application. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the protection scope of the present application.

Claims

1. A reward distribution method for a crowd testing competition, characterized in that: include: Receive registration information from multiple users; Refining and analyzing the registration information to obtain the ability value of the user corresponding to the registration information; Classifying the capability values ​​of the plurality of users to obtain a plurality of categories and users corresponding to each category; A reward distribution plan is determined based on the users in each category and the corresponding capability values ​​of the users in each category.

2. The method according to claim 1, characterized in that The reward allocation scheme includes a single reward allocation scheme or a multiple reward allocation scheme. The reward allocation scheme is determined based on the users of each category and the capability values ​​corresponding to the users of each category, including: In response to determining that the number of users corresponding to one of the categories is less than or equal to the predetermined number, determining the single reward allocation scheme based on the capability values ​​corresponding to the users in each category; In response to determining that the number of users corresponding to all the file categories is greater than the predetermined number, the multiple reward allocation scheme is determined based on the ability value corresponding to the users of each file category.

3. The method according to claim 2, characterized in that The determining of the single reward allocation scheme based on the capability values ​​corresponding to the users in each category includes: Based on the capability values ​​corresponding to the users in each category, a first objective function is constructed with the goal of maximizing the first labor-receive ratio of the organizer of the crowd-testing competition, and a first constraint condition corresponding to the first objective function is constructed; Based on the first constraint condition, the first objective function is solved to obtain the single reward allocation plan.

4. The method according to claim 2, characterized in that: The determining of the multiple reward allocation schemes based on the capability values ​​corresponding to the users in each category includes: Based on the capability values ​​corresponding to the users in each category, a second objective function is constructed with the goal of maximizing the second labor-receive ratio of the organizer of the crowd-testing competition, and a second constraint condition corresponding to the second objective function is constructed; Based on the second constraint condition, the second objective function is solved to obtain the multi-reward allocation plan.

5. The method according to claim 3, characterized in that: include: The first objective function is determined by the following formula: ， in, For the first labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer.

6. The method according to claim 3, characterized in that Also includes: The first constraint is determined by the following formula: ， in, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, Indicates user Reply The probability of getting the first place for the question corresponding to the file category, Indicates user Reply The effort required for the question corresponding to the file category, Indicates Rewards corresponding to the file category, .

7. The method according to claim 4, characterized in that include: The second objective function is determined by the following formula: ， in, For the second labor-revenue ratio, Indicates Users in the Files category The ability value, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category Reward for the name, Indicates the total number of file categories. Indicated in The total number of users in the profile category, Indicates user The amount of effort required A function of the positive impact on the organizer.

8. The method according to claim 4, characterized in that Also includes: The second constraint is determined by the following formula: ， in, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, Indicates user Reply The title corresponding to the file category can get the first The probability of the name, Indicates user Reply The effort required for the question corresponding to the file category, Indicates File category The rewards corresponding to the name, .

9. A reward distribution device for a crowd-testing competition, characterized in that: include: A receiving module, configured to receive registration information of multiple users; An analysis module is configured to extract and analyze the registration information to obtain a capability value of a user corresponding to the registration information; A classification module is configured to classify the capability values ​​of the plurality of users to obtain a plurality of categories and users corresponding to each category; The determination module is configured to determine a reward distribution plan based on the users in each category and the capability values ​​corresponding to the users in each category.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 8 is implemented.

Images