An anti-cheating crowdsourcing task allocation method, device and electronic equipment

Abstract

The present application relates to the technical field of network data security, and discloses a cheating-preventing crowdsourcing task allocation method, device and electronic equipment, the cheating-preventing crowdsourcing task allocation method comprises the following steps: caching to-be-issued crowdsourcing tasks to form a task pool, and randomly issuing the to-be-issued crowdsourcing tasks in the task pool. The cheating-preventing crowdsourcing task allocation method can avoid the cheating behavior of taking the same task in a same time period by a script in a large quantity by adopting the caching+random mode to issue the crowdsourcing tasks, so as to ensure the normal allocation of the crowdsourcing tasks and the reliability and effectiveness of a related verification mechanism, improve the stability and safety and reliability of a crowdsourcing platform, and ensure the user experience.

Description

Technical Field

[0001] This invention relates to the field of network data security technology, specifically to a crowdsourcing task allocation method, apparatus, and electronic device for preventing cheating. Background Technology

[0002] Crowdsourcing is a new form of production organization brought about by the internet. It is used to describe a new business model in which companies use the internet to distribute work, discover ideas, or solve technical problems.

[0003] Crowdsourcing platforms, a model controlled via the internet, allow organizations (especially in the software and service industries) to leverage the creativity and capabilities of a vast army of volunteers—people with the skills to complete tasks, willing to work in their spare time, content with small payments for their services, or even unpaid initially, simply satisfied with the prospect of greater compensation in the future. This provides a completely new way to organize labor.

[0004] Existing crowdsourcing platform solutions mostly focus on product or service production, while educational crowdsourcing platforms, as a new approach, aim to utilize more high-quality educational resources and provide higher-quality educational services. One type of crowdsourcing task on existing educational crowdsourcing platforms is the judgment / false / answer question. This task distribution and verification mechanism leverages the fact that judgment / false / answer questions only have two possible answers: "correct" or "incorrect." Specifically, by distributing a certain number of judgment / false / answer questions and obtaining the percentage of "correct" and "incorrect" answers from the users who submitted them, the platform determines whether the answer to the judgment / false / answer question is correct or incorrect.

[0005] However, the task distribution mechanism described above, where a certain number of identical judgment questions are distributed simultaneously within a short period, could allow cheating users to use scripts to automatically obtain most or all of these identical questions. They could then select "correct" or "incorrect" for all of them before automatically uploading them, attempting to bypass the server's subsequent verification mechanism. Such cheating not only consumes a large amount of server resources, affecting the normal distribution of judgment question crowdsourcing tasks, but also, if it succeeds in deceiving the server's verification mechanism, it may produce incorrect judgment questions, wasting significant resources on useless questions, disrupting the normal operation of the crowdsourcing platform, and causing economic losses.

[0006] In view of this, this invention is proposed to address the aforementioned cheating issues in judging crowdsourced tasks on educational crowdsourcing platforms. Summary of the Invention

[0007] The purpose of this invention is to provide a crowdsourcing task allocation method, apparatus, and electronic device that can effectively prevent cheating.

[0008] To achieve the above-mentioned objectives, the present invention provides the following technical solution:

[0009] A crowdsourcing task allocation method to prevent cheating includes:

[0010] Crowdsourcing tasks awaiting distribution are cached to form a task pool, and then randomly distributed from the task pool.

[0011] As an optional embodiment of the present invention, the random distribution of crowdsourcing tasks to be assigned from the task pool includes:

[0012] During the same distribution period, randomly select crowdsourcing tasks of different types and / or different contents to be distributed.

[0013] And / or, crowdsourcing tasks of the same type and / or with the same content are randomly assigned to different distribution periods for distribution.

[0014] As an optional embodiment of the present invention, the crowdsourcing task to be distributed is a judgment question crowdsourcing task. A certain number of judgment question crowdsourcing tasks with the same question content are cached. After a certain period of caching, they are mixed with a certain number of other judgment question crowdsourcing tasks with the same content to form a task pool containing judgment question crowdsourcing tasks with different content.

[0015] During the same distribution period, judgment-based crowdsourcing tasks are randomly selected from the task pool and distributed.

[0016] As an optional embodiment of the present invention, a certain number of first judgment question crowdsourcing tasks and a certain number of second judgment question crowdsourcing tasks are cached to form a task pool that mixes the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks. The question content of the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks are different.

[0017] During the same distribution period, the crowdsourcing tasks for the first and second judgment questions are retrieved and distributed.

[0018] And / or, the first judgment question crowdsourcing task and the second judgment question crowdsourcing task are randomly assigned to different distribution time periods for distribution.

[0019] As an optional implementation of the present invention, after a certain number of crowdsourcing tasks with the same question content have been distributed, after a preset time, the answers to all submitted crowdsourcing tasks with the same question content are obtained, and the answer to the crowdsourcing task with the same question content is determined by combining the proportion of each answer.

[0020] Optionally, if the percentage of a certain answer submitted for a judgment question crowdsourcing task exceeds a set value, then that answer is recognized as the answer for that judgment question crowdsourcing task.

[0021] As an optional embodiment of the present invention, the crowdsourcing task to be distributed includes a poisoning task for verifying whether cheating has occurred:

[0022] The poisoning task contains verification information. If the verification information fails, it is judged as an abnormal operation. At the same time, the associated user behavior of the abnormal operation ID is obtained to determine whether cheating has occurred.

[0023] Optionally, the associated user behavior of the abnormal operation ID includes the pass rate of historical poisoning task verification.

[0024] As an optional embodiment of the present invention, the poisoning task is a crowdsourced task of judging a question with a known answer:

[0025] The system receives responses to poisoning tasks and verifies the responses using known answers. If the verification passes, the operation is considered normal; otherwise, it is considered abnormal.

[0026] This invention also provides a crowdsourcing task allocation device for preventing cheating, comprising:

[0027] The caching module caches crowdsourcing tasks to be distributed, forming a task pool.

[0028] The module for retrieving and distributing tasks retrieves crowdsourcing tasks from the task pool and distributes them randomly.

[0029] The present invention also provides an electronic device, including a processor and a memory, wherein the memory is used to store a computer-executable program, and when the computer program is executed by the processor, the processor executes the aforementioned anti-cheating crowdsourcing task allocation method.

[0030] The present invention also provides a computer-readable medium storing a computer-executable program, which, when executed, implements the aforementioned anti-cheating crowdsourcing task allocation method.

[0031] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0032] The crowdsourcing task allocation method of this invention prevents cheating by caching and randomly distributing crowdsourcing tasks. This avoids cheating behavior such as receiving a large number of identical tasks in the same time period through scripts, thus ensuring the normal allocation of crowdsourcing tasks and the reliability and effectiveness of related verification mechanisms. This improves the stability and security of the crowdsourcing platform and ensures the user experience.

[0033] The random distribution method of the present invention can randomly distribute crowdsourcing tasks of different types and / or different contents in the task pool, thereby avoiding the repeated receipt of crowdsourcing tasks of the same type and / or the same contents in the same time period and thus avoiding cheating.

[0034] This invention targets educational crowdsourcing platforms. The anti-cheating crowdsourcing task allocation method caches judgment question crowdsourcing tasks to form a task pool containing judgment question crowdsourcing tasks with different content. During the same distribution period, judgment question crowdsourcing tasks in the task pool are randomly retrieved and distributed, so that judgment question crowdsourcing tasks with different content are distributed within the same time period. This makes the probability of the script's "automatic answer" answer being verified by the verification mechanism extremely low, effectively blocking cheating behavior.

[0035] The crowdsourcing task allocation method for preventing cheating in this invention verifies and filters abnormal operations by issuing "poisoning" tasks, thus proactively defending against potential risks of cheating. This invention determines whether cheating has occurred by combining the current abnormal operation status with related user behavior, avoiding situations where abnormal operations caused by normal user errors are mistakenly identified as cheating. Attached Figure Description

[0036] Figure 1 A flowchart of the anti-cheating crowdsourcing task allocation method of the present invention;

[0037] Figure 2 The flowchart of the crowdsourcing task allocation method for preventing cheating in this invention is shown below, which involves randomly distributing crowdsourcing tasks from the task pool.

[0038] Figure 3 The present invention provides a flowchart of the anti-cheating crowdsourcing task allocation method for an educational crowdsourcing platform.

[0039] Figure 4 The flowchart for judging the answer of a crowdsourcing task in the anti-cheating crowdsourcing task allocation method of this invention;

[0040] Figure 5 The flowchart of the poisoning task distribution in the crowdsourcing task allocation method for anti-cheating in this invention. Detailed Implementation

[0041] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention.

[0042] Therefore, the following detailed description of embodiments of the present invention is not intended to limit the scope of the claimed invention, but merely illustrates some embodiments of the invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the scope of protection of the present invention.

[0043] It should be noted that, unless otherwise specified, the embodiments and features and technical solutions in the present invention can be combined with each other.

[0044] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0045] In the description of this invention, it should be noted that the terms "upper," "lower," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, or the orientation or positional relationship commonly used when the product of this invention is in use, or the orientation or positional relationship commonly understood by those skilled in the art. These terms are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this invention. In addition, the terms "first," "second," etc., are only used to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0046] See Figure 1 As shown in the figure, this embodiment provides a crowdsourcing task allocation method to prevent cheating, including:

[0047] Crowdsourcing tasks awaiting distribution are cached to form a task pool, and then randomly distributed from the task pool.

[0048] This embodiment of the crowdsourcing task allocation method for preventing cheating avoids cheating behavior such as receiving a large number of identical tasks in the same time period by caching and randomly distributing crowdsourcing tasks. This ensures the normal allocation of crowdsourcing tasks and the reliability and effectiveness of related verification mechanisms, improves the stability and security of the crowdsourcing platform, and ensures the user experience.

[0049] As one embodiment of the present invention, see Figure 2 As shown, the random distribution of crowdsourcing tasks from the task pool in this embodiment includes:

[0050] During the same distribution period, crowdsourcing tasks of different types and / or with different content are randomly selected and distributed. Specifically, after a certain period of caching, the task pool contains a mixture of first and second crowdsourcing tasks created at different times. When distributing, the first and second crowdsourcing tasks in the task pool can be randomly selected and distributed. This allows crowdsourcing tasks created at different times to be distributed at the same time, enabling the distribution of crowdsourcing tasks with different content on a single distribution node.

[0051] And / or, crowdsourcing tasks of the same type and / or with the same content are randomly assigned to different distribution time periods for distribution. Specifically, when a certain number of first and second crowdsourcing tasks are created, they are distributed according to the set distribution rules. For example, some tasks can be distributed after creation, some after a first set time, some after another set time, and so on, until all tasks are distributed. This ensures that neither the first nor the second crowdsourcing tasks are all distributed in a short period of time, preventing scripts from automatically grabbing a large number of tasks.

[0052] Furthermore, in the anti-cheating crowdsourcing task allocation method of this embodiment, the crowdsourcing tasks to be distributed include a large number of different crowdsourcing tasks. By caching, the crowdsourcing tasks newly created in different time periods are mixed and randomly retrieved and distributed when the crowdsourcing tasks are distributed, so as to avoid distributing a large number of the same crowdsourcing tasks at the same time.

[0053] In addition, to ensure that all crowdsourced tasks are distributed, the anti-cheating crowdsourced task allocation method in this embodiment has a crowdsourced task allocation strategy:

[0054] Distribution Strategy 1: When creating a new crowdsourcing task for a judgment question, the batch size, number of tasks per batch, and delivery time are set according to the number of tasks. For example, upon creating a new crowdsourcing task, all crowdsourcing tasks are set to be evenly distributed into N portions, and then delivered in batches at set time intervals. In this embodiment, the time intervals can be the same, different, or randomly configured by the system.

[0055] Distribution Strategy Two: Set a distribution time T0 for crowdsourced tasks. When a new crowdsourced task is created, a random distribution strategy is used to distribute an unpredictable number of tasks at random times. After distribution time T0 elapses since the task was created, the number of distributed tasks is obtained. If the proportion of distributed tasks to the total number of tasks is greater than a set value (e.g., 80%), the crowdsourced task for that question is considered to have been distributed. Otherwise, another distribution time T0 is executed until all tasks for that question are distributed. If distribution is not completed after multiple T0s, a strategy of distributing all tasks in the task pool is executed.

[0056] Specifically, in order to achieve mixed distribution of crowdsourcing tasks, the task pool in this embodiment includes multiple task temporary storage containers. After a crowdsourcing task is created, it is divided into multiple parts and stored in each task temporary storage container. Each task temporary storage container is set with a time parameter. When the time parameter is exhausted, the crowdsourcing task in the task temporary storage container will be distributed.

[0057] The random distribution method in this embodiment can randomly distribute crowdsourcing tasks of different types and / or different contents in the task pool, avoiding the repeated receipt of crowdsourcing tasks of the same type and / or the same contents in the same time period, thereby avoiding cheating.

[0058] The anti-cheating crowdsourcing task allocation method of this embodiment can be applied to the distribution of judgment question crowdsourcing tasks in educational crowdsourcing platforms. The specific technical solution is as follows:

[0059] See Figure 3 As shown in this embodiment, a crowdsourcing task allocation method for preventing cheating is provided. The crowdsourcing task to be distributed is a judgment question crowdsourcing task. A certain number of judgment question crowdsourcing tasks with the same question content are cached. After caching for a certain period of time, they are mixed with a certain number of other judgment question crowdsourcing tasks with the same content to form a task pool containing judgment question crowdsourcing tasks with different content.

[0060] During the same distribution period, judgment-based crowdsourcing tasks are randomly selected from the task pool and distributed.

[0061] Because educational crowdsourcing platforms distribute judgment question crowdsourcing tasks by releasing a certain number of identical judgment question crowdsourcing tasks within the same time period, and the verification mechanism determines whether the judgment question answer is "correct" or "incorrect" by obtaining the percentage of "correct" and "incorrect" answers from the user-submitted answers, this task distribution and verification mechanism of educational crowdsourcing platforms has loopholes. This allows scripts to "automatically grab tasks" and "automatically answer questions," resulting in cheating behavior. If a sufficient number of scripts trigger "automatic task grabbing" and "automatic question answering" within a certain time period, and since "automatic answers" are generally all "correct" or all "incorrect," they can occupy the majority of the judgment question crowdsourcing tasks released within that time period, thus forcibly determining the answer to the judgment question crowdsourcing task.

[0062] The anti-cheating crowdsourcing task allocation method in this embodiment caches judgment question crowdsourcing tasks to form a task pool containing judgment question crowdsourcing tasks with different content; during the same distribution period, judgment question crowdsourcing tasks in the task pool are randomly retrieved and distributed, so that judgment question crowdsourcing tasks with different content are distributed in the same time period, thereby making the probability of the script's "automatic answer" answer being verified by the verification mechanism extremely low, and effectively blocking cheating behavior.

[0063] Specifically, the anti-cheating crowdsourcing task allocation method in this embodiment caches a certain number of first judgment question crowdsourcing tasks and a certain number of second judgment question crowdsourcing tasks to form a task pool that mixes the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks. The question content of the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks are different.

[0064] During the same distribution period, the first and second judgment question crowdsourcing tasks are retrieved and distributed. Specifically, after a certain period of caching, the task pool contains a mix of first and second judgment question crowdsourcing tasks created at different times. When distributing, the first and second judgment question crowdsourcing tasks in the task pool can be retrieved randomly for distribution. This allows crowdsourcing tasks created at different times to be distributed at the same time, enabling the distribution of various judgment question crowdsourcing tasks with different question contents to be distributed on a single distribution node.

[0065] And / or, the first and second judgment question crowdsourcing tasks are randomly assigned to different distribution time periods for distribution. Specifically, when a certain number of first and second judgment question crowdsourcing tasks are created, they are distributed according to the set distribution rules. For example, some tasks can be distributed after creation, some after a first set time, some after another set time, and so on, until all tasks are distributed. This ensures that neither the first nor the second judgment question crowdsourcing tasks are all distributed in a short period of time, preventing scripts from automatically grabbing a large number of questions.

[0066] Furthermore, in the anti-cheating crowdsourcing task allocation method of this embodiment, the crowdsourcing tasks to be distributed include a large number of questions. By caching, the judgment question crowdsourcing tasks newly created in various time periods are mixed together and randomly retrieved and distributed when the crowdsourcing tasks are distributed, so as to avoid distributing a large number of the same judgment question crowdsourcing tasks at the same time.

[0067] Further, see Figure 4As shown in this embodiment, the crowdsourcing task allocation method for preventing cheating involves distributing a certain number of judgment-based crowdsourcing tasks with identical content. After a preset time period, the answers to all submitted judgment-based crowdsourcing tasks are obtained. The answer is determined by considering the proportion of each answer. This embodiment employs a caching and random distribution method for judgment-based crowdsourcing tasks to eliminate cheating strategies. The verification mechanism's reliance on answer proportions to determine the answer to the judgment-based crowdsourcing task is therefore reliable.

[0068] In addition, to ensure that all crowdsourced tasks for each question are distributed, the anti-cheating crowdsourced task allocation method in this embodiment has a crowdsourced task distribution strategy:

[0069] Distribution Strategy 1: When creating a new crowdsourcing task for judgment questions, the batches, number of tasks per batch, and delivery time are set according to the number of tasks. For example, upon creating a new crowdsourcing task for judgment questions, all crowdsourcing tasks are set to be evenly distributed into N portions, and then delivered in batches at set time intervals. In this embodiment, the time intervals can be the same, different, or randomly configured by the system.

[0070] Distribution Strategy Two: Set a distribution time T0 for crowdsourced tasks. When a new judgment question crowdsourced task is created, a random distribution strategy is used to distribute an unpredictable number of tasks at random times. After distribution time T0 elapses since the task was created, the number of distributed tasks is obtained. If the proportion of distributed tasks to the total number of tasks is greater than a set value (e.g., 80%), the judgment question crowdsourced task is considered to have been distributed. Otherwise, another distribution time T0 is executed until all tasks for that question are distributed. If distribution is not completed after multiple T0s, the strategy of distributing all tasks in the task pool is executed once.

[0071] Specifically, in order to achieve mixed distribution of crowdsourcing tasks, the task pool in this embodiment includes multiple task temporary storage containers. After a crowdsourcing task is created, it is divided into multiple parts and stored in each task temporary storage container. Each task temporary storage container is set with a time parameter. When the time parameter is exhausted, the crowdsourcing task in the task temporary storage container will be distributed.

[0072] Optionally, if the percentage of a certain answer in the submitted judgment question crowdsourcing task exceeds a set value, then that answer is recognized as the answer to the judgment question crowdsourcing task for that question content. Considering the reliability of answer recognition based on answer percentage, the condition of "the vast majority" needs to be met, meaning that the percentage of one aspect of the judgment in the answer should be significantly greater than the percentage of another aspect. Optionally, the set value is 60%.

[0073] As can be seen from the above, the anti-cheating crowdsourcing task allocation method of this embodiment can prevent cheating from taking effect; however, the existence of cheating will still occupy platform resources and affect the normal operation of the platform. Therefore, the anti-cheating crowdsourcing task allocation method of this embodiment can also actively identify and eliminate cheating, specifically by adopting the following technical solution:

[0074] See Figure 5 As shown in this embodiment, a crowdsourcing task allocation method for preventing cheating includes a "poisoning" task for verifying whether cheating has occurred in the crowdsourcing tasks to be distributed.

[0075] The poisoning task contains verification information. If the verification fails, it is judged as an abnormal operation. At the same time, the associated user behavior of the abnormal operation ID is obtained to determine whether cheating has occurred.

[0076] This embodiment's anti-cheating crowdsourcing task allocation method verifies and filters abnormal operations by issuing "poisoning" tasks, proactively defending against potential risks of cheating. This embodiment determines whether cheating has occurred by combining the current abnormal operation status with related user behavior, avoiding situations where abnormal operations caused by normal user errors are mistakenly identified as cheating.

[0077] The poisoning task in this embodiment is a crowdsourced task containing simple verification information. The distribution of the poisoning task is random, and after being received by the user, there will be a prompt such as "This task is for testing purposes only" to avoid causing confusion to the user.

[0078] Optionally, the associated user behavior of the abnormal operation ID includes the pass rate of historical poisoning task verification. When the pass rate of historical poisoning task verification for an abnormal operation ID is lower than a certain value, the user is identified as a cheater. Optionally, the pass rate of historical poisoning task verification is 50%.

[0079] Optionally, the associated user behavior of the abnormal operation ID includes the number of operations over a certain time period and / or the frequency of operations within a certain historical period. A cheating user is identified when the number of operations over a certain time period exceeds a certain value, and / or when the frequency of operations within a certain historical period exceeds a certain value.

[0080] As an optional implementation of this embodiment, for an educational crowdsourcing platform, the "poisoning" task is a crowdsourcing task for judging questions with known answers:

[0081] The system receives responses to poisoning tasks and verifies the responses using known answers. If the verification passes, the operation is considered normal; otherwise, it is considered abnormal.

[0082] It should be noted that the poisoning tasks in this embodiment generally involve very simple common-sense judgment questions, such as "The sun is round", "The earth is square", "1+1=3", etc.

[0083] This embodiment also provides a crowdsourcing task allocation device for preventing cheating, including:

[0084] The caching module caches crowdsourcing tasks to be distributed, forming a task pool.

[0085] The module for retrieving and distributing tasks retrieves crowdsourcing tasks from the task pool and distributes them randomly.

[0086] The anti-cheating crowdsourcing task allocation device in this embodiment distributes crowdsourcing tasks by caching and randomizing them. This avoids cheating behavior such as receiving a large number of identical tasks in the same time period through scripts, thus ensuring the normal allocation of crowdsourcing tasks and the reliability and effectiveness of related verification mechanisms. This improves the stability and security of the crowdsourcing platform and ensures the user experience.

[0087] The anti-cheating crowdsourcing task allocation device of this embodiment can be applied to the distribution of judgment question crowdsourcing tasks in educational crowdsourcing platforms. The specific technical solution is as follows:

[0088] This embodiment provides a crowdsourcing task allocation device for preventing cheating. The crowdsourcing task to be distributed is a judgment question crowdsourcing task. The caching module caches a certain number of judgment question crowdsourcing tasks with the same question content. After caching for a certain period of time, the cached task is mixed with a certain number of other judgment question crowdsourcing tasks with the same content to form a task pool containing judgment question crowdsourcing tasks with different content.

[0089] The task retrieval and distribution module randomly retrieves judgment-based crowdsourcing tasks from the task pool and distributes them during the same distribution period.

[0090] Because educational crowdsourcing platforms distribute judgment question crowdsourcing tasks by releasing a certain number of identical judgment question crowdsourcing tasks within the same time period, and the verification mechanism determines whether the judgment question answer is "correct" or "incorrect" by obtaining the percentage of "correct" and "incorrect" answers from the user-submitted answers, this task distribution and verification mechanism of educational crowdsourcing platforms has loopholes. This allows scripts to "automatically grab tasks" and "automatically answer questions," resulting in cheating behavior. If a sufficient number of scripts trigger "automatic task grabbing" and "automatic question answering" within a certain time period, and since "automatic answers" are generally all "correct" or all "incorrect," they can occupy the majority of the judgment question crowdsourcing tasks released within that time period, thus forcibly determining the answer to the judgment question crowdsourcing task.

[0091] In this embodiment, the anti-cheating crowdsourcing task allocation device caches judgment question crowdsourcing tasks to form a task pool containing judgment question crowdsourcing tasks with different content; it randomly retrieves judgment question crowdsourcing tasks from the task pool and distributes them during the same distribution period, so that judgment question crowdsourcing tasks with different content are distributed during the same time period. This makes the probability of the script's "automatic answer" answer being verified by the verification mechanism extremely low, thus effectively blocking cheating behavior.

[0092] Specifically, in this embodiment of the anti-cheating crowdsourcing task allocation device, the caching module caches a certain number of first judgment question crowdsourcing tasks and a certain number of second judgment question crowdsourcing tasks respectively, forming a task pool that mixes the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks. The question content of the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks are different.

[0093] The retrieval and distribution module retrieves and distributes the first and second judgment question crowdsourcing tasks within the same distribution period.

[0094] And / or, the distribution module will randomly assign the first judgment question crowdsourcing task and the second judgment question crowdsourcing task to different distribution time periods for distribution.

[0095] Furthermore, the anti-cheating crowdsourcing task allocation device in this embodiment includes a question-answer judgment module. After the distribution module has distributed a certain number of crowdsourcing tasks with identical question content, and after a preset time, the question-answer judgment module obtains the answers to all submitted crowdsourcing tasks and, based on the proportion of each answer, determines the answer to the question content of the crowdsourcing task. This embodiment, through a caching + random distribution method for crowdsourcing tasks, eliminates the strategy against cheating. The verification mechanism's method of determining the answer to the question content based on the answer proportion is reliable.

[0096] Optionally, if the percentage of a certain answer in the submitted judgment question crowdsourcing task exceeds a set value, then that answer is recognized as the answer to the judgment question crowdsourcing task for that question content. Considering the reliability of answer recognition based on answer percentage, the condition of "the vast majority" needs to be met, meaning that the percentage of one aspect of the judgment in the answer should be significantly greater than the percentage of another aspect. Optionally, the set value is 60%.

[0097] As can be seen from the above, the anti-cheating crowdsourcing task allocation device of this embodiment can prevent cheating from taking effect; however, the existence of cheating will still occupy platform resources and affect the normal operation of the platform. Therefore, the anti-cheating crowdsourcing task allocation device of this embodiment can also actively identify and eliminate cheating, specifically by adopting the following technical solution:

[0098] A crowdsourcing task allocation device for preventing cheating includes a poisoning module, which distributes poisoned tasks (used to verify whether cheating has occurred) among the crowdsourcing tasks to be allocated.

[0099] The poisoning task contains verification information. If the verification fails, it is judged as an abnormal operation. At the same time, the associated user behavior of the abnormal operation ID is obtained to determine whether cheating has occurred.

[0100] This embodiment's anti-cheating crowdsourcing task allocation device uses a poisoning module to distribute poisoned tasks, thereby verifying and screening abnormal operations and proactively defending against potential risks of cheating. This embodiment determines whether cheating has occurred by combining the current abnormal operation status with related user behavior, avoiding situations where abnormal operations caused by normal user errors are mistakenly identified as cheating.

[0101] Optionally, the associated user behavior of the abnormal operation ID includes the pass rate of historical poisoning task verification. When the pass rate of historical poisoning task verification for an abnormal operation ID exceeds a certain value, the user is identified as a cheater. Optionally, the pass rate of historical poisoning task verification is 90%.

[0102] Optionally, the associated user behavior of the abnormal operation ID includes the number of operations over a certain time period and / or the frequency of operations within a certain historical period. A cheating user is identified when the number of operations over a certain time period exceeds a certain value, and / or when the frequency of operations within a certain historical period exceeds a certain value.

[0103] As an optional implementation of this embodiment, for an educational crowdsourcing platform, the "poisoning" task is a crowdsourcing task for judging questions with known answers:

[0104] The system receives responses to poisoning tasks and verifies the responses using known answers. If the verification passes, the operation is considered normal; otherwise, it is considered abnormal.

[0105] It should be noted that the poisoning tasks in this embodiment generally involve very simple common-sense judgment questions, such as "The sun is round", "The earth is square", "1+1=3", etc.

[0106] This embodiment also provides an electronic device, including a processor and a memory, wherein the memory is used to store a computer-executable program, and when the computer program is executed by the processor, the processor executes the anti-cheating crowdsourcing task allocation method.

[0107] The electronic device is manifested in the form of a general-purpose computing device. It may contain one or more processors that work collaboratively. This invention also does not preclude distributed processing, meaning that processors may be distributed across different physical devices. The electronic device of this invention is not limited to a single entity, but may also be the sum of multiple physical devices.

[0108] The memory stores a computer-executable program, typically machine-readable code. The computer-readable program can be executed by the processor to enable the electronic device to perform the method of the present invention, or at least some steps of the method.

[0109] The memory includes volatile memory, such as random access memory (RAM) and / or cache memory, and may also be non-volatile memory, such as read-only memory (ROM).

[0110] Optionally, in this embodiment, the electronic device further includes an I / O interface for exchanging data with external devices. The I / O interface can represent one or more of several bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0111] The electronic device of the present invention may also include elements or components. For example, some electronic devices also include display units such as a display screen, and some electronic devices also include human-computer interaction elements such as buttons and keyboards. Any electronic device capable of executing a computer-readable program in memory to implement the method of the present invention or at least some steps of the method can be considered as an electronic device covered by the present invention.

[0112] The computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0113] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0114] This embodiment also provides a computer-readable medium storing a computer-executable program, which, when executed, implements the anti-cheating crowdsourcing task allocation method.

[0115] The computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0116] From the above description of the embodiments, those skilled in the art will readily understand that the present invention can be implemented by hardware capable of executing specific computer programs, such as the system of the present invention, and the electronic processing unit, server, client, mobile phone, control unit, processor, etc. included in the system. The present invention can also be implemented by computer software that executes the methods of the present invention, for example, by control software executed by a microprocessor, electronic control unit, client, server, etc. However, it should be noted that the computer software executing the methods of the present invention is not limited to execution in one or a specific set of hardware entities; it can also be implemented in a distributed manner by unspecified hardware. For computer software, the software product can be stored in a computer-readable storage medium (such as a CD-ROM, USB flash drive, portable hard drive, etc.) or distributed across a network, as long as it enables electronic devices to execute the methods according to the present invention.

[0117] The above embodiments are only used to illustrate the present invention and are not intended to limit the technical solutions described herein. Although the present invention has been described in detail with reference to the above embodiments, the present invention is not limited to the specific embodiments described above. Therefore, any modifications or equivalent substitutions to the present invention, as well as all technical solutions and improvements that do not depart from the spirit and scope of the invention, are covered within the scope of the claims of the present invention.

Claims

1. An anti-cheating crowd-sourcing task allocation method, characterized in that, The method comprises the following steps: The to-be-released crowdsourcing tasks are cached to form a task pool, and the to-be-released crowdsourcing tasks in the task pool are called to be randomly released; The anti-cheating crowdsourcing task allocation method comprises a crowdsourcing task distribution strategy, and the crowdsourcing task distribution strategy comprises: Distribution strategy one: when a new judgment question crowdsourcing task is created, the number of tasks is set to determine the batch of crowdsourcing task release, the number of tasks released per batch, and the time point of release, while completing the new crowdsourcing task, all crowdsourcing tasks are set to be evenly distributed into N parts, and the crowdsourcing tasks are released in batches at the set time interval; Or distribution strategy two: set the distribution time T0 of the crowdsourcing task, when the new crowdsourcing task is created, the crowdsourcing tasks are randomly distributed at an uncertain time point, and the number of distributed crowdsourcing tasks is obtained after the distribution time T0 from the creation of the crowdsourcing task, if the proportion of the number of distributed crowdsourcing tasks to the total number of crowdsourcing tasks is greater than the set value, it is considered that the distribution of the judgment question crowdsourcing task is completed, otherwise, another distribution time T0 is executed, until the crowdsourcing tasks of the question are completely distributed, if the distribution is not completed after multiple T0, the crowdsourcing task in the task pool is executed to complete the distribution strategy; The to-be-released crowdsourcing task is a judgment question crowdsourcing task, a certain number of judgment question crowdsourcing tasks with the same content are cached, and after a certain time of caching, a certain number of other judgment question crowdsourcing tasks with the same content are mixed to form a task pool of judgment question crowdsourcing tasks with different contents; The judgment question crowdsourcing tasks in the task pool are randomly called to be released at the same release time period; A certain number of first judgment question crowdsourcing tasks and a certain number of second judgment question crowdsourcing tasks are respectively cached to form a task pool of mixed first judgment question crowdsourcing tasks and second judgment question crowdsourcing tasks, and the content of the questions of the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks is different; The first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks are called to be released at the same release time period; And / or, the first judgment question crowdsourcing tasks and the second judgment question crowdsourcing tasks are randomly allocated to different release time periods for release; The to-be-released crowdsourcing task comprises a poison task for verifying whether cheating occurs: The poison task contains verification information, when the verification information fails to pass the verification, it is judged that the operation is abnormal, and the associated user behavior of the abnormal operation ID is obtained to determine whether cheating occurs; The associated user behavior of the abnormal operation ID comprises the pass rate of historical poison task verification.

2. The anti-cheating crowd-sourcing task allocation method of claim 1, wherein, The calling of the to-be-allocated crowdsourcing tasks in the task pool for random release comprises: Different types and / or different contents of to-be-released crowdsourcing tasks are randomly called to be released at the same release time period; And / or, the same type and / or the same content of to-be-released crowdsourcing tasks are randomly allocated to different release time periods for release.

3. The anti-cheating crowd-sourcing task allocation method of claim 1, wherein, When a certain number of judgment question crowdsourcing tasks with the same content are all distributed, after a preset time, the answers of all submitted judgment question crowdsourcing tasks are obtained, the proportions of various answers are integrated, and the answer of the judgment question crowdsourcing task of the content of the question is determined.

4. The anti-cheating crowdsourcing task allocation method of claim 3, wherein, When the proportion of an answer of a submitted judgment question crowdsourcing task exceeds a set value, the answer is determined as the answer of the judgment question crowdsourcing task of the content of the question.

5. The anti-cheating crowd-sourcing task allocation method of claim 1, wherein, The poisoning task is a judgment question crowdsourcing task with a known answer: The operation of receiving a submitted reply to the poisoning task verifies the reply to the poisoning task through the known answer. If the verification is passed, it is determined as a normal operation, and if the verification fails, it is determined as an abnormal operation.

6. An anti-cheating crowd-sourcing task allocation apparatus characterized by comprising: It includes: A cache module caches the to-be-distributed crowdsourcing tasks to form a task pool; and a calling and distributing module calls the to-be-distributed crowdsourcing tasks in the task pool for random distribution; The crowdsourcing task distribution strategy includes: Distribution strategy one: when a new judgment question crowdsourcing task is created, the number of tasks is set according to the batch number of the crowdsourcing task distribution, the number of tasks distributed in each batch, and the time point of distribution. When the new crowdsourcing task is completed, all crowdsourcing tasks are evenly distributed into N parts, and the crowdsourcing tasks are distributed in batches according to the set time interval; Or distribution strategy two: set the distribution time T0 of the crowdsourcing task. When the new crowdsourcing task is completed, the crowdsourcing tasks are distributed in an uncertain time point according to a random distribution strategy. After the distribution time T0 from the creation of the new crowdsourcing task, the number of distributed crowdsourcing tasks is obtained. If the proportion of the number of distributed crowdsourcing tasks relative to the total number of crowdsourcing tasks is greater than a set value, it is considered that the distribution of the judgment question crowdsourcing task has been completed. Otherwise, another distribution time T0 is executed until all crowdsourcing tasks of the question are distributed. If the distribution is not completed after multiple T0, the crowdsourcing tasks in the task pool are executed for a full distribution strategy; The to-be-distributed crowdsourcing task is a judgment question crowdsourcing task. A certain number of judgment question crowdsourcing tasks with the same content are cached. After a certain time, the cached tasks are mixed with a certain number of other judgment question crowdsourcing tasks with the same content to form a task pool of judgment question crowdsourcing tasks with different contents. Randomly call the judgment question crowdsourcing tasks in the task pool for distribution in the same distribution period. A certain number of first judgment question crowdsourcing tasks and a certain number of second judgment question crowdsourcing tasks are cached to form a task pool of mixed first judgment question crowdsourcing tasks and second judgment question crowdsourcing tasks. The content of the first judgment question crowdsourcing task is different from that of the second judgment question crowdsourcing task. The first judgment question crowdsourcing task and the second judgment question crowdsourcing task are called for distribution in the same distribution period. And / or, the first judgment question crowdsourcing task and the second judgment question crowdsourcing task are randomly distributed to different distribution periods for distribution. The to-be-distributed crowdsourcing task includes a poisoning task for verifying whether cheating occurs: The verification information is contained in the poisoning task, and when the verification information fails to pass the verification, it is determined as abnormal operation, and the associated user behavior of the abnormal operation ID is obtained to determine whether cheating occurs; The associated user behavior of the abnormal operation ID includes a passing rate of historical poisoning task verification. 7.An electronic device comprising a processor and a memory, the memory configured to store a computer executable program, the computer executable program comprising program instructions that, when executed by the processor, cause the processor to perform any one of the methods of claim 1-5. The computer executable program is executed to implement the method of claim 1-5.

8. A computer readable medium storing a computer executable program, characterized in that, The computer executable program is executed to implement the method of claim 1-5.

Images