Automated Tasking System for Crowdsourcing Accuracy and Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Crowdsourcing for large data problems faces challenges such as incomplete, imprecise, and time-consuming task completion, leading to increased costs and resource wastage due to inefficient manual pairing and compensation of individuals for data input tasks.
Innovation Solution
A tasking system that includes a targeting module for user profiling, a prediction module for task assignment based on past performance, an assignment module for workflow management, and an assessment module for quality control, ensuring accurate and efficient task completion by assigning tasks to the most suitable users and monitoring progress.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If crowdsourcing is used to solve large data problems by breaking them into smaller tasks, then the large data problem can be completed through individual contributions, but the smaller tasks may not be completed correctly leading to incorrect completion of the large data problem
Solution Approach 1:
The system implements automated accuracy assessment that provides feedback on task completion quality. The assessment module evaluates whether submitted data points meet predefined accuracy criteria, and this feedback is used to determine whether tasks need to be redone, thereby improving overall reliability while maintaining productivity.
Solution Approach 2:
The system performs preliminary actions by pre-defining accuracy criteria and expected data point ranges before tasks are assigned. This allows the assessment module to automatically evaluate task completions against these pre-established standards, ensuring correctness without requiring manual review of each task.
2Speed
If the crowd is compensated to increase speed of input, then the speed of data input increases, but the costs become cost prohibitive and results may still be unacceptable
Solution Approach 1:
The system implements self-service through automated accuracy assessment that evaluates task completions without requiring expensive manual review. The assessment module automatically determines whether data points are correct based on pre-defined criteria, eliminating the need for costly human verification while maintaining high input speed.
Solution Approach 2:
The system replaces the mechanical system of manual task verification with an automated computational assessment module. This substitution eliminates the need for expensive human reviewers while maintaining accurate evaluation of task completions, thereby reducing costs while preserving speed.
3Reliability
If manual pairing of individuals and tasks is performed to ensure correct completion, then task assignment accuracy may improve, but the process becomes time consuming and inefficient
Solution Approach 1:
The system replaces manual task assignment with an automated assignment module that uses algorithms to match tasks with appropriate crowd members. This computational approach maintains reliable task assignment by considering relevant criteria while eliminating the time-consuming nature of manual pairing processes.
Solution Approach 2:
The assignment module operates autonomously to match tasks with suitable individuals based on predefined criteria and historical performance data. This self-service capability eliminates the need for manual intervention in task assignment while maintaining high accuracy in matching tasks with capable workers.
4Measurement precision
If data is not analyzed quickly to determine whether it is within proper margin of expected results, then thorough analysis can be performed, but the data ultimately becomes unusable and requires redoing tasks
Solution Approach 1:
The system performs preliminary actions by pre-defining acceptable data ranges and accuracy criteria before data collection begins. This allows the assessment module to quickly evaluate incoming data against these pre-established standards, providing thorough analysis through automated comparison while enabling rapid determination of whether data points are correct.
Solution Approach 2:
The system replaces thorough but time-consuming manual data analysis with automated computational assessment. The assessment module rapidly evaluates data points against pre-defined criteria using computational methods, achieving both thoroughness in evaluation and speed in processing that eliminates the need to redo tasks.
Data Source
AI summary
Disclosed is a tasking system to assign individuals to tasks. The tasking system targets a user for the task based information in a user profile such as demographics, background and reputation of the user to perform a task. The tasking system predicts if a user will do a given task well based on a user's background, user's skill, and applied predictive algorithms. The tasking system manages the workflow of the task, assesses the probability of the user's answer being accurate, and continuously optimizes assignment and assessment of the task to improve data quality.