Rules-Based Answer Script Mapping to Eligible Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing digital marking systems lack the ability to apply specific rules for assigning answer scripts to markers and do not consider factors that impact marking quality and schedule, leading to inefficiencies and inaccuracies in the evaluation process.
Innovation Solution
A processor-implemented method and system for rules-based mapping of answer scripts to markers, which preprocesses scripts to generate metadata, analyzes pre-defined rules, calculates productivity metrics for markers, and uses logistic regression to assign scripts to the most eligible markers based on expertise and availability, ensuring high marking standards and accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If round robin mechanism is used for assigning answer scripts to markers, then the assignment process is simple and fast, but it does not accommodate specific requirements and rules for answer script assignment
Solution Approach 1:
The system transitions from a static round-robin assignment mechanism to a dynamic rule-based assignment system that can adapt to different requirements. The assignment logic changes from fixed sequential distribution to flexible rule-driven distribution, allowing the system to accommodate various marking requirements while maintaining efficiency.
Solution Approach 2:
The system introduces multiple parameters for marker selection including expertise matching, availability status, marking quality metrics, and workload distribution. These parameters enable the system to evaluate and select markers based on comprehensive criteria rather than simple sequential assignment, resolving the contradiction between simplicity and adaptability.
2Adaptability or versatility
If manual routing data entry is required, then the system can accommodate custom requirements, but it increases administrative burden and processing time
Solution Approach 1:
The system enables self-service through automated rule analysis and marker selection. Instead of requiring administrators to manually configure routing data, the system automatically analyzes answer script attributes, applies predefined rules, and selects appropriate markers, eliminating administrative burden while maintaining custom requirement accommodation.
Solution Approach 2:
The system performs preliminary actions by pre-configuring rule sets and marker profiles before the actual assignment process. This preparation work is done once and reused across multiple assignments, reducing the time required for each individual assignment while maintaining the ability to handle custom requirements.
3Device complexity
If traditional marking systems are used, then the process is straightforward, but they do not consider factors impacting marking quality and schedule
Solution Approach 1:
The system implements feedback mechanisms by continuously monitoring marker performance metrics including marking quality, speed, and accuracy. This feedback is used to dynamically adjust marker assignments and provide real-time insights, ensuring consistent marking quality while maintaining system manageability through automated control loops.
Solution Approach 2:
The system replaces manual administrative processes with automated computational mechanisms. Instead of human administrators manually managing assignments and quality control, the system uses algorithms to analyze attributes, apply rules, and optimize assignments, improving reliability while keeping the interface simple for users.
4Productivity
If answer scripts are not pre-processed and metadata is not generated, then the processing pipeline is shorter and faster, but specific rules cannot be applied and mapping accuracy decreases
Solution Approach 1:
The system performs preliminary processing of answer scripts including attribute extraction, metadata generation, and rule analysis before the actual mapping process. This preparation ensures that all necessary information is available for accurate rule-based assignment, improving mapping precision without significantly impacting overall processing time through efficient pipeline design.
Data Source
AI summary
Existing digital marking systems employ round robin mechanism for assigning candidate responses to faculty members for correction which may require manually feeding routing data. These mechanisms do not accommodate specific requirements when rules are to be applied for answer scripts assignment to markers and do not take into consideration marking quality and schedule. Present disclosure provides systems and methods that achieve high marking standards by assigning answer script to a most eligible marker wherein parts of answer script are assigned to most eligible domain marker in case of segmented marking. Marker and answer script attributes are captured that form part of assignment rules thus enabling creation of conditions. Marker profiles are generated based on expertise and availability. Marker's submissions and past performance are analysed, and best suited markers are evaluated and ranked for correcting answer script, thereby ensuring highest possible level of marking quality and accuracy within stipulated time frame.