Assessment Management System for Consistent Grading

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computer-based assessment management systems face challenges in ensuring consistency in marking across student answers and providing effective feedback, despite advancements in technology.

Innovation Solution

A computer-implemented method and system that allows users to select portions of answers, assign grades and feedback, and associate them with criteria, while displaying indications of grades and enabling users to modify assignments, thereby improving consistency and feedback quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional paper-based marking methods are used, then markers can provide feedback within answers or margins, but consistency amongst assessment scores deteriorates

Engineering Contradiction:
Improveconsistency amongst assessment scoresVSAvoidfeedback provision within answers
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

A computer-based marking system acts as an intermediary between markers and assessments, providing structured guidance through marking guides and criteria frameworks. The system mediates the marking process by enforcing consistent application of grading criteria across multiple assessments while maintaining the ability to provide detailed feedback through digital comments and annotations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system transforms the marking process from unstructured paper-based commentary to structured digital data with defined parameters. Grades are assigned according to specific criteria with measurable parameters, enabling consistent comparison across assessments while maintaining feedback capability through structured comment fields associated with specific criteria.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If computer-based systems are used for assessment management, then paper management is reduced and collection of answers and grades is improved, but consistency in marking across student answers deteriorates

Engineering Contradiction:
Improvecollection of answers and gradesVSAvoidconsistency in marking
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

Marking guides and criteria are prepared in advance within the computer-based system, establishing consistent grading standards before assessments are marked. The system pre-configures grading frameworks that guide markers through the assessment process, ensuring consistent application of criteria across all student answers while enabling efficient digital collection and processing.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If existing computer-based systems provide allocation of marks according to marking guide, then grading efficiency is improved, but useful feedback to students deteriorates

Engineering Contradiction:
Improvegrading efficiencyVSAvoiduseful feedback to students
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system segments feedback into criterion-specific components, allowing detailed comments to be associated with individual grading criteria rather than providing only aggregate scores. This segmentation enables efficient automated mark allocation while preserving rich, actionable feedback for students about their performance on specific aspects of the assessment.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10672287B2Method and system for managing assessments
Publication Date: 2020.06.02 VAN HARMELEN MARK
  • US10672287B2 patent drawing
  • US10672287B2 patent drawing
  • US10672287B2 patent drawing

AI summary

The present invention relates to a method of managing an assessment, including selecting a portion or position in an answer to a question of one or more questions within an assessment in response to a first user input; assigning a grade and/or feedback to the selected portion or position in response to a second user input; and associating the grade and/or feedback to one of a plurality of criteria in response to a third user input. Other methods and systems for managing an assessment are also disclosed.