Automated Grading System Using Modular Policy Aggregation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing e-Learning systems face challenges in efficiently combining and assessing various grade objects to determine an individual's overall performance or proficiency, lacking flexibility and automation in grading processes.

Innovation Solution

A method and system for processing grade objects involve applying contributor policies, aggregators, and result policies to generate aggregate and result grade objects, allowing for weighted scoring, exclusion of high or low grades, and conversion to discrete values, which are stored, displayed, or sent to devices, facilitating flexible assessment structures and automated grading.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple grade objects are combined to assess overall performance, then assessment accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveassessment accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the grading process into distinct components: contributor policies (for processing individual grade objects), aggregators (for combining grades), and result policies (for final processing). Each component handles a specific aspect of the grading workflow, making the complex task of combining multiple grade objects manageable and configurable through modular policy applications.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If flexible grading options are provided (weighted scoring, exclusion policies), then adaptability is improved, but processing complexity increases

Engineering Contradiction:
Improvegrading flexibilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements dynamic grading configurations where contributor policies and result policies can be selectively applied based on assessment requirements. Policies such as weighting schemes, exclusion rules for high/low grades, and discrete value conversions can be activated or deactivated dynamically, allowing the system to adapt to different grading scenarios without requiring a completely different processing structure.

Inventive Principle:
Principle #15Dynamics

3Productivity

If automated grading processing is implemented, then productivity is improved, but implementation complexity increases

Engineering Contradiction:
Improvegrading efficiencyVSAvoidimplementation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The automated grading system operates autonomously by automatically applying contributor policies to process grade objects, using aggregators to combine results, and implementing result policies to generate final assessments. The system self-manages the entire grading workflow without requiring manual intervention at each step, thereby improving productivity while the complexity is encapsulated within the automated processing logic.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240379020A1Systems and methods for electronic prediction of rubric assessments
Publication Date: 2024.11.14 DESIRE2LEARN
  • US20240379020A1 patent drawing
  • US20240379020A1 patent drawing
  • US20240379020A1 patent drawing

AI summary

Various embodiments are described herein that generally relate to a system and method for processing a plurality of grade objects to determine a value for an intermediate result grade object or a final result grade object according to an assessment structure. This may be accomplished by obtaining values for a plurality of grade objects and applying various policies and aggregator functions to these values based on the assessment structure.