Equation Grading via Syntax Tree Structural Normalization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current participant response systems are inadequate for grading equation-based assessments accurately, as they rely on simple string comparison, leading to errors due to multiple valid solutions not being recognized.

Innovation Solution

A computerized grading method that creates syntax trees for both the response and the solution, comparing them to determine equivalence, allowing for grading based on the structural and algebraic normalization of equations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If simple string comparison is used for grading, then the grading process is simple and fast, but grading accuracy deteriorates due to inability to recognize multiple valid solutions

Engineering Contradiction:
Improvegrading speedVSAvoidgrading accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces syntax trees as an intermediary data structure between the participant's response string and the solution string. The syntax tree parser converts both strings into standardized tree representations that capture mathematical structure, enabling accurate comparison while maintaining automated processing. This intermediary structure resolves the contradiction by providing both speed (through automated parsing) and accuracy (through structural normalization).

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the representation parameter from raw string form to normalized syntax tree form. By transforming both responses and solutions into a common structural representation where equivalent mathematical expressions map to identical tree structures, the system achieves accurate recognition of multiple valid solutions while maintaining efficient automated grading.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If string comparison is used, then the system complexity is low, but the ability to detect mathematical equivalence deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidequivalence detection reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent segments the mathematical expression into constituent parts (operators, operands, parentheses) and organizes them into a hierarchical syntax tree structure. This segmentation allows the system to compare mathematical equivalence at multiple levels of the tree structure, reliably detecting equivalent expressions while maintaining manageable system complexity through modular parsing logic.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces the mechanical string-matching approach with a symbolic parsing and normalization system. Instead of directly comparing character sequences, the system uses syntax tree construction and traversal algorithms to detect mathematical equivalence, significantly improving reliability while keeping the system computationally manageable.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of time

If automated grading is implemented, then grading time is reduced, but grading accuracy deteriorates due to inability to handle multiple valid solutions

Engineering Contradiction:
Improvegrading timeVSAvoidgrading accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The syntax tree serves as an intermediary that enables automated systems to accurately handle multiple valid solutions. By converting both responses and solutions into normalized tree structures, the automated grader can reliably compare mathematical equivalence without time-consuming manual review, simultaneously achieving speed and accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the data representation parameter from raw strings to normalized syntax trees, enabling automated grading to accurately recognize multiple valid mathematical solutions. This parameter transformation allows the system to maintain both rapid automated processing and high grading accuracy.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9117375B2Equation-based assessment grading method and participant response system employing same
Publication Date: 2015.08.25 SMART TECH INC (CA)
  • US9117375B2 patent drawing
  • US9117375B2 patent drawing
  • US9117375B2 patent drawing

AI summary

A computerized assessment grading method comprises creating a syntax tree for a received equation-based response to at least one assessment question and a syntax tree for at least one solution to the at least one question, comparing the syntax trees, and grading the response based on the results of the comparison.