Serious Game Rubric Evaluation for Measurable Wargame Learning

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional wargame design methods lack objective evaluation criteria, repeatability, and measurable learning objectives, leading to flawed designs and unintended consequences in addressing complex, messy problems.

Innovation Solution

A serious game and evaluation apparatus that integrates system dynamics modeling and wargaming to provide a dynamic simulation model, utilizing a rubric management model to assess systems thinking and critical thinking changes in users, with a scoring guide to evaluate learning outcomes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional wargame design methods use subjective opinions based on qualitative models to determine key variables and relationships, then the design process is flexible and adaptable to different scenarios, but the evaluation of design quality and learning outcomes lacks objectivity and measurability

Engineering Contradiction:

Improveadaptability of wargame design to different scenariosVSAvoidobjectivity of design evaluation

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent transforms the evaluation of systems thinking from a subjective qualitative assessment to an objective quantitative measurement by defining specific parameters and dimensions (e.g., system boundaries, feedback loops, delays, stocks and flows). These parameters allow for standardized scoring and comparison across different wargame designs while maintaining adaptability to various scenarios through configurable assessment criteria.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The patent introduces an intermediary assessment framework that mediates between the subjective wargame design process and objective evaluation requirements. This framework includes standardized rubrics, scoring guides, and evaluation protocols that translate subjective design decisions into measurable outcomes, enabling both flexibility in design and objectivity in assessment.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Loss of information

If conventional wargames are used to explore complex systems and messy problems, then they can provide qualitative insights and strategic understanding, but they lack repeatability and cannot objectively measure learning outcomes

Engineering Contradiction:

Improvequalitative insights from wargamingVSAvoidrepeatability of wargame results

Core Design Contradiction:

Loss of informationVSReliability

Solution Approach 1:

The patent implements feedback mechanisms through standardized assessment rubrics that systematically capture and measure changes in participants' systems thinking before and after wargame engagement. This feedback loop enables quantitative tracking of learning outcomes across multiple sessions and participants, providing reliable data on whether specific learning objectives were achieved while preserving the qualitative insights gained during gameplay.

Inventive Principle:

Principle #23Feedback

3Adaptability or versatility

If conventional wargame design focuses on exploring messy problems through qualitative models, then it can address complex real-world scenarios, but it cannot objectively evaluate design flaws or compare different games exploring the same problem

Engineering Contradiction:

Improveability to address complex real-world scenariosVSAvoidevaluation of design quality

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent segments the evaluation of wargame design into distinct dimensions and criteria (e.g., system boundaries, feedback loops, delays, stocks and flows, learning objectives). This segmentation allows for systematic assessment of each component's quality and completeness, enabling precise identification of design flaws and objective comparison across different games while maintaining the ability to address complex real-world scenarios through comprehensive coverage of these segments.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS20260045172A1Method And Apparatus For Serious Game Execution And Evaluation

Publication Date: 2026.02.12 WORCESTER POLYTECHNIC INSTITUTE

AI summary

Embodiments of the innovation relate to a serious game and evaluation apparatus configured to execute a rubric management model for evaluation of changes to critical thinking of game participants of a serious game to inform and measure learning objectives. When executing the rubric management model, the serious game and evaluation apparatus can measure changes to dimensions of systems thinking of game participants while exploring a complex system and messy problem of interest. As such, the serious game and evaluation apparatus provides a measurement tool to inform and evaluate learning objectives for serious gaming. In one arrangement, the serious game and evaluation apparatus is configured to generate, as the serious game, a dynamic simulation model which integrates both system dynamics modeling and wargaming to provide simulation of a complex system and messy problems.