Dynamic Test Item Generation for Adaptive Assessment Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computer systems for educational testing are inflexible, leading to biased and inaccurate results, and waste processing power and memory resources by generating, administering, and storing inaccurate content.

Innovation Solution

A dynamic content generation system that uses templates with parameterized variables and user information to create customized sets of items for each user, ensuring contextual relevance and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional computer systems use fixed, pre-defined test content, then system complexity is reduced and ease of operation is improved, but adaptability deteriorates and measurement precision deteriorates due to bias and inaccuracy

Engineering Contradiction:
Improvecontent adaptabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically generates test content at runtime based on user profiles and performance data, transitioning from static pre-defined content to dynamic adaptive content. The content delivery system adjusts question difficulty, type, and topic based on real-time user responses, making the system flexible and adaptive without requiring complex manual configuration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes multiple parameters simultaneously including question difficulty level, topic area, question type, and content presentation based on user performance metrics. By varying these parameters dynamically, the system achieves high adaptability while using standardized generation algorithms that prevent excessive complexity.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If conventional systems administer standardized content to all users, then ease of operation is improved and device complexity is reduced, but measurement precision deteriorates due to biased and inaccurate results

Engineering Contradiction:
Improveassessment accuracyVSAvoidcontent delivery complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The content delivery system automatically adjusts and personalizes content based on user responses and performance data without requiring manual intervention. The system self-regulates by analyzing user answers and dynamically selecting subsequent content, achieving high measurement precision while maintaining ease of operation through automation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors user responses and uses this feedback to adjust content selection, difficulty level, and presentation. This closed-loop feedback mechanism ensures accurate measurement of user knowledge and skills while the automated feedback processing keeps operational complexity manageable.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If conventional systems generate and store extensive content libraries, then adaptability is improved, but loss of substance increases due to wasted processing power and memory resources on inaccurate content

Engineering Contradiction:
Improvecontent flexibilityVSAvoidresource waste
Core Design Contradiction:
Adaptability or versatilityVSLoss of substance

Solution Approach 1:

The content library is segmented into modular components with defined difficulty levels, topic areas, and question types. This segmentation allows the system to assemble only the necessary subset of content for each user based on their profile and performance, achieving adaptability while minimizing resource consumption by not loading or processing the entire content library for every user.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system generates and processes only the partial content needed for each specific assessment instance rather than processing the entire content library. By applying partial action, the system maintains content flexibility and adaptability while significantly reducing waste of processing power and memory resources on unnecessary content generation and storage.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20250378765A1System and methods for improving user engagement and assessment validity by dynamically generating test items
Publication Date: 2025.12.11 UNIVERSITY OF KANSAS
  • US20250378765A1 patent drawing
  • US20250378765A1 patent drawing
  • US20250378765A1 patent drawing

AI summary

The present disclosure relates to systems, methods, and computer-readable media for a dynamic content generation system that efficiently, accurately, and flexibly generates dynamic sets of content items based on different sets of identified information. For example, the dynamic content generation system identifies a template of content items along with different sets of user information. Additionally, for each set of user information, the dynamic content generation system generates a personalized and unique set of dynamic content items by correlating pieces of user information from the given user with parameterized variables from the template of content items.