Random Clinical Trial Management System for LMS A/B Testing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Educators lack practical tools to systematically test and update instructional materials, leading to inefficient use of time and resources, as they often rely on unvetted recommendations or instincts rather than evidence-based methods to assess learning outcomes.

Innovation Solution

A random clinical trial management system integrated with learning management systems, enabling educators to design and implement randomized controlled trials and A/B testing through a user-friendly interface, randomly assigning students to control or variation educational modules and providing analysis results to inform instructional decisions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If educators rely on instincts and unvetted recommendations for instructional materials, then decision-making is simple and quick, but learning outcomes are not optimized and time is wasted on ineffective materials

Engineering Contradiction:
Improveassessment accuracyVSAvoidtesting system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary testing platform that mediates between educators and instructional materials. This platform automatically conducts A/B testing and randomized controlled trials, providing evidence-based recommendations without requiring educators to become researchers. The intermediary handles the complexity of experimental design, data collection, and analysis, while educators receive simplified actionable insights.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables instructional materials to self-demonstrate their effectiveness through automated testing. Materials are automatically assigned to different student groups, and the system collects and analyzes performance data without manual intervention. This self-service approach allows materials to prove their value through empirical evidence rather than requiring educators to manually evaluate each resource.

Inventive Principle:
Principle #25Self-service

2Productivity

If educators systematically test instructional materials through randomized controlled trials, then learning outcomes are optimized, but time and administrative resources are consumed

Engineering Contradiction:
Improvelearning effectivenessVSAvoidtesting duration
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically setting up experimental groups, assigning students to control and treatment conditions, and collecting data throughout the learning process. Rather than requiring educators to conduct post-hoc analysis, the system proactively implements the entire testing framework before instructional decisions are made, integrating assessment into the natural flow of teaching.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The testing process operates continuously alongside normal instruction rather than interrupting it. Students are randomly assigned to different material versions and proceed with their learning while data is automatically collected. This continuous action allows testing to occur in parallel with teaching, eliminating the need for separate testing sessions and maximizing the utilization of instructional time.

Inventive Principle:
Principle #20Continuity of useful action

3Ease of operation

If educators use distant textbook companies' decisions for instructional materials, then material selection is simplified, but adaptability to local classroom needs is reduced

Engineering Contradiction:
Improvematerial selection easeVSAvoidlocal customization
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system enables local quality by allowing different instructional materials to be tested and optimized for specific classroom contexts. Rather than imposing a single standardized curriculum from distant publishers, the platform allows educators to test multiple material versions and identify which works best for their particular students, preserving local adaptability while maintaining ease of operation through automated testing.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20230360746A1A/b testing and random clinical trials in learning management systems
Publication Date: 2023.11.09 WESTERN GOVERNORS UNIV
  • US20230360746A1 patent drawing
  • US20230360746A1 patent drawing
  • US20230360746A1 patent drawing

AI summary

A random clinical trial (RCT) management system is disclosed. The system includes a user interface, including a configuration interface configured to receive user input defining parameters for a randomized clinical trial and a dashboard interface configured to output results of the randomized clinical trial. The system includes an analysis engine configured to analyze data from a plurality of educational modules associated with a learning management system (LMS) course, including a control educational module and at least one variation educational module correlated to the control educational module Analyzing is performed based on user input received at the configuration interface. The analysis engine randomly assigns students interacting with the learning management system to one of the educational modules and reports analysis results to the dashboard interface. The system includes a communications interface configured to be coupled to an LMS.