AI Test Monitoring With Dynamic Risk-Based Proctoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current test administration systems rely on universal, expensive, and inefficient human proctoring, fail to assess individual test event risks, are prone to technological cheating, and allow proxy testing, limiting accessibility and security.
Innovation Solution
A computer-based test monitoring system using AI-enabled computer vision and risk analytics dynamically allocates security resources based on individual and location-specific risk factors, detecting cheating through body movement analysis and preventing proxy testing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If universal human proctoring is applied to all test events, then test security is maintained, but test administration costs increase significantly
Solution Approach 1:
The system dynamically adjusts security monitoring levels based on real-time risk assessment of individual test events. Instead of applying static universal proctoring, the system continuously evaluates risk factors (test type, location, taker history, environmental conditions) and adjusts the intensity of monitoring accordingly, transitioning between automated and human proctoring modes as needed
Solution Approach 2:
The system applies differentiated security measures to different test events based on their specific risk profiles. High-risk events receive enhanced human proctoring while low-risk events use automated monitoring, ensuring that security resources are allocated where they are most needed rather than uniformly across all events
2Loss of energy
If automated monitoring is used, then test administration costs are reduced, but detection precision of cheating behavior decreases
Solution Approach 1:
The system uses AI-based computer vision technology as an intermediary between automated monitoring and human proctoring. The AI system performs initial analysis of test-taker behavior, environmental conditions, and test patterns, flagging suspicious activities for human review. This intermediary layer enables automated monitoring to maintain high detection precision by filtering and prioritizing cases that require human judgment
Solution Approach 2:
The system replaces manual human proctoring with AI-based computer vision and risk analytics technology. The AI system automatically analyzes video feeds, detects suspicious behaviors (eye movements, head positions, unauthorized objects), and evaluates test-taking patterns, substituting the mechanical human proctoring process with an automated intelligent system that maintains detection precision while reducing costs
3Productivity
If risk assessment is performed for individual test events, then security resource allocation is optimized, but system complexity increases
Solution Approach 1:
The risk assessment system is segmented into multiple independent modules that evaluate different risk factors separately (test characteristics, location factors, taker history, environmental conditions). Each module processes specific data types and contributes to the overall risk score, allowing the complex assessment to be broken down into manageable, independently developable components that can be combined to optimize security resource allocation
Data Source
AI summary
A system and process for dynamic security monitoring of test taking. The system combines historical information about the test taker or relevant conditions, and includes sensors which objectively monitor test taker's actions, inactions, and involuntary response to the test given before and during the test, and at a specific test location. The information collected from the sensors is compared to a plurality of predetermined individual risk factors, which indicate a possibility of test fraud by the individual test taker to create a test event risk profile. The individual risk profile is combined with non-individual specific risk factors to create a holistic test event security profile. Security resources are then dynamically assigned to or removed from the test event based on the unique test event security profile.


