Online Exam Proctoring System Using Segmented Audio Video Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current online exam proctoring tools require dedicated browsers, devices, or high bandwidth, making it difficult to monitor multiple factors effectively without compromising system integrity.
Innovation Solution
An AI-driven system that collects reference samples of a student's speech and video of them looking at their computer screen, then captures and segments audio and video during the exam to identify potential cheating by comparing these segments to the reference samples.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If current monitoring tools are used to capture necessary information, then monitoring capability is improved, but device complexity and bandwidth requirements increase
Solution Approach 1:
The system uses the student's existing computer and camera for multiple functions: capturing reference video/audio samples, monitoring during the exam, detecting cheating behaviors, and comparing against reference data. This eliminates the need for dedicated proctoring devices while maintaining comprehensive monitoring capability.
Solution Approach 2:
The system creates a reference copy (video and audio samples) of the student's appearance and voice before the exam. During the exam, real-time video and audio are compared against this reference copy to detect discrepancies indicating cheating, such as face swaps or voice changes, without requiring additional specialized hardware.
2Reliability
If current monitoring tools are used to capture necessary information, then monitoring capability is improved, but bandwidth requirements increase
Solution Approach 1:
The system segments the video and audio streams into frames and audio segments, processing only these discrete units rather than transmitting the entire continuous stream. This allows for more efficient bandwidth utilization while maintaining the ability to detect cheating patterns through analysis of individual segments.
Solution Approach 2:
The system extracts key features from the video and audio data, such as facial recognition data, voice characteristics, and gaze direction, rather than transmitting the complete raw data streams. This extraction approach reduces bandwidth requirements significantly while preserving the essential information needed for cheating detection.
3Measurement precision
If reference samples and segmentation comparison are used, then cheating detection accuracy is improved, but processing time increases
Solution Approach 1:
The system collects reference video and audio samples from the student before the exam begins, establishing a baseline of their appearance and voice characteristics. This preliminary action allows for rapid comparison during the actual exam without requiring complex real-time analysis, thereby reducing processing time while maintaining high detection accuracy.
Solution Approach 2:
The system replaces manual review of exam footage with automated AI-based analysis that uses machine learning models to quickly identify cheating patterns. This substitution of mechanical manual review with automated intelligent systems significantly reduces processing time while improving detection consistency and accuracy.
Data Source
AI summary
Systems and methods are provided for proctoring online exams that collects reference samples of a student's speech and video of them looking at their computer screen. Audio and video of the student are then captured during the exam. That audio and video is segmented and compared to the reference samples in order to identify segments that potentially contain at least one of another speaker who is not the student, the student looking away from the computer screen, another face that is not the student's. The frequency and severity of flagged segments are used to indicate the overall level of suspicion to an exam proctor.