Secure Online Exam Proctoring via Segmented Evaluation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Online examinations face challenges in ensuring security and accurately assessing practical skills due to the ease of cheating and limitations in evaluating hands-on proficiency, particularly in distance learning settings where proctoring is difficult and question-and-answer formats may not adequately demonstrate real-world competence.

Innovation Solution

A system and method for administering and proctoring secure online exams that include practical tasks, utilizing a testing server and secure computing devices to execute evaluation applications, which prevent unauthorized access and allow exam takers to perform tasks through evaluation applications or apparatuses, generating interaction data for competence assessment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If online examinations use question-and-answer format, then ease of administration and objectivity are improved, but accuracy in evaluating practical skills and real-world competence deteriorates

Engineering Contradiction:
Improveease of administrationVSAvoidaccuracy in evaluating practical skills
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The examination is divided into two distinct parts: a traditional question-and-answer section for theoretical knowledge assessment, and a practical task section where students must complete hands-on exercises using specialized software or equipment. This segmentation allows each section to serve its specific purpose - the Q&A portion maintains ease of administration while the practical portion accurately evaluates real-world competence.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A secure testing environment with specialized evaluation software acts as an intermediary between the student and the practical task. This intermediary system provides a controlled interface that captures student interactions with the practical tools while maintaining security and preventing cheating, thus enabling accurate assessment of practical skills in an online format.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If distance learning is implemented, then accessibility and flexibility are improved, but proctoring difficulty and security risk worsen

Engineering Contradiction:
ImproveaccessibilityVSAvoidproctoring difficulty
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system provides self-service proctoring features where the testing environment automatically monitors student behavior, tracks interactions with evaluation tools, and captures evidence of task completion. The system serves its own proctoring needs through automated detection mechanisms, eliminating the need for human proctors while maintaining security and assessment integrity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The testing system continuously monitors student actions during the practical examination and provides real-time feedback to both the system and the student. The system tracks whether students are following proper procedures, how they interact with evaluation tools, and provides immediate feedback on task completion status, thereby maintaining security and assessment accuracy in a distance learning environment.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If practical examination tasks are added, then accuracy in assessing hands-on proficiency is improved, but device complexity and examination structure worsen

Engineering Contradiction:
Improveaccuracy in assessing hands-on proficiencyVSAvoidexamination structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The evaluation software serves multiple functions simultaneously: it provides the practical examination interface, captures interaction data, monitors security compliance, and generates assessment results. This multi-functionality reduces the need for separate systems and simplifies the overall examination structure while maintaining accurate assessment of hands-on proficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9280907B2Proctored performance analysis
Publication Date: 2016.03.08 KRYTERION
  • US9280907B2 patent drawing
  • US9280907B2 patent drawing
  • US9280907B2 patent drawing

AI summary

Systems and methods described herein provide for administering and proctoring of a secure online exam that allows for complex testing utilizing practical examination tasks. The practical examination tasks provide for evaluation of the knowledge of the exam taker, as well as the exam taker's ability to apply that knowledge in a real-world environment. By performing the practical examination tasks in the context of a secure online exam, the competence of the test taker can be readily determined without worrying about the exam taker illicitly accessing information on their computer or via a remote source of data. The exam taker may perform the practical examination tasks through manipulation of an evaluation application executing on the exam taker's secured computer. The practical examination tasks may also be carried out through manipulation by the exam taker of an evaluation apparatus coupled to the exam taker's secured computer.