Reference-Figure Scoring Criteria for Cartesian Drawing Questions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing automatic scoring systems for drawing-based questions in CBT impose restrictions on the degree of freedom, leading to ineffective measurement of examinees' understanding and potential errors in setting scoring criteria.
Innovation Solution
A scoring system that generates and applies scoring criteria using a client-server architecture, allowing for the definition of scoring criteria through reference figures and logical operations on a coordinate plane, enabling flexible and accurate scoring of drawing-based answers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If restrictions are imposed on the degree of freedom in drawing answers, then automatic scoring can be achieved with simple scoring criteria, but the effectiveness of measuring examinees' understanding is reduced
Solution Approach 1:
The scoring system dynamically adjusts the degree of freedom in answering. It provides a snap technique that limits selectable points to integer coordinates when simple automatic scoring is needed, while also allowing free coordinate input when more precise measurement of understanding is required. This dynamic adaptation resolves the contradiction by making the system flexible enough to handle both automated simplicity and measurement precision depending on the specific testing context.
2Measurement precision
If the degree of freedom in answering is increased, then measurement of examinees' understanding is improved, but scoring criteria setting becomes more complex and error-prone
Solution Approach 1:
The patent introduces an intermediary mechanism - the snap technique - that mediates between free coordinate input and automated scoring. When free coordinate input is used to improve measurement precision, the snap technique automatically snaps coordinates to integer values, providing a bridge that maintains scoring simplicity while allowing flexibility in answering. This intermediary resolves the contradiction by automatically handling the complexity of scoring criteria setting.
3Ease of operation
If conventional methods of specifying scoring criteria by user input of numerical values are used, then scoring criteria can be set, but errors are likely to occur and the process becomes troublesome
Solution Approach 1:
The system implements self-service by automatically generating scoring criteria based on the reference figure drawn by the user. Instead of requiring manual numerical input, the system automatically extracts coordinate information from the visual reference figure and generates the scoring criteria. This self-service mechanism resolves the contradiction by eliminating manual input errors while maintaining ease of operation - the user simply draws the reference figure and the system handles the complex numerical extraction and criteria generation automatically.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
An information processing apparatus includes a processor that executes a program stored in a storage and generates scoring criterion information. The scoring criterion information is referenced in a scoring process of an answer figure to a problem that requires drawing of a figure in a Cartesian coordinate system. The Cartesian coordinate system is a coordinate plane or a coordinate space. In response to a reference figure being drawn in the Cartesian coordinate system based on a user operation, the scoring criterion information including information on a scoring criterion determined based on the reference figure is generated. The Cartesian coordinate system is displayed on a display.