Program, information processing system, information processing device and information processing method

Abstract

An information processing device, an information processing system, a program, and an information processing method are provided that enable easy setting of grading criteria for questions that require drawing a figure. [Solution] The information processing device has a processing unit that generates scoring criteria information that is referenced in the scoring process of answer figures to questions that require figures to be drawn in a coordinate plane or a coordinate space, which is a Cartesian coordinate system.The processing unit draws a reference figure in the Cartesian coordinate system displayed on the display unit based on user operation, and generates scoring criteria information that includes information related to the scoring criteria determined based on the reference figure.

Description

[Technical Field]

[0001] The present invention provides program ,Information Processing Systems, Information processing device and an information processing method. [Background technology]

[0002] In recent years, the adoption of CBT (Computer Based Testing), in which answers to questions are given on a computer, has been increasing in exams administered at schools and various qualification exams (for example, Patent Document 1). In CBT, answers are acquired in the form of electronic data, so applying automatic scoring technology using a computer can improve scoring accuracy and reduce the burden on scorers. In particular, for questions that require candidates to select the correct answer from multiple options or questions that require candidates to input numerical answers, automatic scoring can be performed with high accuracy using simple scoring criteria.

[0003] In addition, in questions that require drawing figures such as graphs on a coordinate plane, automatic scoring based on simple scoring criteria has traditionally been achieved by limiting the degree of freedom in drawing in the answer. For example, in a question where two points on a coordinate plane are selected and a line connecting those two points is automatically drawn, by adopting snapping technology that limits the selectable points to integer coordinates, automatic scoring can be performed based on simple scoring criteria in which the correct answer is determined when the coordinates of the answer and the coordinates of the correct answer completely match. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-251203 Summary of the Invention [Problem to be solved by the invention]

[0005] However, limiting the freedom of response can result in the problem that it is not always possible to effectively measure the examinee's understanding of the questions. On the other hand, to increase the degree of freedom in answers, it is necessary to set in advance a scoring standard that indicates the range that will be judged as a correct answer so that answer figures that are similar to the model answer can also be judged as correct. In setting this scoring standard, if the user simply specifies a range on the coordinate plane by numerical values, there is a problem that it is prone to errors and is cumbersome.

[0006] The object of this invention is to provide a system that allows users to easily set the grading criteria for questions that require users to draw shapes. program ,Information Processing Systems, Information processing device and an information processing method. [Means for solving the problem]

[0007] In order to solve the above problem, the program of the present invention is a program for acquiring marking criteria information to be referenced in marking a figure that is an answer to a question that asks a computer to draw a figure on a coordinate plane or a coordinate space, which is a Cartesian coordinate system. No. 1 process and , a second process of transmitting the acquired scoring criteria information to a server that is different from the external computer device operated by the user and has a storage unit that stores individual data managed by the user; Execute the above No. 1 In the process, when a predetermined user operation is received, The aforementioned The method is characterized in that a reference figure is drawn in the orthogonal coordinate system displayed on the display unit of a computer device, and the scoring criteria information including information related to the scoring criteria determined based on the reference figure is obtained.

[0008] In order to solve the above-mentioned problems, an information processing system according to the present invention includes a first processing unit and a second processing unit, wherein the first processing unit acquires marking criteria information that is referenced in a marking process of an answer figure for a question that requires a figure to be drawn in a coordinate plane or a coordinate space, which is a Cartesian coordinate system; the second processing unit executes the marking process based on the marking criteria information and answer information related to the answer figure; and the first processing unit, upon receiving a predetermined user operation, draws a reference figure in the Cartesian coordinate system displayed on a display unit of an external computer device operated by a user, and acquires the marking criteria information including information related to the marking criteria determined based on the reference figure. and transmitting the acquired scoring criteria information to a server that is different from the computer device and has a storage unit that stores individual data managed by the user.It is characterized by:

[0009] In order to solve the above problem, an information processing device according to the present invention includes a processing unit that acquires scoring criteria information that is referenced in a scoring process of an answer figure to a question that requires a figure to be drawn on a coordinate plane or a coordinate space, which is a Cartesian coordinate system. When a predetermined user operation is received, the processing unit draws a reference figure on the Cartesian coordinate system displayed on a display unit of an external computer device operated by the user, and acquires the scoring criteria information including information related to the scoring criteria that is determined based on the reference figure. and transmitting the acquired scoring criteria information to a server that is different from the computer device and has a storage unit that stores individual data managed by the user. It is characterized by:

[0010] In order to solve the above-mentioned problems, an information processing method according to the present invention is an information processing method executed by a computer, which acquires marking standard information to be referenced in marking a figure as an answer to a question that requires a figure to be drawn on a coordinate plane or a coordinate space, which is a Cartesian coordinate system. No. 1 Steps a second step of transmitting the acquired scoring criteria information to a server that is different from the external computer device operated by the user and has a storage unit that stores individual data managed by the user; and No. 1 In the step, when a predetermined user operation is received, The aforementioned The method is characterized in that a reference figure is drawn in the orthogonal coordinate system displayed on the display unit of a computer device, and the scoring criteria information including information related to the scoring criteria determined based on the reference figure is obtained. [Effects of the Invention]

[0011] According to the present invention, it is possible to easily set the grading criteria for questions that require drawing a figure. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a schematic diagram illustrating the configuration of a scoring system. [Figure 2] FIG. 2 is a block diagram showing the functional configuration of the scoring server. [Figure 3] FIG. 2 is a block diagram showing a functional configuration of a client terminal. [Figure 4] FIG. 2 is a block diagram showing the functional configuration of a client server. [Figure 5] FIG. 10 is a sequence diagram illustrating a scoring criterion generation process. [Figure 6] FIG. 10 is a diagram illustrating an example of a scoring criteria setting screen. [Figure 7] FIG. 10 is a diagram showing an example of the contents of scoring criteria data. [Figure 8] FIG. 10 is a sequence diagram illustrating a scoring process. [Figure 9] FIG. 10 is a diagram showing a reference pattern setting screen according to the first embodiment. [Figure 10] 10 is a diagram showing an example of a scoring criteria setting screen on which the contents of the reference pattern setting screen in FIG. 9 are reflected. FIG. [Figure 11] 10 is a diagram showing another example of the scoring criteria setting screen on which the contents of the reference pattern setting screen of FIG. 9 are reflected. FIG. [Figure 12] FIG. 10 is a diagram showing a reference pattern setting screen according to the second embodiment. [Figure 13] FIG. 10 is a diagram illustrating a method for setting a determination region. [Figure 14] FIG. 10 is a diagram illustrating a method for setting a determination region. [Figure 15] FIG. 15 is a diagram showing an example of a scoring criteria setting screen on which the contents of the reference pattern setting screen of FIG. 14 are reflected. [Figure 16] FIG. 11 is a diagram showing a reference pattern setting screen according to the third embodiment. [Figure 17] FIG. 17 is a diagram showing an example of a scoring criteria setting screen on which the contents of the reference pattern setting screen in FIG. 16 are reflected. [Figure 18] FIG. 10 is a diagram showing a reference pattern setting screen according to the fourth embodiment. [Figure 19] FIG. 20 is a diagram showing an example of a scoring criteria setting screen on which the contents of the reference pattern setting screen of FIG. 18 are reflected. [Figure 20] FIG. 13 is a diagram showing an example of a reference pattern setting screen according to Modification 5. [Figure 21] FIG. 13 is a diagram showing another example of the reference pattern setting screen according to the fifth modification. [Figure 22] FIG. 13 is a diagram showing another example of the reference pattern setting screen according to the fifth modification. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0014] <Grading system configuration> FIG. 1 is a schematic diagram of a scoring system 1 according to this embodiment. The scoring system 1 (information processing system) includes a scoring server 10 (information processing device), a client terminal 20, and a client server 30. The scoring server 10, the client terminal 20, and the client server 30 are connected to each other so as to be able to communicate information via a communication network N. The communication network N is, for example, the Internet, but is not limited to this and may be another network such as a LAN (Local Area Network).

[0015] The scoring system 1 is a computer system that provides an automatic scoring service for CBT. The scoring system 1 of this embodiment can automatically score questions that require a subject to draw a figure on a Cartesian coordinate system, which is a coordinate plane. However, the scoring system 1 may also be capable of automatically scoring questions of other types (e.g., questions that require a subject to select a correct answer from multiple options, or questions that require a subject to input a numerical answer). In response to a request from the client terminal 20, the scoring server 10 of the scoring system 1 generates scoring criteria data 332 (scoring criteria information) (see FIG. 4 ) including information related to the scoring criteria of the question and transmits it to the client server 30. In addition, the scoring server 10 executes a scoring process for the answer figure in response to a call from the client server 30 of the automatic scoring API, and transmits scoring result data 335 including information related to the scoring result to the client server 30. In the scoring process, the scoring criteria included in the scoring criteria data 332 are referenced. Details of these processes will be described later.

[0016] <Grading server configuration> FIG. 2 is a block diagram showing the functional configuration of the scoring server 10. As shown in FIG. The scoring server 10 includes a CPU 11 (Central Processing Unit), a RAM 12 (Random Access Memory), a storage unit 13, an operation unit 14, a display unit 15, a communication unit 16, and a bus 17. The components of the scoring server 10 are connected via the bus 17.

[0017] The CPU 11 is a processor (a processing unit, a first processing unit, a second processing unit) that controls the operation of each unit of the scoring server 10. The CPU 11 reads out the scoring criteria generation program 131, the scoring program 132, and the like stored in the storage unit 13, expands them in a work area of the RAM 12, and executes various processes in accordance with the expanded programs. For example, by executing the scoring criteria generation program 131, the CPU 11 provides the client terminal 20 with a scoring criteria generation UI (User Interface), and generates scoring criteria data 332 based on a user operation on the client terminal 20 and transmits it to the client server 30. Furthermore, when an automatic scoring API is called from the client server 30, the CPU 11 executes the scoring program 132 to execute a scoring process for the answer, generates scoring result data 335, and transmits it to the client server 30.

[0018] The RAM 12 provides a working memory space for the CPU 11 and stores temporary data. The RAM 12 may include a non-volatile memory.

[0019] The storage unit 13 is a non-transitory recording medium readable by the CPU 11 as a computer, and is configured by an HDD (Hard Disk Drive), an SSD (Solid State Drive), etc. The storage unit 13 stores programs such as a scoring criteria generation program 131 and a scoring program 132 executed by the CPU 11, as well as data referenced when the programs are executed. The programs are stored in the storage unit 13 in the form of computer-readable program codes.

[0020] The operation unit 14 has a pointing device such as a mouse, a keyboard, and the like, and receives position inputs and key inputs from the user and outputs the operation information to the CPU 11.

[0021] The display unit 15 includes a display device such as a liquid crystal display, and performs various displays on the display device in accordance with display control signals from the CPU 11.

[0022] The communication unit 16 is configured by a router, a network card, etc. The CPU 11 is connected to and communicates with the client terminal 20 and the client server 30 on the communication network N via the communication unit 16 to transmit and receive data.

[0023] <Client terminal configuration> FIG. 3 is a block diagram showing the functional configuration of the client terminal 20. As shown in FIG. The client terminal 20 is a computer device used by a user (for example, a teacher who manages students' answers and their grading results) who uses the services of the scoring system 1. The client terminal 20 is, for example, a notebook PC (Personal Computer), a desktop PC, a tablet terminal, or a smartphone. The client terminal 20 requests the scoring server 10 and the client server 30 to execute various processes in response to input operations from the user on the browser 231, and displays the processing results received from the scoring server 10 on the display unit 25.

[0024] The client terminal 20 includes a CPU 21, a RAM 22, a storage unit 23, an operation unit 24, a display unit 25, a communication unit 26, and a bus 27. The components of the client terminal 20 are connected to each other via the bus 27.

[0025] The CPU 21 is a processor that controls the operation of each part of the client terminal 20. The CPU 21 reads out programs such as the browser 231 stored in the storage unit 23, expands them in a work area of the RAM 22, and executes various processes in accordance with the expanded programs.

[0026] The RAM 22 provides a working memory space for the CPU 21 and stores temporary data. The RAM 22 may include a non-volatile memory.

[0027] The storage unit 23 is a non-transitory recording medium readable by the CPU 21 as a computer, and is composed of an HDD, SSD, etc. The storage unit 23 stores programs such as a browser 231 executed by the CPU 21, as well as data referenced when the programs are executed. The programs are stored in the storage unit 23 in the form of computer-readable program code. The browser 231 is a program that displays on the display unit 25 the execution results of various programs transmitted from the scoring server 10 and the client server 30, information on web pages on the Internet, etc.

[0028] The configurations of the operation unit 24, the display unit 25, and the communication unit 26 are the same as those of the operation unit 14, the display unit 15, and the communication unit 16 of the scoring server 10, and therefore a description thereof will be omitted.

[0029] <Client-server configuration> FIG. 4 is a block diagram showing the functional configuration of the client server 30. As shown in FIG. The client server 30 is a computer device that stores individual data managed by users who use the services of the scoring system 1 (for example, data related to the scoring criteria for questions, answers, and scoring results, etc.), and stores and executes automatic scoring scripts generated by users.

[0030] The client server 30 includes a CPU 31, a RAM 32, a storage unit 33, an operation unit 34, a display unit 35, a communication unit 36, and a bus 37. The components of the client server 30 are connected to each other via the bus 37.

[0031] The CPU 31 is a processor that controls the operation of each component of the client server 30. The CPU 31 reads various programs, such as the automatic scoring script 331, stored in the storage unit 33, expands them in a work area of the RAM 32, and executes various processes in accordance with the expanded programs. For example, by executing the automatic scoring script 331, the CPU 31 calls the automatic scoring API of the scoring server 10 using the individual scoring data 334 as an argument, and generates and acquires the scoring result data 335. In this specification, the term "program" is understood to include a script that can be executed without compiling.

[0032] The RAM 32 provides a working memory space for the CPU 31 and stores temporary data. The RAM 32 may include a non-volatile memory.

[0033] The storage unit 33 is a non-transitory recording medium readable by the CPU 31 as a computer, and is composed of an HDD, SSD, etc. The storage unit 33 stores programs such as the automatic scoring script 331 executed by the CPU 31, as well as data referenced when the program is executed. The programs are stored in the storage unit 33 in the form of computer-readable program code. The automatic scoring script 331 is usually created by the user of the scoring system 1 according to the purpose, but a script created in advance may also be used.

[0034] The data stored in the storage unit 33 includes scoring criteria data 332, answer data 333 (answer information), individual scoring data 334, and scoring result data 335.

[0035] The scoring criteria data 332 is referenced in the scoring process of answer figures for questions that require figures to be drawn on a Cartesian coordinate system, which is a coordinate plane. The scoring criteria data 332 includes information related to the scoring criteria in the above scoring process. The scoring criteria data 332 is generated by the scoring server 10 in response to a request from the client terminal 20, transmitted to the client server 30, and stored in the storage unit 33. The scoring criteria data 332 is a file in a format that can be referenced as an argument when the automatic scoring API of the scoring server 10 is executed, in this case, a JSON format file.

[0036] The answer data 333 is data related to answer figures generated by the students or other respondents who have answered the questions on their answering terminal devices (not shown). If there are multiple respondents, the answer data 333 is generated for each respondent. The data items included in the answer data 333 are predetermined for each question.

[0037] Individual scoring data 334 is data in which answer data 333 of a certain respondent is inserted into scoring criteria data 332. Therefore, individual scoring data 334 includes scoring criteria information and answer information generated by one respondent. If there are multiple respondents, individual scoring data 334 is generated for each respondent. Individual scoring data 334 is a file in the same format as scoring criteria data 332 (here, JSON format).

[0038] The scoring result data 335 includes information related to the scoring results of the answers. The scoring result data 335 is generated in the scoring server 10 by calling the automatic scoring API of the scoring server 10 using the individual scoring data 334 as an argument, and is transmitted to the client server 30.

[0039] The configurations of the operation unit 34, the display unit 35, and the communication unit 36 are the same as those of the operation unit 14, the display unit 15, and the communication unit 16 of the scoring server 10, and therefore a description thereof will be omitted.

[0040] <How the scoring system works> Next, we will explain the operation of the scoring system 1, focusing on the operation related to generating the scoring criteria and the scoring operation using the scoring criteria. The main operating entities in these operations are the CPU 11 of the scoring server 10, the CPU 21 of the client terminal 20, and the CPU 31 of the client server 30, but for convenience, the scoring server 10, the client terminal 20, and the client server 30 may be described below as the main operating entities.

[0041] FIG. 5 is a sequence diagram illustrating the scoring criterion generation process. FIG. 5 is a diagram showing the flow of signals transmitted and received between the scoring server 10, the client terminal 20, and the client server 30 in the operation of generating the scoring criteria.

[0042] A user who uses the automatic scoring function provided by the scoring system 1 first launches the browser 231 on the client terminal 20 and accesses a predetermined URL. This causes the client terminal 20 to request the scoring server 10 to transmit display data for displaying the scoring criteria setting screen 251 (step S101). In response to the request, the scoring server 10 executes the scoring criteria generation program 131, transmits the display data for displaying the scoring criteria setting screen 251 to the client terminal 20, and displays the scoring criteria setting screen 251 on the display unit 25 of the client terminal 20 (step S102).

[0043] FIG. 6 is a diagram showing an example of the scoring criteria setting screen 251. As shown in FIG. The scoring criteria setting screen 251 displays reference correct answer information 41, reference shape information 42, answer figure information 43, scoring variable information 44, scoring logic information 45, question ID 461, sub-question ID 462, save button 47, and reference figure drawing button 48. In the following, a point whose x coordinate is a and whose y coordinate is b on the xy coordinate plane used to answer a question will be referred to as point (a, b).

[0044] The reference correct answer information 41 is information related to the correct answer figure set by the user as the model answer to the question. In FIG. 6, a straight line L0 with Point0 (5, 10) and Point1 (-5, -10) as its two endpoints is set as the correct answer figure. The "Bind by index" setting also means that the answer order of multiple answer elements set after the setting is taken into consideration. In the example of FIG. 6, the first point selected by the respondent when answering is set as Point0, and the second point selected is set as Point1. On the other hand, by changing the "Index" part from the drop-down list to "Bind by Any," the answer order can be ignored. In this case, both the combination of the selected two points "Point0, Point1" and the combination of "Point1, Point0" are scored, and the higher score is adopted as the scoring result.

[0045] Reference shape information 42 is information related to various shapes referenced in the scoring criteria. In FIG. 6, "graphBounds," which represents the coordinate plane used for the answer, is set as the reference shape. Here, "graphBounds" is a rectangular area with the point (-10,-10) at its lower left end and lengths of 20 in the x and y directions. In FIG. 6, only "graphBounds" is set as the reference shape, but two or more reference shapes may be set.

[0046] The answer figure information 43 is data related to the answer figure of the respondent. When setting the scoring criteria, dummy answer figure information 43 is input to provide a place to insert the respondent's answer data. Here, the coordinate data of the two end points P0 (Point 0) and P1 (Point 1) of the straight line L0 as the answer figure is input so as to correspond to the reference correct answer information 41.

[0047] The scoring variable information 44 is information related to scoring variables for configuring the scoring logic of the scoring logic information 45. Here, the value of the automatic scoring function "equalAll" is substituted for the scoring variable "correct." The automatic scoring function "equalAll" is a function that returns "true (1)" if the data of the reference correct answer information 41 (here, the coordinates of Point0 and Point1) and the data of the answer figure information 43 (also the coordinates of Point0 and Point1) are completely identical, and returns "false (0)" if they are not completely identical. In FIG. 6, a single scoring variable is used, but two or more scoring variables may be set.

[0048] The scoring logic information 45 represents the scoring logic using the scoring variables of the scoring variable information 44. In Fig. 6, the score is determined by the logical expression "score = correct". In the example of Fig. 6, since the data in the reference correct answer information 41 and the data in the answer figure information 43 do not completely match, the scoring variable "correct" becomes "false (0)" and the "score" becomes "0".

[0049] The question ID 461 is a unique code assigned to each question. The question ID 461 can be used to call up the scoring criteria data 332 corresponding to that question. The sub-question ID 462 is a unique code assigned to each sub-question included in the question. If a question includes multiple sub-questions, the scoring criteria data 332 includes information on multiple scoring criteria corresponding to the multiple sub-questions. In this case, scoring can be performed by adding up the scores of the multiple sub-questions to determine the score for the entire question, or by determining the question as correct only if all of the sub-questions are answered correctly.

[0050] The save button 47 is a button for generating the scoring criteria data 332 based on the content of the scoring criteria setting screen 251 at that time.

[0051] The reference figure drawing button 48 is a button that is selected when drawing a reference figure used for setting the grading criteria on the graph viewer. The method for setting the grading criteria using a reference figure will be described later.

[0052] When the save button 47 is selected, a request to generate scoring criteria data 332 is sent from the client terminal 20 to the scoring server 10 (step S103 in FIG. 5). Upon receiving the generation request, the scoring server 10 executes processing in accordance with the scoring criteria generation program 131 to generate scoring criteria data 332 in JSON format and transmits it to the client server 30 (step S104). When the scoring criteria data 332 is stored in the memory unit 33 of the client server 30 in step S104, the scoring criteria generation process ends.

[0053] FIG. 7 is a diagram showing an example of the contents of the scoring criteria data 332. Here, the scoring criteria data 332 reflecting the contents of the scoring criteria setting screen 251 shown in Fig. 6 is illustrated. The scoring criteria data 332 includes the sub-question ID, scoring logic, correct answer (contents of the reference correct answer information 41), the answer of the answerer (contents of the answer graphic information 43), and an answerer identification ID for identifying the answerer. Fig. 7 is an example of the scoring criteria data 332, and the format is not limited to this.

[0054] Next, a marking process for automatically marking the answer figure using the generated marking standard data 332 will be described. FIG. 8 is a sequence diagram illustrating the scoring process. The scoring process is started in response to a predetermined user operation on the client terminal 20 when the scoring criteria data 332 and the answer data 333 are stored in the storage unit 33 of the client server 30.

[0055] When the marking process is started, the client terminal 20 requests the client server 30 to start the automatic marking script 331 (step S201).

[0056] The client server 30 executes the automatic scoring script 331 in response to the request. The client server 30 first generates individual scoring data 334 by inserting one piece of answer data 333 into the scoring criteria data 332, and stores the generated data in the storage unit 33 (step S202). In step S202, the individual scoring data 334 is generated by replacing the "answer by answerer" portion of the scoring criteria data 332 shown in FIG. 7 with the actual answer content of an individual answerer. In this way, the individual scoring data 334 is generated, which includes the scoring criteria information included in the scoring criteria data 332 and the answer data 333 from a certain answerer.

[0057] Next, the client server 30 calls the automatic scoring API of the scoring server 10 using the individual scoring data 334 generated in step S202 as an argument (step S203). The scoring server 10 executes the scoring program 132 in response to the call of the automatic scoring API, generates scoring result data 335, and transmits it to the client server 30 (step S204). Here, the scoring server 10 refers to the scoring criteria of the scoring criteria data 332 included in the received individual scoring data 334, and scores the answer data 333 included in the individual scoring data 334. In the example of FIGS. 6 and 7, first, the scoring server 10 compares the coordinates of the reference correct answer information 41 with the coordinates of the answer figure information 43 of the answer data 333, and obtains the value of the scoring variable "correct". Then, the score is calculated according to the scoring logic of "score=correct", and scoring result data 335 including information on the score is generated.

[0058] When the client server 30 receives the scoring result data 335, it determines whether scoring has been completed for all respondents (step S205), and if it determines that there is a respondent for whom scoring has not been completed ("NO" in step S205), it executes step S202 again using the answer data 333 of the next respondent. If it determines that scoring has been completed for all respondents ("YES" in step S205), the client server 30 ends the automatic scoring script 331. This ends the scoring process.

[0059] <How to set grading criteria using reference figures> In the scoring system 1 of this embodiment, when setting the scoring criteria on the scoring criteria setting screen 251, a reference graphic can be displayed (drawn) on the display unit of the client terminal 20, and information about this reference graphic can be reflected in the scoring criteria. Below, Examples 1 to 5 relating to the method of setting the scoring criteria using the reference graphic in this way will be described.

[0060] Example 1 First, as a first embodiment, a case will be described in which a judgment area is defined by a reference figure, and a marking standard relating to the positional relationship between the judgment area and the answer figure is set.

[0061] FIG. 9 is a diagram showing a reference pattern setting screen 252 according to the first embodiment. The reference shape setting screen 252 is a graph viewer that is displayed on the display unit 25 when the reference shape drawing button 48 is selected on the scoring criteria setting screen 251. The reference shape setting screen 252 displays a coordinate plane 51, a mode selection button 52, a reference line 61, a reference rectangle 62, an answer shape 71, and the like. Of these, the reference line 61 and the reference rectangle 62 are examples of reference shapes.

[0062] The coordinate plane 51 corresponds to the "graphBounds" set in the reference shape information 42 of the scoring criteria setting screen 251. A reference line 61, a reference rectangle 62, an answer shape 71, and the like are drawn on this coordinate plane 51. The coordinate range of the coordinate plane 51 and the spacing between auxiliary lines can be changed by inputting values into a text box 53 provided on the right side of the reference shape setting screen 252. This change is also reflected in the content of "graphBounds" in the reference shape information 42 of the scoring criteria setting screen 251. Depending on the user's operation, it is also possible to display a reference value on the x-axis and / or y-axis of the coordinate plane 51. For example, it is also possible to display "0" representing the origin at the intersection of the x-axis and y-axis.

[0063] The mode selection button 52 is a button for specifying the drawing mode of the reference figure on the reference figure setting screen 252. When the mode selection button 52 is selected, a group of icons (not shown) representing multiple drawing mode options is displayed, and the drawing mode can be changed by selecting one of the icons. The drawing modes include a reference line drawing mode in which a reference line is drawn as the reference figure, an area specification mode in which an area is specified based on the reference line, and a rectangle drawing mode in which a reference rectangle is drawn as the reference figure.

[0064] Here, the reference line 61 corresponds to a straight line L0 (a correct answer figure set by the user as a model answer for the question) set in the reference correct answer information 41 of the scoring criteria setting screen 251. The reference line 61 can be generated by selecting the reference line drawing mode using the mode selection button 52 and performing an operation of specifying two endpoints on the coordinate plane 51 (for example, by placing the mouse cursor and clicking). When specifying the endpoints, a snap technique that limits selectable points to integer coordinates may be employed. Furthermore, the shape of the reference line 61 may be changed by changing the positions of the endpoints of the reference line 61, and this change may be reflected in the reference correct answer information 41 of the scoring criteria setting screen 251. Furthermore, when the coordinate data of the two endpoints (Point1, Point2) in the reference correct answer information 41 is changed, the change may be reflected in the reference line 61 on the reference figure setting screen 252.

[0065] The reference rectangle 62 is a rectangle with sides parallel to the coordinate axes of the coordinate plane. The reference rectangle 62 in FIG. 9 is a square with sides of length 2 and centers at the two endpoints of the reference line 61. The reference rectangle 62 represents judgment areas R0 and R1 whose boundaries are the reference rectangle 62. The positional relationship between the judgment areas R0 and R1 and the answer figure 71 can be set as the scoring criteria. For example, the scoring criteria can be set so that the answer is judged to be correct when the answer figure 71 passes through the judgment areas R0 and R1. In this case, in addition to the answer figure 71 that completely matches the reference line 61 representing the correct answer figure, any answer figure 71 that passes through the judgment areas R0 and R1 is judged to be correct. It is also possible to set the scoring criteria so that the answer is judged to be correct when predetermined feature points (two endpoints P0 and P1) of the answer figure 71 are located within the judgment areas R0 and R1, respectively.

[0066] When the rectangle drawing mode is selected by the mode selection button 52, the reference rectangle 62 is drawn on the coordinate plane 51 in response to a user operation. The user operation is, for example, an operation of specifying the positions of opposite vertices of the reference rectangle 62 on the coordinate plane 51, and the position of the reference rectangle 62 on the coordinate plane 51 is identified based on this user operation. This user operation may be a drag operation. In other words, the start point and end point of the drag operation may be identified as the positions of opposite vertices of the reference rectangle 62. Furthermore, when specifying the positions of the opposite vertices, a snapping technique may be employed that limits the selectable points to integer coordinates.

[0067] The answer figure 71 corresponds to the straight line L0 in the answer figure information 43 on the scoring criteria setting screen 251. At the scoring criteria generation stage, the answer figure 71 is a dummy.

[0068] FIG. 10 is a diagram showing an example of a scoring criteria setting screen 251 on which the contents of the reference pattern setting screen 252 in FIG. 9 are reflected. 10, in addition to "graphBounds" representing the answer coordinate area, judgment areas "R0" and "R1" corresponding to the two reference rectangles 62 are defined and displayed as reference shapes. The coordinate data representing the judgment areas "R0" and "R1" in the reference shape information 42 is calculated and displayed by the CPU 11 from the contents of the judgment areas R0 and R1 on the reference shape setting screen 252. This saves the user the trouble of inputting the coordinate data of the judgment areas "R0" and "R1" as reference shapes.

[0069] In the scoring variable information 44, scoring variables "satisfied_0" and "satisfied_1" are defined and displayed. The scoring variable "satisfied_0" is assigned the value of the automatic scoring function "lineHits" that takes as arguments the straight line "L0" of the answer figure information 43 and the judgment area "R0" as the reference shape. Also, the scoring variable "satisfied_1" is assigned the value of the automatic scoring function "lineHits" that takes as arguments the straight line "L0" of the answer figure information 43 and the judgment area "R1" as the reference shape. The automatic scoring function "lineHits" is a function that returns "true" if the argument straight line passes through the argument judgment area.

[0070] The scoring logic information 45 defines a scoring logic in which the "score" is "1" when both of the scoring variables "satisfied_0" and "satisfied_1" are "true." In the example of FIGS. 9 and 10, the straight line L0 (answer figure 71) of the answer figure information 43 passes through both the judgment areas R0 and R1, so the "score" is calculated as "1." In this way, the scoring criteria data 332 generated by the scoring criteria setting screen 251 of FIG. 10 is used in the scoring process to determine whether or not the answer figure 71 passes through the judgment areas R0 and R1.

[0071] FIG. 11 is a diagram showing another example of the scoring criteria setting screen 251 on which the contents of the reference pattern setting screen 252 of FIG. 9 are reflected. In the scoring variable information 44 of the scoring criteria setting screen 251 of FIG. 11, the scoring variables "in1," "in2," and "correct" are defined and displayed. The scoring variable "in1" is assigned the value of the automatic scoring function "inBox" that takes as arguments "L0.points[0]," which represents one end point P0 of the straight line L0 of the answer figure information 43, and the judgment area "R0." The scoring variable "in2" is assigned the value of the automatic scoring function "inBox" that takes as arguments "L0.points[1]," which represents the other end point P1 of the straight line "L0" of the answer figure information 43, and the judgment area "R1." The automatic scoring function "inBox" is a function that returns "true" if the argument point is located within the argument's judgment area. The scoring variable "correct" is defined to be "true" if both the scoring variables "in1" and "in2" are "true."

[0072] In the scoring logic information 45, the score is determined by the logical formula "score=correct". In the example of Figs. 9 and 11, the end points P0 and P1 of the straight line L0 (answer figure 71) of the answer figure information 43 are respectively within the judgment areas R0 and R1, so the scoring variables "in1", "in2", and "correct" are all "true (1)", and the "score" is calculated as "1". In this way, the scoring criteria data 332 generated by the scoring criteria setting screen 251 of Fig. 11 is used in the scoring process to determine whether or not predetermined feature points (here, the two end points P0 and P1) of the answer figure 71 are located within the judgment areas R0 and R1.

[0073] As shown in FIGS. 10 and 11, the definition of the scoring variables in the scoring variable information 44 and the contents of the scoring logic information 45 can be freely set by the user in accordance with a desired scoring method.

[0074] Example 2 In the first embodiment, the determination region is determined by the reference rectangle 62 as a reference figure. However, instead of this, the determination region may be determined by using two or more reference lines as boundary lines as reference figures.

[0075] FIG. 12 is a diagram showing a reference pattern setting screen 252 according to the second embodiment. 12, reference lines 63 and 64 are displayed instead of the reference rectangle 62 shown in FIG. 9. The reference lines 63 and 64 are examples of reference shapes. The reference line 63 corresponds to a graph of the function y = 2x + 2, and the reference line 64 corresponds to a graph of the function y = 2x - 2. Furthermore, a region with the reference line 63 as its boundary and whose y coordinate is smaller than that of the reference line 63 is defined as a determination region R2, and a region with the reference line 64 as its boundary and whose y coordinate is larger than that of the reference line 64 is defined as a determination region R3. In other words, the determination region R2 is a region that satisfies y ≥ 2x - 2, and the determination region R3 is a region that satisfies y ≤ 2x + 2. Hereinafter, the overlapping range of the determination regions R2 and R3 will be referred to as a determination region R4.

[0076] The determination regions R2 and R3 in FIG. 12 are set in the following manner. That is, first, as shown in FIG. 13, the region specification mode is selected using the mode selection button 52, and a reference line 63 is drawn. The reference line 63 can be drawn by a user operation of specifying two points on the coordinate plane 51. From this state, a user operation (mouse-over operation) of positioning a cursor 55 on one side or the other of the reference line 63 on the display screen can be performed to specify the one side or the other of the reference line 63 as the determination region R2. In FIG. 13, the determination region R2 is specified by positioning the cursor 55 on the −y direction (+x direction) side of the reference line 63. The content of the specified determination region R2 is reflected in the information display section 54 provided on the right side of the reference shape setting screen 252. Note that if the input content in the text box of the information display section 54 is changed, the change may be reflected in the reference line 63 and the second region R2. 13, by performing a confirmation operation such as a click operation, the reference line 63 and the judgment area R2 are confirmed and are reflected in the reference shape information 42 on the scoring criteria setting screen 251. Note that the operation for specifying the judgment area R2 may be an operation other than a mouse-over operation.

[0077] Next, as shown in Fig. 14, a reference line 64 is drawn, and a judgment region R3 is specified by positioning cursor 55 on the +y direction (-x direction) side of reference line 64. By performing a click operation or the like in the state shown in Fig. 14, the reference line 64 and judgment region R3 are confirmed. In addition, a judgment region R4, which is the overlapping range of judgment regions R2 and R3, is confirmed.

[0078] FIG. 15 is a diagram showing an example of a scoring criteria setting screen 251 on which the contents of the reference pattern setting screen 252 in FIG. 14 are reflected. In the reference shape information 42 on the scoring criteria setting screen 251 in Fig. 15, in addition to "graphBounds" representing the answer coordinate area, the judgment areas "R2" and "R3" shown in Figs. 12-14 are defined and displayed as reference shapes. The inequalities representing the judgment areas "R2" and "R3" in the reference shape information 42 are calculated and displayed by the CPU 11 from the contents of the reference lines 63 and 64 and the judgment areas R2 and R3 on the reference shape setting screen 252. This saves the user the trouble of inputting data to specify the judgment areas "R2" and "R3" as reference shapes.

[0079] In the scoring variable information 44, scoring variables "sati_pt0R2", "sati_pt0R3", "sati_pt1R2", and "sati_pt1R3" are defined and displayed. The scoring variable "sati_pt0R2" is assigned the value of the automatic scoring function "satisfies" that takes as arguments "L0.pt0" representing one end point P0 of the straight line L0 of the answer figure information 43 and the judgment area "R2". The scoring variable "sati_pt0R3" is assigned the value of the automatic scoring function "satisfies" that takes as arguments "L0.pt" and the judgment area "R3". The scoring variable "sati_pt1R2" is assigned the value of the automatic scoring function "satisfies" that takes as arguments "L0.pt1" representing the other end point P1 of the straight line L0 of the answer figure information 43 and the judgment area "R2". The scoring variable "sati_pt1R3" is assigned the value of the automatic scoring function "satisfies," which takes "L0.pt1" and the judgment region "R3" as arguments. The automatic scoring function "satisfies" is a function that returns "true" if the argument point is located within the argument judgment region.

[0080] The scoring logic information 45 defines a scoring logic in which "score" is set to "1" when all of the scoring variables "sati_pt0R2," "sati_pt0R3," "sati_pt1R2," and "sati_pt1R3" are "true." Here, the scoring variables "sati_pt0R2" and "sati_pt1R2" are all set to "true" when the straight line L0 (answer figure 71) of the answer figure information 43 is located in judgment area R2, and the scoring variables "sati_pt0R3" and "sati_pt1R3" are all set to "true" when the straight line L0 (answer figure 71) of the answer figure information 43 is located in judgment area R3. That is, the scoring logic in FIG. 15 is such that "score" is set to "1" when the straight line L0 of the answer figure information 43 is located within judgment area R4, which is the overlapping range of judgment areas R2 and R3. In other words, the scoring criteria data 332 generated by the scoring criteria setting screen 251 of Figure 15 is used in the scoring process to determine whether the two end points P0, P1 of the answer figure 71 are located within the judgment area R4 whose boundaries are the two reference lines 63, 64.

[0081] Example 3 Next, as a third embodiment, a case where a scoring standard relating to the similarity of the shapes of the reference pattern and the answer pattern is set will be described.

[0082] Fig. 16 is a diagram showing a reference pattern setting screen 252 according to Example 3. In Fig. 16, elements other than the coordinate plane 51 are omitted (the same applies to the following Figs. 18, 20-22). In Figure 16, a reference rectangle 65 with a side length of 6 and centered at the origin is drawn as a reference figure. The reference rectangle 65 represents a judgment area R5 with the reference rectangle 65 as its boundary line. Also, a rectangular answer figure 75 connecting four points on the coordinate plane 51 is drawn. The answer figure 75 represents an answer area U0 with the answer figure 75 as its boundary line.

[0083] FIG. 17 is a diagram showing an example of a scoring criteria setting screen 251 on which the contents of the reference pattern setting screen 252 in FIG. 16 are reflected. In the reference shape information 42 of the scoring criteria setting screen 251 of FIG. 17, the judgment area "R5" shown in FIG. 16 is defined and displayed as the reference shape in addition to "graphBounds" representing the answer coordinate area.

[0084] In the answer figure information 43, the area "U0" represented by the answer figure 75 is defined.

[0085] The scoring variable "same" is defined in the scoring variable information 44. The scoring variable "same" is assigned the value of the automatic scoring function "sameRegion" that takes the region "U0" related to the answer figure information 43 and the judgment region "R5" as arguments. The automatic scoring function "sameRegion" is a function that returns "true" if the two regions of the arguments completely match.

[0086] In addition, a default precision 49 ("Default precision") is set in the scoring criteria setting screen 251 of FIG. 17. The default precision 49 determines the amount of deviation from the correct answer range that is acceptable as a correct answer. In FIG. 17, the default precision 49 is set to "0," so the value of the scoring function "same" becomes "true" only when each point of the answer figure 75 shown in FIG. 16 completely matches the vertices of the reference rectangle 65. In contrast, if the value of the default precision 49 is set to "1," for example, the value of the scoring function "same" becomes "true" if the deviation of each point of the answer figure 75 from the vertices of the reference rectangle 65 is 1 or less. The setting of the default precision 49 may be included in the scoring criteria setting screen 251 of FIGS. 6, 10, 11, and 15 described above.

[0087] In the scoring logic information 45, the score is determined by the logical formula "score=same". In the example of Figs. 16 and 17, the judgment area R5 does not match the answer area U0 related to the answer figure 75, so the scoring variable "same" becomes "false (0)" and the "score" becomes "0". In this way, the scoring criteria data 332 generated by the scoring criteria setting screen 251 of Fig. 17 is used in the scoring process to judge the similarity of the shape between the answer figure 75 and the reference rectangle 65 as the reference figure.

[0088] Example 4 Next, as a fourth embodiment, a case where a scoring standard relating to the comparison of the areas of the reference pattern and the answer pattern is set will be described.

[0089] FIG. 18 is a diagram showing a reference pattern setting screen 252 according to the fourth embodiment. In Figure 18, a reference rectangle 66 with a side length of 6 and centered at the origin is drawn as a reference figure. The reference rectangle 66 represents a judgment area R6 with the reference rectangle 66 as its boundary line. Also, a hexagonal answer figure 76 connecting six points on the coordinate plane 51 is drawn. The answer figure 76 represents an answer area U1 with the answer figure 76 as its boundary line.

[0090] FIG. 19 is a diagram showing an example of a scoring criteria setting screen 251 that reflects the contents of the reference pattern setting screen 252 of FIG. In the reference shape information 42 of the scoring criteria setting screen 251 of FIG. 19, the judgment area "R6" shown in FIG. 18 is defined and displayed as the reference shape in addition to "graphBounds" representing the answer coordinate area.

[0091] In the answer figure information 43, the area "U1" represented by the answer figure 76 is defined.

[0092] A scoring variable "intersection" is defined in the scoring variable information 44. The scoring variable "intersection" is assigned the value of the automatic scoring function "overlap" that takes as arguments the judgment area "R6" and the area "U1" related to the answer figure information 43. The automatic scoring function "overlap" is a function that returns the value of (the area where the two argument areas overlap) / (the area of one of the argument areas).

[0093] In the scoring logic information 45, the score is determined by the logical formula "score=intersection>0.75". According to this, when the value of the scoring variable "intersection" is greater than 0.75, the score is "1". In this way, the scoring criteria data 332 generated by the scoring criteria setting screen 251 in FIG. 19 is used in the scoring process to determine the comparison of the area between the answer graphic 76 and the reference rectangle 66 as the reference graphic.

[0094] Example 5 Next, as a fifth embodiment, a case will be described in which scoring criteria relating to the similarity of the shape and distance between a reference graphic representing a graph of a predetermined function and the answer area are generated.

[0095] FIG. 20 is a diagram showing an example of a reference pattern setting screen 252 according to the fifth modification. 20, reference lines 67a and 67b representing graphs of two linear functions are drawn on the reference graphic setting screen 252. The reference lines 67a and 67b are examples of reference graphics. Also, a straight answer graphic 77a corresponding to the reference line 67a and a straight answer graphic 77b corresponding to the reference line 67b are drawn. Based on such reference graphics, scoring variables such as those shown in (i) to (iii) below can be set, and a score can be calculated using scoring logic that combines these scoring variables. (i) The distance between each end point of the answer figure 77a and the reference line 67a (ii) The distance between each end point of the answer figure 77b and the reference line 67b (iii) The difference or distance between the intersection 77c of answer figures 77a and 77b and the intersection 67c of reference lines 67a and 67b For example, the scoring logic can be set so that if the distance between (i) and (ii) is 1 or less, a score of "1" is added, and if the intersections 77c and 67c in (iii) are the same, a score of "1" is added.

[0096] FIG. 21 is a diagram showing another example of the reference pattern setting screen 252 according to the fifth modification. 21, two reference lines 68a and 68b representing a graph of a hyperbolic function are drawn on the reference graphic setting screen 252. The reference lines 68a and 68b are an example of a reference graphic. Also, hyperbolic answer graphics 78a and 78b corresponding to the reference lines 68a and 68b are drawn. Based on such reference graphics, scoring variables such as those listed below (i) to (iv) can be set, and a score can be calculated using scoring logic that combines these scoring variables. (i) The overlap rate of the area between the smallest rectangle enclosing the answer figure 78a and the smallest rectangle enclosing the reference line 68a (ii) The overlap rate of the area between the smallest rectangle enclosing answer figure 78b and the smallest rectangle enclosing reference line 68b (iii) Comparison of the shapes of answer figures 78a and 78b and reference lines 68a and 68b (iv) Answer: The x-coordinate of the asymptote 78c of figures 78a and 78b For example, the scoring logic can be set so that if the overlap rate of (i) and (ii) is 0.75 or more, a score of "1" is added to each, if (iii) satisfies a specified analogy condition, a score of "1" is added, and if the coordinate of the asymptote of (iv) matches a specified value (or is within a specified range), a score of "1" is added.

[0097] FIG. 22 is a diagram showing another example of the reference pattern setting screen 252 according to the fifth modification. On the reference graphic setting screen 252 shown in FIG. 22, a reference line 69a representing a graph of a quadratic function and a reference rectangle 69b centered on the minimum point of the reference line 69a are drawn. The reference rectangle 69b represents a judgment region R7 whose boundary is the reference rectangle 69b. The reference line 69a and the reference rectangle 69b are an example of a reference graphic. Also, a curved answer graphic 79a corresponding to the reference line 69a is drawn. Based on such a reference graphic, scoring variables such as those listed below (i) to (iii) can be set, and a score can be calculated using scoring logic that combines these scoring variables. (i) The overlap rate of the area between the smallest rectangle enclosing the answer figure 79a and the smallest rectangle enclosing the reference line 69a (ii) Analogy of the shape of answer figure 79a and reference line 69a (iii) Whether the minimum point as a characteristic point of answer figure 79a is within the range of judgment area R7 For example, the scoring logic can be set so that if the overlap rate of (i) is 0.75 or more, a score of "1" is added, if (ii) a specified analogy condition is met, a score of "1" is added, and if the positional relationship of the minimum point of (iii) is met, a score of "1" is added. If the quadratic function related to the reference line 69a has an upward convex shape, a local maximum point can be used as the characteristic point. If the reference line 69a represents a graph of a cubic function, a local maximum point, a local minimum point, or an inflection point can be used as the characteristic point.

[0098] <Effects> As described above, the scoring server 10 as an information processing device according to this embodiment includes the CPU 11 as a processing unit that generates scoring criteria data 332, which is referenced in the scoring process of answer figures for questions that require figures to be drawn on a Cartesian coordinate system, which is the coordinate plane 51. The CPU 11, based on a user operation, draws reference figures (e.g., reference line 61, reference rectangle 62) on the coordinate plane 51 displayed on the display unit 25 of the client terminal 20, and generates scoring criteria data 332 including information related to the scoring criteria determined based on the reference figures. This allows for easy setting of scoring criteria in a visually and intuitive manner. Furthermore, the scoring criteria can be easily adjusted by simply adjusting the shape of the reference figure to be displayed. Furthermore, compared to the conventional method of setting the correct answer range only by inputting numerical values, errors in the setting of the scoring criteria can be easily identified. Furthermore, combining multiple reference figures allows for detailed and flexible setting of scoring criteria.

[0099] In the first embodiment, the reference rectangle 62 as a reference figure represents judgment areas R0 and R1 with the reference rectangle 62 as a boundary line, and the scoring criterion data 332 is used in the scoring process to determine whether the answer figure 71 passes through the judgment areas R0 and R1. In the second embodiment, the reference lines 63 and 64 as reference figures represent judgment areas R2 and R3 with the reference lines 63 and 64 as boundary lines, and the scoring criterion data 332 is used in the scoring process to determine whether the answer figure 71 passes through the judgment areas R2 and R3. This allows the correct answer range used in the scoring criterion to be easily set in a visual and intuitive manner.

[0100] In the first embodiment, the reference rectangle 62 as a reference figure represents the judgment areas R0 and R1 whose boundaries are the reference rectangle 62, and the marking criterion data 332 is used in the marking process to determine whether the end points P0 and P1 as feature points of the answer figure 71 are located within the judgment areas R0 and R1. This allows the correct answer range used in the marking criterion to be easily set in a visual and intuitive manner.

[0101] In Example 5, answer figures 77a, 77b, 78a, 78b, and 79a are graphs of straight lines or curves, and the characteristic points are the end points of the straight lines, or the end points, maximum points, minimum points, or inflection points of the curves. This allows the scoring criteria for questions that require drawing straight lines or curves to be set simply and appropriately.

[0102] In addition, in Examples 1, 3, and 4, the reference rectangles 62, 65, and 66 serving as reference figures are rectangles having sides parallel to the coordinate axes of the coordinate plane 51. This allows the positional relationship between the reference figure and the answer figure to be identified by simple processing.

[0103] In addition, in the first, third, and fourth embodiments, the CPU 11 specifies the positions of the reference rectangles 62, 65, and 66 on the coordinate plane 51 based on a user operation that specifies the positions of opposite vertices of the reference rectangles 62, 65, and 66 on the coordinate plane 51. This allows the reference graphic to be displayed with a simple operation.

[0104] In addition, in the second embodiment, the reference graphic includes two reference lines 63 and 64, and represents a determination region R4 whose boundaries are the two reference lines 63 and 64. This allows the determination region to be set simply and flexibly by adjusting the slope and intercept of each reference line.

[0105] Furthermore, in the second embodiment, the CPU 11 sets the determination regions R2 and R3 based on a user operation for designating one side or the other of the reference lines 63 and 64 on the coordinate plane 51, and the user operation for designating one side or the other of the reference lines 63 and 64 is an operation for positioning a predetermined cursor 55 on one side or the other of the reference lines 63 and 64 on the display screen on which the reference lines 63 and 64 are displayed. This makes it possible to designate the determination regions with a simple operation.

[0106] Furthermore, the scoring criteria data 332 according to the third and fifth embodiments are used in the scoring process to determine the shape similarity between the answer graphic and the reference graphic, thereby enabling the scoring criteria for the shape similarity to be easily set in a visual and intuitive manner.

[0107] Furthermore, the reference rectangle 66 as the reference figure in the fourth embodiment is a figure that occupies a predetermined area on the coordinate plane 51, and the marking criteria data 332 is used in the marking process to determine the comparison of the areas of the answer figure 76 and the reference rectangle 66. This allows the marking criteria for the area comparison to be easily set in a visual and intuitive manner.

[0108] Moreover, the scoring criterion data 332 according to the fifth embodiment is used in the scoring process to determine the distance between the endpoints as the characteristic points of the answer figures 77a and 77b in Fig. 20 and the reference lines 67a and 67b as the reference figures. This allows the scoring criterion for the distance from the reference figure (i.e., the position of the answer figure) to be easily set in a visual and intuitive manner.

[0109] Furthermore, the CPU 11 executes the marking process based on the marking individual data 334 including the marking standard data 332 and the answer data 333 related to the answer figure. This allows automatic marking based on the set marking standard.

[0110] The scoring system 1 according to this embodiment also includes a CPU 11 of the scoring server 10 as a first processing unit and a second processing unit. The CPU 11 as the first processing unit generates scoring criteria data 332 that is referenced in the scoring process of an answer figure for a question that requires a figure to be drawn on a Cartesian coordinate system, which is a coordinate plane 51. The CPU 11 as the second processing unit executes the scoring process based on individual scoring data 334 that includes the scoring criteria data 332 and answer data 333 related to the answer figure. The CPU 11 as the first processing unit draws a reference figure (such as a reference line 61 and a reference rectangle 62) on the coordinate plane 51 displayed on the display unit 25 of the client terminal 20 based on a user operation, and generates scoring criteria data 332 that includes information related to the scoring criteria determined based on the reference figure. This allows the scoring criteria to be easily set in a visually and intuitive manner.

[0111] Furthermore, the scoring criteria generation program 131 according to this embodiment causes the CPU 11 of the scoring server 10 as a computer to execute a process of generating scoring criteria data 332 that is referenced in the scoring process of an answer figure to a question that requires a figure to be drawn on a Cartesian coordinate system that is the coordinate plane 51. In this process, the CPU 11 draws a reference figure (a reference line 61, a reference rectangle 62, etc.) on the coordinate plane 51 displayed on the display unit 25 of the client terminal 20 based on a user operation, and generates the scoring criteria data 332 that includes information related to the scoring criteria that has been determined based on the reference figure. This allows the scoring criteria to be easily set in a visual and intuitive manner.

[0112] Moreover, the information processing method according to this embodiment is an information processing method executed by the CPU 11 of the scoring server 10 as a computer, and includes a step of generating scoring criteria data 332 to be referenced in the scoring process of an answer figure to a question that requires a figure to be drawn on a Cartesian coordinate system that is the coordinate plane 51. In this step, based on a user operation, a reference figure (reference line 61, reference rectangle 62, etc.) is drawn on the coordinate plane 51 displayed on the display unit 25 of the client terminal 20, and scoring criteria data 332 including information related to the scoring criteria determined based on the reference figure is generated. This allows the scoring criteria to be easily set in a visual and intuitive manner.

[0113] <Other> The description of the above embodiment is merely an example of the information processing device, information processing system, program, and information processing method according to the present invention, and the present invention is not limited to this. For example, in the above embodiment, an example has been described in which the scoring system 1 includes the scoring server 10, the client terminal 20, and the client server 30, but this is not limited to this. For example, the scoring system 1 may have a single information processing device that includes the functions of the scoring server 10, the client terminal 20, and the client server 30. Furthermore, the functions of the scoring server 10, the client terminal 20, and the client server 30 may be shared among any number of information processing devices, two or more of which may perform the functions. Furthermore, some of the functions may be realized by cloud computing. For example, a CPU (first processing unit) that provides a scoring criterion generation UI and generates the scoring criterion data 332 and a CPU (second processing unit) that performs the scoring process may be provided in separate servers.

[0114] Furthermore, the processes related to the generation of the scoring criteria data 332 and the programs and data used in the scoring process (for example, the scoring criteria generation program 131, the scoring program 132, the automatic scoring script 331, the scoring criteria data 332, the answer data 333, the individual scoring data 334, and the scoring result data 335) do not necessarily have to be stored in the memory unit shown in the above embodiment, but may be stored in any external file server, etc.

[0115] Furthermore, the scoring logic related to the scoring criteria is not limited to the one exemplified in the above embodiment, as long as it refers to the position or shape of the reference graphic in some way.

[0116] In addition, an example has been given in which scoring processing is performed using individual scoring data 334 obtained by inserting answer data 333 into scoring criteria data 332, but this is not limited to this, and scoring processing can be performed in any manner as long as it refers to scoring criteria information related to the scoring criteria and answer information related to the answer.

[0117] In the above embodiment, an example has been described in which a figure is drawn on an xy Cartesian coordinate system, which is a coordinate plane, but the present invention is not limited to this and may be applied to a case in which a figure is drawn on an xyz Cartesian coordinate system, which is a coordinate space. In this case, the reference figure, answer figure, and correct figure may be three-dimensional in the coordinate space.

[0118] Furthermore, it goes without saying that the detailed configurations and detailed operations of each component of the scoring system 1, scoring server 10, client terminal 20 and client server 30 in the above embodiment can be modified as appropriate within the scope that does not deviate from the spirit of the present invention.

[0119] Although the embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and its equivalents. The inventions described in the claims originally attached to this application are as follows. The claim numbers described in the appendix are the same as those of the claims originally attached to this application. [Note] <Claim 1> a processing unit that generates marking criteria information that is referenced in marking a figure that is an answer to a question that requires the drawing of a figure on a coordinate plane or a coordinate space, which is an orthogonal coordinate system; The processing unit draws a reference graphic in the orthogonal coordinate system displayed on a display unit based on a user operation, and generates the scoring criteria information including information related to the scoring criteria determined based on the reference graphic. 1. An information processing device comprising: <Claim 2> the reference figure represents a predetermined judgment area having the reference figure as a boundary line; The marking criteria information is used in the marking process to determine whether the answer figure passes through the determination area. 2. The information processing device according to claim 1, <Claim 3> the reference figure represents a predetermined judgment area having the reference figure as a boundary line; The marking criteria information is used in the marking process to determine whether a predetermined feature point of the answer figure is located within the determination area. 2. The information processing device according to claim 1, <Claim 4> The answer figure is a straight line or curved line graph, The characteristic points are the end points of the straight line, or the end points, maximum points, minimum points, or inflection points of the curve. 4. The information processing device according to claim 3, <Claim 5> 5. The information processing device according to claim 2, wherein the reference graphic is a rectangle having sides parallel to the coordinate axes of the Cartesian coordinate system. <Claim 6> 6. The information processing device according to claim 5, wherein the processing unit identifies the position of the reference graphic in the orthogonal coordinate system based on the user operation that specifies the position of the opposite vertex of the reference graphic in the orthogonal coordinate system. <Claim 7> 5. The information processing device according to claim 2, wherein the reference graphic includes two or more reference lines and represents the determination region having the two or more reference lines as boundary lines. <Claim 8> the processing unit sets the determination region based on the user operation of indicating one side or the other side of the reference line in the orthogonal coordinate system; The information processing device according to claim 7, characterized in that the user operation for indicating one side or the other side of the reference line is an operation for positioning a predetermined cursor on one side or the other side of the reference line on a display screen on which the reference line is displayed. <Claim 9> 2. The information processing apparatus according to claim 1, wherein the marking standard information is used in the marking process to determine whether the answer graphic and the reference graphic are similar in shape. <Claim 10> the reference figure is a figure occupying a predetermined area in the orthogonal coordinate system, 2. The information processing apparatus according to claim 1, wherein the marking standard information is used in the marking process for making a judgment regarding a comparison of the areas of the answer graphic and the reference graphic. <Claim 11> 2. The information processing apparatus according to claim 1, wherein the marking standard information is used in the marking process to determine a distance between a predetermined feature point of the answer figure and the reference figure. <Claim 12> 12. The information processing device according to claim 1, wherein the processing unit executes the marking process based on the marking criteria information and answer information related to the answer figure. <Claim 13> a first processing unit and a second processing unit; the first processing unit generates marking criteria information to be referenced in marking a figure as an answer to a question that requires a figure to be drawn on a coordinate plane or a Cartesian coordinate system that is a coordinate space; The second processing unit executes the scoring process based on the scoring criteria information and the answer information related to the answer figure, The first processing unit draws a reference figure in the orthogonal coordinate system displayed on a display unit based on a user operation, and generates the scoring criteria information including information related to scoring criteria determined based on the reference figure. An information processing system comprising: <Claim 14> causing the computer to execute a process of generating marking criteria information to be referenced in a marking process of an answer figure to a question that requires the drawing of a figure on a coordinate plane or a Cartesian coordinate system that is a coordinate space; In the process, a reference figure is drawn in the orthogonal coordinate system displayed on the display unit based on a user operation, and the scoring criteria information including information related to the scoring criteria determined based on the reference figure is generated. A program characterized by: <Claim 15> 1. A computer-implemented information processing method, comprising: generating marking criteria information to be referenced in marking a figure as an answer to a question that requires the drawing of a figure on a coordinate plane or a coordinate space, which is a Cartesian coordinate system; In the step, a reference figure is drawn in the orthogonal coordinate system displayed on the display unit based on a user operation, and the scoring criteria information including information related to the scoring criteria determined based on the reference figure is generated. An information processing method comprising: [Explanation of symbols]

[0120] 1. Scoring system (information processing system) 10. Scoring server (information processing device) 11 CPU (processing unit, first processing unit, second processing unit) 13 Storage section 131 Scoring Criteria Generation Program 132 Scoring Program 20 Client Terminals 21 CPU 23 Memory section 231 browsers 25 Display section 251 Scoring criteria setting screen 252 Reference Shape Setting Screen 30 Client Server 31 CPU 33 Storage section 331 Auto-scoring script 332 Scoring criteria data (scoring criteria information) 333 Response data (response information) 334 Individual data for scoring (scoring criteria information, response information) 335 Scoring result data 41 Reference Answer Information 42 Reference shape information 43 Answer information 44 Scoring Variable Information 45 Scoring logic information 461 Question ID 462 Question ID 47 Save button 48 Reference Drawing Button 49 Default precision 51 Coordinate plane (Cartesian coordinate system) 52 Mode selection button 53 Text Box 54 Information display section 55 cursor 61, 63, 64, 67a, 67b, 68a, 68b, 69a Reference lines (reference figures) 62, 65, 66, 69b Reference rectangle (reference figure) 71, 75, 76, 77a, 77b, 78a, 78b, 79a Answer shapes N Communication Network P0, P1 End points (feature points) R0~R7 Judgment area U0, U1 answer area

Claims

1. a first process for acquiring marking criteria information to be referenced in a marking process of an answer figure to a question that requires a computer to draw a figure on a coordinate plane or a Cartesian coordinate system that is a coordinate space; a second process of transmitting the acquired scoring criteria information to a server that is different from the external computer device operated by the user and that has a storage unit that stores individual data managed by the user; In the first process, when a predetermined user operation is received, a reference figure is drawn in the orthogonal coordinate system displayed on a display unit of the computer device, and the scoring criteria information including information related to the scoring criteria determined based on the reference figure is acquired. A program characterized by:

2. the reference figure represents a predetermined judgment area having the reference figure as a boundary line; The marking criteria information is used in the marking process to determine whether the answer figure passes through the determination area.

2. The program according to claim 1 .

3. the reference figure represents a predetermined judgment area having the reference figure as a boundary line; The marking criteria information is used in the marking process to determine whether a predetermined feature point of the answer figure is located within the determination area.

2. The program according to claim 1 .

4. The answer figure is a straight line or curved line graph, The characteristic points are the end points of the straight line, or the end points, maximum points, minimum points, or inflection points of the curve.

4. The program according to claim 3.

5. 5. The program according to claim 2, wherein the reference graphic is a rectangle having sides parallel to the coordinate axes of the Cartesian coordinate system.

6. 6. The program according to claim 5, wherein the program causes the computer to execute a process of identifying the position of the reference figure in the orthogonal coordinate system based on a user operation that specifies the position of the opposite vertex of the reference figure in the orthogonal coordinate system.

7. 5. The program according to claim 2, wherein the reference graphic includes two or more reference lines and represents the determination area having the two or more reference lines as boundary lines.

8. causing the computer to execute a process of setting the determination region based on a user operation of indicating one side or the other side of the reference line in the orthogonal coordinate system; The program according to claim 7, characterized in that the user operation for indicating one side or the other side of the reference line is an operation for positioning a predetermined cursor on one side or the other side of the reference line on a display screen on which the reference line is displayed.

9. 2. The program according to claim 1, wherein the marking criteria information is used in the marking process to determine whether the answer graphic and the reference graphic are similar in shape.

10. the reference figure is a figure occupying a predetermined area in the orthogonal coordinate system, 2. The program according to claim 1, wherein the marking criteria information is used in the marking process to make a judgment regarding a comparison between the areas of the answer graphic and the reference graphic.

11. 2. The program according to claim 1, wherein the marking criteria information is used in the marking process to determine a distance between a predetermined feature point of the answer figure and the reference figure.

12. 12. The program according to claim 1, wherein the computer executes the marking process based on the marking criteria information and answer information related to the answer figure.

13. a first processing unit and a second processing unit; the first processing unit acquires marking criteria information to be referenced in marking a figure as an answer to a question that requires a figure to be drawn on a coordinate plane or a coordinate space, which is a Cartesian coordinate system; the second processing unit executes the scoring process based on the scoring criteria information and answer information related to the answer figure; When a predetermined user operation is received, the first processing unit draws a reference figure in the orthogonal coordinate system displayed on a display unit of an external computer device operated by the user, and acquires the scoring criteria information including information related to scoring criteria determined based on the reference figure; The acquired scoring criteria information is transmitted to a server that is different from the computer device and has a storage unit that stores individual data managed by the user. An information processing system comprising:

14. a processing unit for acquiring grading criteria information to be referenced in grading a figure as an answer to a question that requires the drawing of a figure on a coordinate plane or a coordinate space, which is a Cartesian coordinate system; When the processing unit receives a predetermined user operation, the processing unit draws a reference figure in the orthogonal coordinate system displayed on a display unit of an external computer device operated by the user, and acquires the scoring criteria information including information related to scoring criteria determined based on the reference figure; The acquired scoring criteria information is transmitted to a server that is different from the computer device and has a storage unit that stores individual data managed by the user.

1. An information processing device comprising:

15. 1. A computer-implemented information processing method, comprising: a first step of acquiring marking criteria information to be referenced in marking a figure as an answer to a question that requires the drawing of a figure on a coordinate plane or a coordinate space, which is a Cartesian coordinate system; a second step of transmitting the acquired scoring criteria information to a server that is different from the external computer device operated by the user and that has a storage unit that stores individual data managed by the user, In the first step, when a predetermined user operation is received, a reference figure is drawn in the orthogonal coordinate system displayed on a display unit of the computer device, and the scoring criteria information including information related to the scoring criteria determined based on the reference figure is acquired.

1. An information processing method comprising:

Images