Test management device, test management system, test management program, and test management method

Abstract

To provide a test management device, a test management system, a test management program, and a test management method that ensure the fairness of online tests and increase their reliability. [Solution] An exam management device has a control unit that acquires a photographed image of an answered sheet, which is an answer sheet after answering written questions, and registers it in a memory unit as a first image. The control unit acquires a photographed image of a masked sheet, which is an answer sheet after masking processing that masks at least the answer portion, and registers it in the memory unit as a second image. The exam management system has an exam terminal, a portable device, and an exam management device. The exam terminal has a display unit that displays a written screen including the question text of the written questions. The portable device has a camera that photographs the answered sheet.

Description

[Technical Field]

[0001] The present invention relates to a test management device, a test management system, a test management program, and a test management method for managing online tests. [Background technology]

[0002] Nowadays, so-called online exams, which are exams conducted online via the Internet, etc., have become widespread. Online exams can be roughly classified into two types: one where candidates gather at a designated venue to take the exam, and one where candidates take the exam at home or in a private booth. The latter has the advantage that candidates do not have to take the trouble of traveling to a testing venue.

[0003] Most online examination systems require candidates to select answers on an examination screen displayed on a monitor, but some systems including written examinations require candidates to write their answers on a paper answer sheet (see, for example, Patent Document 1). The system in Patent Document 1 is configured to print the answer sheet on a printer, send a scanned image of the answer sheet after the answers have been written to a server, and then perform grading and other tasks on the scanned image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-169971 Summary of the Invention [Problem to be solved by the invention]

[0005] However, when test takers take written tests at home, etc., it is difficult to immediately collect the answer sheets after answering, so there is a risk that not only the questions but also the answers written by the test takers may be leaked. In today's world where the Internet is widespread and information communication is easy, it is impossible to prevent information leaks, especially when tests are held with a time lag.

[0006] The present invention has been made to solve the above-mentioned problems, and aims to provide a test management device, test management system, test management program, and test management method that ensure the fairness of online tests and increase their reliability. [Means for solving the problem]

[0007] An exam management device according to one embodiment of the present invention has a control unit that acquires a photographed image of an answered sheet, which is an answer sheet after the written questions have been answered, and registers it in a memory unit as a first image, and the control unit acquires a photographed image of a masked sheet, which is an answered sheet after a masking process that masks at least the answer portion has been completed, and registers it in the memory unit as a second image.

[0008] An exam management system according to one embodiment of the present invention comprises an exam terminal equipped with a display unit that displays a written screen including the question text of a written question, a portable device equipped with a camera that photographs an answered sheet, which is the answer sheet after the answer has been completed, and an exam management device equipped with a control unit that acquires the photographed image of the answered sheet from the portable device and registers it in a memory unit as a first image, wherein the portable device uses the camera to photograph a masked sheet, which is the answered sheet after a masking process that masks at least the answer portion has been completed, and the control unit acquires the photographed image of the masked sheet from the portable device and registers it in the memory unit as a second image.

[0009] An exam management program according to one embodiment of the present invention causes one or more processors to acquire a photographed image of an answered sheet, which is an answer sheet after the written questions have been answered, and register it in a memory unit as a first image, and acquire a photographed image of a masked sheet, which is an answer sheet after a masking process that masks at least the answer portion has been completed, and register it in a memory unit as a second image.

[0010] An exam management method according to one embodiment of the present invention is configured to have one or more processors perform the following steps: acquiring a photographed image of an answered sheet, which is an answer sheet after the written questions have been answered, and registering it in a memory unit as a first image; and acquiring a photographed image of a masked sheet, which is an answer sheet after a masking process that masks at least the answer portion has been completed, and registering it in the memory unit as a second image. [Effects of the Invention]

[0011] According to the present invention, an image of the masked paper after the masking process is completed is registered, which allows the masking process for the answer sheet to be managed and at least the answer portion to be prevented from being leaked by the examinee, thereby ensuring the fairness of the online exam and increasing its reliability. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a configuration diagram illustrating a test management system according to an embodiment of the present invention; [Figure 2] 1. FIG. 4 is an explanatory diagram showing an example of a standby screen displayed on a display unit of the test terminal of FIG. [Figure 3] 1. FIG. 4 is an explanatory diagram showing another example of the standby screen displayed on the display unit of the test terminal of FIG. [Figure 4] 1. FIG. 4 is an explanatory diagram showing an example of a writing screen displayed on a display unit of the test terminal of FIG. [Figure 5] 5 is a schematic diagram illustrating an answer sheet printed via the writing screen of FIG. 4. [Figure 6] FIG. 6 is a schematic diagram illustrating the state in which answers have been written on the answer sheet of FIG. 5 (answered sheet). [Figure 7] 2 is an explanatory diagram illustrating an example of a photographing screen in an image photographing mode of the portable device of FIG. 1. FIG. [Figure 8] FIG. 7 is an explanatory diagram showing an example of a state in which a masking process has been performed on an answer sheet on which answers have been written as in FIG. 6. [Figure 9]FIG. 7 is an explanatory diagram showing another example of the state in which the answer sheet on which the answers have been written as in FIG. 6 has been subjected to a masking process. [Figure 10] 2 is a block diagram illustrating a functional configuration of the test terminal of FIG. 1. [Figure 11] 2 is a block diagram illustrating the functional configuration of the portable device of FIG. 1. FIG. [Figure 12] 2 is an explanatory diagram showing an example of an examination environment for an examinee taking an online examination using the examination management system of FIG. 1. [Figure 13] 10 is a sequence chart illustrating a flow of a test management method according to an embodiment of the present invention, up to the transmission of written data from the test management device to a test terminal. [Figure 14] 10 is a sequence chart illustrating a flow from the display of a writing screen to the end of a masking process in a test management method according to an embodiment of the present invention. [Figure 15] 10 is a sequence chart illustrating a process flow of a test management method according to an embodiment of the present invention, focusing on determining whether an answer sheet after masking processing can be read. [Figure 16] 11 is an explanatory diagram showing an example of a mask screen displayed on the display unit of the test terminal of FIG. 10 in the test management system according to Modification A of the embodiment of the present invention. FIG. [Figure 17] FIG. 7 is an explanatory diagram showing an example of a state in which an answer sheet on which answers have been written as in FIG. 6 has been subjected to masking processing by overprinting. [Figure 18] 10 is a sequence chart illustrating a process flow focusing on masking processing by overprinting in a test management method according to Modification A of the embodiment of the present invention. [Figure 19] 10 is an explanatory diagram showing an example of a writing screen displayed on the display unit of the testing terminal of FIG. 1 in the test management system according to the modified example B of the embodiment of the present invention. FIG. [Figure 20] FIG. 20 is a schematic diagram illustrating an answer sheet printed via the writing screen of FIG. 19. [Figure 21]FIG. 21 is an explanatory diagram showing an example of the state in which the answer sheet of FIG. 20 has been masked after the answers have been written. [Figure 22] 10 is an explanatory diagram showing an example of a writing screen displayed on the display unit of the testing terminal of FIG. 1 in the test management system according to the modified example C of the embodiment of the present invention. FIG. [Figure 23] 10 is a schematic diagram illustrating an example of an answer sheet prepared by an examinee or the like in an examination management system according to variant C of an embodiment of the present invention. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0013] Embodiment 1 to 15, an example of the overall configuration, an example of the functional configuration, and an example of the operation of a test management system 100 according to an embodiment of the present invention will be described. The same reference numerals will be used for components common to each figure, and their description will be omitted or simplified as appropriate. In each figure, some reference numerals will be omitted as appropriate to avoid cluttering the drawings.

[0014] The test management system 100 manages online tests (hereinafter simply referred to as "tests") and, as shown in FIG. 1, includes at least a test management device 10 and a test terminal 30. The test management system 100 may include a portable device 40, a printer 50, or an operation terminal 20. The test management device 10, the operation terminal 20, the test terminal 30, and the portable device 40 are capable of wired or wireless communication via a network N such as the Internet.

[0015] In FIG. 1, each examinee's test location is indicated by a dashed line and marked with the symbol Z. In other words, FIG. 1 illustrates an example in which an exam terminal 30, a portable device 40, and a printer 50 are installed at each exam location for each examinee. Each examinee takes the exam using the exam terminal 30, the portable device 40, and the printer 50 at their respective exam location. The exam location is assumed to be a private room in the examinee's home or similar location. The exam venue may be a private booth (such as a rental work booth or a private room in an internet cafe) as long as the printer 50 is installed. While the printer 50 does not necessarily have to be installed at the exam location, it is desirable to install the printer 50 at the exam location to prevent cheating and information leaks. However, the exam location may also be a public hall where multiple examinees share a single printer 50.

[0016] Examinees register personal information such as their name, unique identification information (such as an ID or email address), and unique passwords in the system via the test terminal 30 or the portable device 40. However, at least one of the identification information and password may be provided by the test management device 10. For example, by inputting the identification information and password into a login screen provided by the test management device 10, the examinee can operate the system and take the online test while being guided by various pieces of information. However, the test terminal 30 and the portable device 40 may be operated by an assistant to the examinee.

[0017] The test management device 10 manages the application, check-in process, implementation, etc. of the online test. The test management device 10 is configured to provide online tests to multiple test takers who have completed the test application procedure. The test management device 10 is configured as a cloud server based on cloud computing, an on-premise physical server, or a server system that combines these. An example of the functional configuration of the test management device 10 will be described later.

[0018] The operation terminal 20 is a PC (Personal Computer) or the like provided by the test management device 10 and used by the operator of the online test-related system (hereinafter referred to as the present system). PCs include desktop PCs, notebook PCs, tablet PCs, smartphones, etc. An operator on the operation side adds and edits information on the software and databases managed by the test management device 10 via the operation terminal 20, and performs maintenance of the present system.

[0019] The examination terminal 30 is a PC or the like used by examinees when taking online examinations. The examination terminal 30 is used, for example, to register examinees' personal information, process examination applications, and photograph answer sheets for written questions. A desktop PC or a notebook PC is desirable as the examination terminal 30. An example of the functional configuration of the examination terminal 30 will be described later.

[0020] The portable device 40 may be used for registering personal information of examinees and applying for exams. The portable device 40 is not limited to a device owned by the examinee, but may also be a device loaned to the examinee. Each examinee takes the online exam with at least one portable device 40 nearby. The portable device 40 must be equipped with a camera. A smartphone or tablet PC is preferable as the portable device 40, but a web camera or digital camera connectable to the exam terminal 30 may also be used as long as it is capable of at least transmitting captured images to the exam management device 10. An example of the functional configuration of the portable device 40 will be described later.

[0021] The printer 50 is a device that receives information including characters, figures, etc. from a PC or the like and prints the received information on a medium such as paper. The printer 50 is set up in advance so that it can print print data transmitted from the test terminal 30 via wired or wireless communication onto a paper medium. The printer 50 may also have a scanner function.

[0022] The test management device 10 includes a communication unit 11, a control unit 12, and a storage unit 13. The communication unit 11 is an interface that allows the control unit 12 to communicate with external devices such as the operation terminal 20, the test terminal 30, and the mobile device 40 via wired or wireless communication. The control unit 12 provides various information in response to requests from the external devices. The control unit 12 stores information transmitted from the external devices such as the test terminal 30 and the mobile device 40 in the storage unit 13 as appropriate. The control unit 12 is configured with one or more processors. More specifically, the control unit 12 is configured with a processing unit such as a central processing unit (CPU), a micro processing unit (MPU), or a graphics processing unit (GPU), and various functions of the control unit 12 are realized by the processing unit and a control program such as the test management program 13p. Some of the various functions of the control unit 12 may be realized by hardware.

[0023] 1, the control unit 12 has an information processing means 12a, an output processing means 12b, and an image capture management means 12c. The information processing means 12a executes processing related to login from the test terminal 30 and the portable device 40. Note that the login processing on the portable device 40 may be simple, such as entering a number displayed on the test terminal 30 or reading a QR code (registered trademark).

[0024] The output processing means 12b transmits the initial data to the examination terminal 30, thereby displaying an initial screen on the display unit 34 of the examination terminal 30. The initial screen or a screen transitioning from it may display the examination reserved by the logged-in examinee in a specifiable manner. When the output processing means 12b receives designation information, which is information about the examination designated on the initial screen or the like, it transmits immediately before start data for final confirmation before the start of the examination to the examination terminal 30, thereby displaying a standby screen G1, for example, as shown in FIG. 5 or FIG. 6, on the display unit 34.

[0025] The standby screen G1 shown in Figures 2 and 3 has a name section C that displays the name of the exam, a schedule display section D that displays the date or time when the exam will be held, and a personal display section E that displays the examinee's personal information. Figures 2 and 3 show an example in which a pre-set examinee ID is displayed in the personal display section E. The standby screen G1 shown in Figure 2 has a start button F that accepts an operation by the examinee to start the exam. The standby screen G1 shown in Figure 3 has a start information section J that displays information related to the start time of the exam. The start information section J in Figure 3 displays information in countdown format that shows the time remaining until the start of the exam.

[0026] If you want to have a certain degree of flexibility in the start time of the test, the standby screen G1 with the start button F as shown in Figure 2 is preferable, but if you want to strictly manage the start time of the test, the standby screen G1 as shown in Figure 3 is preferable. However, the information displayed on the standby screen G1 is not limited to the examples in Figures 2 and 3, and can be selected and changed as needed.

[0027] The output processing means 12b transmits test data including one or more test questions to the test terminal 30, thereby displaying a test question screen on the display unit 34 of the test terminal 30. For example, the output processing means 12b transmits multiple-choice data as test data to the test terminal 30, thereby displaying a multiple-choice screen (not shown) as a test question screen on the display unit 34. The output processing means 12b transmits written data as test data to the test terminal 30, thereby displaying a written screen G2 including the question text of the written question on the display unit 34. The output processing means 12b may display a written screen G2 on the display unit 34, in which printing of the answer sheet is limited to one time. In this case, the output processing means 12b manages a print log indicating printing on the printer 50.

[0028] FIG. 4 is an explanatory diagram showing an example of a written screen G2 displayed on the display unit 34 of the examination terminal 30. The written screen G2 shown in FIG. 4 includes a question section Ta, a personal information section U, a name section C, a status section S, and a print button P1. In the written screen G2 of FIG. 4, the question section Ta is the area to be printed, and includes a question section Ro where the question text and the like are written, and an answer section Ko where the answers are written after printing. The question section Ta may have one or more identification sections Sk for identifying the answer sheet. FIG. 4 shows an example in which the question section Ta has two identification sections Sk, one of which is the question number and the other is the examinee ID. The notation method and arrangement of the identification sections Sk are not limited to the example of FIG. 4 and can be changed as desired.

[0029] The question section Ro may have guide sections V at the four corners for positioning when photographing. Figure 4 shows an example in which the examinee's ID is displayed in the personal information section U, but the examinee's personal information displayed in the personal information section U can be changed as desired. The name section C is where the name of the exam is displayed. The status section S displays information indicating the progress of the exam. The status section S in Figure 4 indicates that question "TA-001" has finished and question "TA-002" is in progress. The answer section Ko does not necessarily have to be surrounded by a frame or the like.

[0030] The writing screen G2 shown in FIG. 4 has a print button P1 that accepts a command to print an answer sheet only once. The print button P1 may be configured so that once pressed and the printing data is sent to the printer 50, its color or other aspects change and it becomes inoperable. The aspect of the print button P1 may be controlled by the information processing unit 32 of the test terminal 30. The writing screen G2 does not have to have a print button P1. In such a configuration, the answer sheet will be printed directly using the print function of a browser or the like. In this case, the writing screen G2 may also be configured so that the answer sheet can be printed only once.

[0031] The written screen G2 may have an answer end button P2 for notifying the examinee that he or she has finished answering the answer sheet. When the answer end button P2 is pressed by the examinee, an answer end notification is sent from the examination terminal 30, and the output processing means 12b can detect that the answering has finished. The written screen G2 may have a mask end button P3 for notifying the examinee that the masking process has finished. When the mask end button P3 is pressed by the examinee, a mask end notification is sent from the examination terminal 30, and the output processing means 12b can detect that the masking process has finished.

[0032] The output processing means 12b may be configured to print an answer sheet including an identifier via the writing screen G2 by sending written data including information on the answer sheet for the written questions and information on an identifier for uniquely distinguishing the answer sheet to the examination terminal 30. The identifier is assigned to each answer sheet individually and is composed of numbers, letters, symbols, figures, or a combination thereof.

[0033] FIG. 5 is a schematic diagram illustrating an answer sheet printed via the writing screen G2. In FIG. 5, the answer sheet is labeled with the symbol "O" (the symbol is omitted where appropriate). The answer sheet O illustrated in FIG. 5 has a question section R, which is the question text, etc., and an answer column K corresponding to the answer section Ko. The answer column K does not necessarily have to be surrounded by a frame or the like. The answer sheet O illustrated in FIG. 5 has an identifier W that uniquely distinguishes the answer sheet O. The placement and size of the identifier W are not limited to the example in FIG. 5, but it is desirable to place it in a location where it is unlikely to overlap with the examinee's answers. The identifier W may be written vertically.

[0034] FIG. 6 illustrates the state in which the answers have been written on the answer sheet O in FIG. 5, and the answer sheet in this state will be referred to as the answered sheet P (reference numbers omitted where appropriate). The answered sheet P has answers (illustrated by multiple circles) written in the answer columns K, and this entire answer will be referred to as the answer section Ks. The question section R and the answer section Ks may contain not only letters but also figures and the like. At least one of the identification section Sk and the identifier W may be used to evaluate the authenticity of the answered sheet P (including after masking processing) when photographing the answered sheet P with the portable device 40.

[0035] For example, when detecting the end of the test, the output processing means 12b may transmit to the test terminal 30 photographing prompting data for prompting the test subject to photograph the answered answer sheet P, which is an answer sheet on which answers have been written, and may cause the display unit 34 to display information instructing the test subject to photograph the answered answer sheet P (photography instruction information). The photographing instruction information may be, for example, text information such as "Please photograph the answered answer sheet." The output processing means 12b may also cause the test terminal 30 to output information instructing the test subject to execute a masking process (masking instruction information) that masks at least the answer portion Ks. The masking instruction information may be, for example, information indicating the method or procedure of the masking process. The masking instruction information may be a simple explanatory text such as "Please black out the portion of the answer you have written so that it is not visible" or "Please attach a sticker so that the question and the portion of the answer you have written are not visible."

[0036] The photography management means 12c manages photography by the cameras 46a and 46b of the portable device 40 and the images or videos taken by these cameras, and has a command processing means 12m and a registration processing means 12n. For example, when the command processing means 12m detects that the answer to the written question has been completed or that the masking process for the answered paper P has been completed, the command processing means 12m sends an image photography command to the portable device 40, thereby causing the portable device 40 to start up an image photography mode.

[0037] When the command processing means 12m detects that the examinee has finished answering the answer sheet, it may set the portable device 40 to an image capture mode to capture the first image. The command processing means 12m may detect that the examinee has finished answering, for example, by receiving an answer completion notification from the test terminal 30 when the answer completion button P2 is pressed, or may detect that the examinee has finished answering by analyzing surveillance video, etc.

[0038] The command processing means 12m may set the portable device 40 to an image capturing mode to capture a second image when it detects the end of the masking process for the answered sheet P. The command processing means 12m may detect the end of the masking process, for example, by a mask end notification from the test terminal 30 when the mask end button P3 is pressed, or may detect the end of the masking process by analyzing surveillance video or the like.

[0039] In this embodiment, the image capture mode of the portable device 40 refers to a state in which the camera 46a is activated and the image captured by the camera 46a is displayed on the monitor unit Mo. The screen displayed on the display unit 44 in the video capture mode is referred to as the image capture screen G3. The image capture screen G3 may have a shutter button Bs for starting and stopping capture. However, the examinee may manually switch the portable device 40 into the image capture mode at any timing, without relying on the command processing means 12m.

[0040] FIG. 7 is an explanatory diagram illustrating an example of an image capture screen G3 displayed on the display unit 44 of the portable device 40. The image capture screen G3 illustrated in FIG. 7 includes a monitor unit Mo with guide sections Vb at its four corners and a shutter button Bs. The guide sections Vb at the four corners of the monitor unit Mo correspond to the guide sections Va at the four corners of the answered paper P. That is, the examinee may aim the camera 46a at the answered paper P before or after the masking process, adjust the position of the portable device 40 so that the guide sections Vb of the monitor unit Mo overlap with the guide sections Va of the answered paper P, and then touch the shutter button Bs. This allows the examinee to efficiently capture accurate images. However, the answer sheet may not have the guide sections Va. In this case, the examinee may align the guide sections Vb at the four corners of the monitor unit Mo with the four corners of the answered paper P when taking the image.

[0041] The image capture screen G3 may have a title section H as shown in Fig. 7. In the scene where the answered paper P is being photographed, the title section H displays a character string that evokes the subject of the photograph or the purpose of the subject, such as "Taking an image for grading." In the scene where the answered paper P is being photographed after the masking process, the title section H displays a character string that evokes the masking process, such as "Confirm obfuscation."

[0042] The command processing means 12m may send a video capture command to the portable device 40 at a predetermined timing before the start of the test, thereby causing the portable device 40 to activate video capture mode. Furthermore, when the command processing means 12m acquires the first image from the portable device 40, the command processing means 12m may cause the portable device 40 to enter video capture mode in order to capture an image of the examinee and his / her surroundings, that is, to capture an image of the examinee, etc., during the masking process.

[0043] In this embodiment, the video recording mode of the portable device 40 refers to a state in which the camera 46b is activated and the image captured by the camera 46b is displayed on the monitor. The screen displayed on the display unit 44 in the video recording mode is referred to as the video recording screen. The video recording screen may have a shutter button for starting and stopping recording. However, the examinee may manually switch the portable device 40 into the video recording mode at any timing, without relying on the command processing means 12m.

[0044] The registration processing means 12n acquires a photographed image of the answered sheet, which is the answer sheet after the written questions have been answered, and registers the photographed image as a first image in the storage unit 13. The registration processing means 12n acquires a photographed image of the masked sheet Q, which is the answered sheet after the masking process has been completed, and registers the photographed image as a second image in the storage unit 13. The registration processing means 12n may record video captured by the camera 46b as surveillance video.

[0045] The registration processing means 12n may have a function of managing the first image registration process and the second image registration process so that they are completed within a predetermined time range. If the last question is not a written question, the registration processing means 12n may manage the first image registration process and the second image registration process so that they are completed within a predetermined test time (during the test). In this case, the time range is set to a range within the test time. The registration processing means 12n may manage the first image registration process and the second image registration process so that they are completed within the test time even if the last question is a written question. However, the registration processing means 12n may manage the first image registration process and the second image registration process so that they are completed within the test time regardless of how the test is structured.

[0046] The registration processing means 12n may manage the registration processing of the first image and the registration processing of the second image so that they are performed within a time range that is the test time plus a set time. If the last question is a written question, the registration processing means 12n may manage the registration processing of the first image and the second image so that they are completed within a set time from the end of the test, when the test ends, for example, when the test finishes answering the written question. Alternatively, if the last question is a written question, the registration processing means 12n may manage the registration processing of the second image so that they are completed within a set time from the end of the test, when the test ends, when the testee or the like begins a masking process. However, in order to more strictly prevent information leakage, it is desirable to configure the registration processing of the first image and the second image to be performed during the test.

[0047] Even if the last question in the test is not a written question, the registration process of the first image and the second image related to one or more written questions may be configured to be performed at the end of the test. In this case, the registration processing means 12n may manage the registration process of the first image and the second image so that it is performed within the test time, or may manage the registration process of at least the second image so that it is performed within a set time from the end of the test time. However, in consideration of situations where the answer sheet is left for a certain period of time, even in such a configuration, it is desirable that the registration processing means 12n manage the registration process of the first image and the second image so that it is performed each time the written question is completed.

[0048] The registration processing means 12n may have a function to determine whether the answer portion Ks can be read in a captured image of an answered sheet that has been masked (temporarily masked sheet). If the registration processing means 12n determines that the answer portion Ks is unreadable, it may consider the masking process to be complete and register the captured image as a second image. The masking process may include masking not only the answer portion Ks but also the question portion R. In this case, the registration processing means 12n may have a function to determine whether the question portion R and the answer portion Ks can be read in a captured image of the temporarily masked sheet. If the registration processing means 12n determines that the question portion R and the answer portion Ks are unreadable, it may register the captured image as a second image.

[0049] The registration processing means 12n may determine whether the temporarily masked paper is readable by comparing the first image with the captured image of the temporarily masked paper, or may use only the captured image of the temporarily masked paper. For example, the registration processing means 12n may calculate the unreadability rate of characters, etc. in an image extracted from the answer column K or the entire area of ​​the temporarily masked paper, and compare the calculated unreadability rate with a threshold value to determine whether the temporarily masked paper is readable. The threshold value is set to, for example, 80% and can be changed as appropriate. A method such as natural language processing may be used to calculate the unreadability rate. The registration processing means 12n may determine whether the temporarily masked paper is readable by detecting the ratio of the mask M, which is the masked area, to the area within the answer column K or the entire area of ​​the temporarily masked paper, and comparing the detected ratio with a threshold value.

[0050] FIG. 8 illustrates an example in which the answer section Ks of the answered sheet P has been blacked out with a marker or the like, and FIG. 9 illustrates an example in which a masking member (sticker, etc.) has been affixed to the answer section Ks of the answered sheet P. In FIG. 8, the marker or the like corresponds to the mask M, and in FIG. 9, the masking member corresponds to the mask M. However, the registration processing means 12n does not need to have a function for determining whether or not the temporarily masked sheet can be read. For example, in the case of a method in which at least one of the question section R and the answer section Ks is covered with a masking member, it is considered that the possibility of insufficient masking is relatively low. Therefore, in such a case, the function for determining whether or not the sheet can be read may not be employed, and management of information leakage may be left to subsequent confirmation of the second image.

[0051] The information processing means 12a may be configured to manage each time, for example, as exemplified in the following Table 1. That is, the information processing means 12a may register in the storage unit 13 the times of displaying the written screen G2, printing the answer sheet, finishing answering on the answer sheet (finishing of answering), photographing the answered sheet (first photographing), registering the first image, finishing masking, photographing the answered sheet after masking (second photographing), registering the second image, and completing submission of information related to the written question.

[0052] The information processing means 12a may be configured to measure and manage the time from the display of the handwritten screen G2 to the end of answering, the time from the end of answering to the registration of the first image, the time from the first photograph to the second photograph, the time from the second photograph to the completion of submission, the time from the registration of the first image to the registration of the second image, the time from printing to the end of answering, the time from printing to the registration of the first image, the time from the display of the handwritten screen G2 to the registration of the second image, and the time from the display of the handwritten screen G2 to the completion of submission, as in the example of Table 1.

[0053] More specifically, the storage unit 13 may store reference times that serve as standards (such as standards that should not be exceeded) for the time from the display of the writing screen G2 to the end of answering, the time from the end of answering to the registration of the first image, the time from the first photographing to the second photographing, the time from the second photographing to the completion of submission, the time from the registration of the first image to the registration of the second image, the time from printing to the end of answering, the time from printing to the registration of the first image, the time from the display of the writing screen G2 to the registration of the second image, the time from the display of the writing screen G2 to the completion of submission, etc. The information processing means 12a may then time one or more of the above times, and if the time being measured exceeds the reference time, process so as not to accept the submission of the answer to the written question.

[0054] For example, a reference time (first reference time) that is a reference for the time from the completion of answering the written question to the registration of the first image may be stored in the storage unit 13, and the information processing means 12a may be configured to reject the answer to the written question (process the written question as unanswered) if the registration of the first image is not completed within the first reference time from the completion of answering the written question. Alternatively, a reference time (second reference time) that is a reference for the time from the registration of the first image to the registration of the second image may be stored in the storage unit 13, and the information processing means 12a may be configured to reject the answer to the written question (process the written question as unanswered) if the registration of the second image is not completed within the second reference time from the registration of the first image. The first and second reference times can be set arbitrarily and can be changed as appropriate. Considering the processing required for each section, it is preferable to set the second reference time longer than the first reference time. The information processing means 12a may manage various times, such as the time from the display of the handwriting screen G2 to the registration of the second image, in the same manner as described above.

[0055] [Table 1]

[0056] The information processing means 12a may generate a management certificate indicating that each registered time, each measured time, and each time period have not exceeded a reference time. The information processing means 12a may generate the management certificate in a VC (Verifiable Credential) format. The information processing means 12a may issue the management certificate in a tamper-proof state in a blockchain on a P2P network. The information processing means 12a may issue a URL or a two-dimensional code that displays the management certificate, instead of the management certificate itself.

[0057] The memory unit 13 stores various information as well as the operating programs of the control unit 12, including the test management program 13p. The test management program 13p is software that cooperates with a processing unit such as a CPU, MPU, or GPU to realize various functions. The test management program 13p causes one or more processors to function as the information processing means 12a, the output processing means 12b, and the imaging management means 12c.

[0058] The memory unit 13 stores information for displaying various screens (pages) on external devices such as the administration terminal 20, the examination terminal 30, and the portable device 40. The memory unit 13 includes an examinee database (examinee DB) in which information about examinees is organized. For example, examinees register personal information, including their names, in the examinee DB in advance using the examination terminal 30 or the portable device 40. The examinee's personal information includes identification information, a password for logging into the system, and the like. Some of the examinee's personal information may be pre-registered in the examinee DB by the administration side. The memory unit 13 is composed of RAM (Random Access Memory), ROM (Read Only Memory), flash memory, eMMC (Embedded Multi Media Card), SSD (Solid State Drive), HDD (Hard Disk Drive), or the like.

[0059] As shown in FIG. 10, the test terminal 30 includes a communication unit 31, an information processing unit 32, a storage unit 33, a display unit 34, and an input unit 35. The test terminal 30 may include a camera 36. The camera 36 is used to capture images inside the test terminal 30, such as a notebook PC. storehouse The camera 36 may be a camera or an external camera such as a web camera. The camera 36 has an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) and captures moving images and still images.

[0060] The communication unit 31 is an interface that enables the information processing unit 32 to communicate with external devices such as the test management device 10 via wired or wireless communication. The display unit 34 is, for example, a liquid crystal display (LCD) and displays various information in response to instructions from the information processing unit 32. The input unit 35 accepts input operations by examinees and the like and outputs operation signals corresponding to the content of the accepted operations to the information processing unit 32. The input unit 35 is, for example, composed of a keyboard and a pointing device such as a mouse or a trackball.

[0061] In response to operation signals from the input unit 35, the information processing unit 32, in cooperation with the test management device 10, displays a login screen, an initial screen, a standby screen G1, a test question screen (including a written screen G2), and other related information and sub-windows on the display unit 34. Each screen is composed of one or more web pages.

[0062] For example, the information processing unit 32 displays an initial screen on the display unit 34 based on initial data transmitted from the test management device 10. The information processing unit 32 accepts test specification and start operations via the initial screen or the like, and transmits specification information related to the specified test to the test management device 10. The information processing unit 32 displays a standby screen G1 on the display unit 34 based on the immediately preceding data transmitted from the test management device 10.

[0063] The information processing unit 32 sends a test start request or a question request to the test management device 10 at a predetermined timing, and displays a test question screen based on the returned test data on the display unit 34. For example, the information processing unit 32 displays a written screen G2 based on the written data returned from the test management device 10 on the display unit 34. Upon receiving an instruction to print an answer sheet for a written question, the information processing unit 32 sends printing data, which is information about the answer sheet, to the printer 50 via wired or wireless connection, and causes the printer 50 to output the answer sheet.

[0064] The information processing unit 32 may display photographing instruction information on the display unit 34 based on the photographing prompting data transmitted from the test management device 10. The information processing unit 32 may display the photographing instruction information on the currently displayed screen, may display a sub-window including the photographing instruction information, or may transition the currently displayed screen to another screen including the photographing instruction information. The information processing unit 32 may display masking instruction information on the display unit 34 based on the masking prompting data transmitted from the test management device 10. The information processing unit 32 may display the masking instruction information on the currently displayed screen, may display a sub-window including the masking instruction information, or may transition the currently displayed screen to another screen including the masking instruction information.

[0065] The information processing unit 32 is configured with an arithmetic processing device such as a CPU, MPU, or GPU, and various functions of the information processing unit 32 are realized by the arithmetic processing device and an operating program. Some of the various functions of the information processing unit 32 may be realized by hardware. The memory unit 33 stores various information in addition to the operating program of the information processing unit 32. The operating program of the information processing unit 32 also includes division programs transmitted from the test management device 10 as appropriate. The division programs constitute the test management program 13p. The information processing unit 32 can execute some processes, such as switching the display of each element on the screen, without communicating with the test management device 10, by operating based on the division programs. The operating program of the information processing unit 32 is software that cooperates with an arithmetic processing device such as a CPU, MPU, or GPU to realize various functions. The memory unit 33 is configured with RAM, ROM, flash memory, eMMC, SSD, HDD, etc.

[0066] 11, the portable device 40 has a communication unit 41, a portable control unit 42, a memory unit 43, a display unit 44, an input unit 45, a camera 46a, a camera 46b, a sound collection unit 47, and an alarm unit 48. The communication unit 41 is an interface that allows the portable control unit 42 to communicate with external devices such as the test management device 10 via wired or wireless communication. The sound collection unit 47 is a microphone that collects ambient sounds. The alarm unit 48 includes a speaker and outputs sound or voice.

[0067] Camera 46a and camera 46b each have an imaging element such as a CCD or CMOS, and capture video and still images. Camera 46a is a so-called out-camera, located on the opposite side of display unit 44, and is used to capture images of the answer sheet on which the answers have been written, and the answer sheet after masking. Camera 46b is a so-called in-camera, located on the same side as display unit 44, and is positioned to capture images of the examinee and their surroundings.

[0068] The display unit 44 is formed of, for example, a liquid crystal display, and displays various information in response to instructions from the mobile control unit 42. The input unit 45 accepts input operations by the examinee or the like, and outputs an operation signal corresponding to the content of the accepted operation to the mobile control unit 42. The mobile device 40 may have a touch panel configured by stacking the display unit 44 and the input unit 45. In such a configuration, the display unit 44 functions as a display panel that displays characters or images, and the input unit 45 functions as a detection means that detects touch operations.

[0069] In response to an operation signal from the input unit 45, the mobile control unit 42 works in cooperation with the test management device 10 to display a video capture screen, an image capture screen G3, and the like on the display unit 44. The mobile control unit 42 accepts operations by the examinee or the like via each screen and executes processing according to the operation content. For example, the mobile control unit 42 activates the camera 46b in response to a video capture command sent from the test management device 10, and displays a video capture screen on the display unit 44 that allows video capture by button operation. In response to an instruction to start video capture by the examinee or the like who has finished adjusting the angle of view of the camera 46b, the mobile control unit 42 distributes the captured video to the test management device 10 as surveillance video.

[0070] The mobile control unit 42 activates an image capture mode in response to an image capture command transmitted from the test management device 10. That is, the mobile device 40 activates the camera 46a in response to the image capture command and displays an image capture screen G3 on the display unit 44, which allows an image (still image) to be captured by operating a button. The mobile control unit 42 is configured with one or more processors. More specifically, the mobile control unit 42 is configured with an arithmetic processing unit such as a CPU, an MPU, or a GPU, and various functions of the mobile control unit 42 are realized by the arithmetic processing unit and an operating program. Some of the various functions of the mobile control unit 42 may be realized by hardware.

[0071] The memory unit 43 stores various information in addition to the operation program of the mobile control unit 42. The operation program of the mobile control unit 42 also includes divided programs transmitted from the test management device 10 as appropriate. The divided programs constitute the test management program 13p. The mobile control unit 42 can execute some processes, such as switching the display of each element on the screen and screen transitions related to capturing images with the cameras 46a and 46b, without communicating with the test management device 10, by operating based on the divided programs. The operation program of the mobile control unit 42 is software that realizes various functions in cooperation with a processing unit such as a CPU, MPU, or GPU. The memory unit 43 is composed of RAM, ROM, flash memory, eMMC, SSD, HDD, etc.

[0072] FIG. 12 is an explanatory diagram showing an example of the exam environment for an examinee taking an online exam using the exam management system 100. As shown in FIG. 12, the examinee accesses the system using the exam terminal 30 and displays the exam question screen on the display unit 34. The examinee answers the multiple-choice questions using a mouse or the like. For written questions, the examinee prints out an answer sheet using the printer 50 and writes the answers directly on the printed answer sheet.

[0073] When transmitting surveillance video to the test management device 10, the portable device 40 is positioned so that the camera 46b can capture images of the examinee and their surroundings during the test. If the surveillance video from the camera 46b is configured to be saved, even if the surveillance video is not in real time, the examinee may be disqualified through subsequent review, thereby preventing cheating by examinees. Furthermore, for example, if an examinee exceeds the time limit and is disqualified, if the surveillance video includes footage of the masking process, the reason why the examinee had difficulty completing the task can be confirmed after the fact, and relief measures can be taken.

[0074] In the case of Modification A described below, since malfunctions of the printer 50 have a significant impact on the masking process, surveillance footage is important for rescue measures. In Modification A, during the masking process, there may be time to point the camera 46b toward the printer 50 and capture surveillance footage.

[0075] Next, an example of a test management method according to this embodiment will be described with reference to the sequence charts of Figures 13 to 15. Figures 13 to 15 show an example of a test consisting of two questions: the first question is a multiple-choice question and the second question is a written question.

[0076] An examinee uses the exam terminal 30 to access the system via a URL or the like and performs operations for logging in. That is, when the exam management device 10 receives a login request from the exam terminal 30 via the login screen (step S101), it compares the examinee's identification information, etc. included in the login request with the identification information, etc. in the exam candidate DB (step S102). If the test management device 10 is successful in matching with the exam candidate DB, it sends initial data to the exam terminal 30 (step S103). Based on the initial data, the exam terminal 30 displays, for example, an initial screen on the display unit 34 that displays a designated exam that has been booked (step S104).

[0077] The test terminal 30 receives an operation on the initial screen to specify a test and to instruct its start (step S105), and transmits specification information related to the specified test to the test management device 10 (step S106). Upon receiving the specification information, the test management device 10 transmits previous data for standby before the start of the test to the test terminal 30 (step S107). Based on the previous data, the test terminal 30 displays a standby screen G1, such as that shown in FIG. 2 or 3, on the display unit 34 (step S108).

[0078] The examinee accesses the system from a URL or the like using the portable device 40 and performs operations to log in. For example, when the test management device 10 receives a login request from the portable device 40 via a login screen or the like (step S109), the test management device 10 performs verification based on the examinee's identification information or the like included in the login request (step S110), and then sends a video capture command to the portable device 40 (step S111).

[0079] The portable device 40 activates video capture mode in response to the video capture command. That is, the portable device 40 activates the camera 46b in response to the video capture command and displays the video capture screen on the display unit 44 (step S112). At this time, the examinee, etc., while checking the monitor unit of the video capture screen, adjusts the angle of view of the camera 46b so that at least the examinee's hands and the display unit 34 of the test terminal 30 are captured. It is more preferable to adjust the angle of view of the camera 46b so that the examinee's face is also captured. When the portable device 40 receives an instruction to start video capture, such as by the examinee, etc., pressing the shutter button on the video capture screen (step S113), the portable device 40 starts video capture using the camera 46b and distributes the video as surveillance video to the test management device 10 (step S114). The test management device 10 starts recording the surveillance video (step S115).

[0080] When the test starts at the time when the test is to start or when the start button F is pressed (step S116), the test terminal 30 sends a test start request to the test management device 10 (step S117). In response to the test start request, the test management device 10 sends multiple-choice data including information on the first question of the test to the test terminal 30 (step S118). Based on the multiple-choice data, the test terminal 30 displays a multiple-choice screen including the first question of the test on the display unit 34 (step S119).

[0081] The examination terminal 30 switches the display on the multiple-choice screen in response to an answer input operation by the examinee or the like (step S120), receives an instruction to submit (step S121), and sends a completion notice indicating the end of answering to the examination management device 10 (step S122). In response to the completion notice, the examination management device 10 receives the answer to the first question and sends written data including information on the second question to the examination terminal 30 (step S123). Based on the written data, the examination terminal 30 displays a written screen G2 including information on the written answer sheet on the display unit 34 (step S124).

[0082] The test terminal 30 receives a print instruction by pressing the print button P1 or the like (step S125), and transmits print data, which is information about the answer sheet, to the printer 50 via wired or wireless connection (step S126). The printer 50 prints and outputs the information about the answer sheet on a paper medium based on the print data (step S127).

[0083] The examinee or the like writes their answers on the output answer sheet. When the examination terminal 30 detects that the examinee has finished answering, for example by pressing the answer end button P2 (step S128), it sends an answer end notification indicating that the examinee has finished answering to the test management device 10 (step S129). The test management device 10 sends photography prompting data to the examination terminal 30 to prompt the examinee to take a photo of the answer sheet (step S130), and the examination terminal 30 displays photography instruction information on the display unit 34 based on the photography prompting data (step S131).

[0084] The test management device 10 also transmits an image capture command to the portable device 40 (step S132). The portable device 40 activates an image capture mode based on the image capture command. That is, the portable device 40 activates the camera 46a in response to the image capture command, and displays an image capture screen G3 on the display unit 44, which allows the user to capture an image by operating a button (step S133).

[0085] The examinee or the like holds the camera 46a facing the answer sheet and adjusts the camera 46a so that the entire answer sheet is captured as large as possible within the field of view of the camera 46a. At this time, the image captured by the camera 46a is transmitted to the test management device 10, and the control unit 12 may perform a process of verifying at least one of the identification unit Sk and the identifier W. That is, the control unit 12 may permit the photograph to be taken if the information on the identification unit Sk, etc. stored in the memory unit 13 matches the information on the identification unit Sk, etc. in the image, or may cause the display unit 44 to display an error message if the match is not successful. The verification process may be performed by the portable device 40.

[0086] In response to a press of the shutter button Bs, the portable device 40 photographs the answer sheet with the camera 46a (step S134). The portable device 40 displays a confirmation screen (not shown) on the display unit 44 to allow the user to confirm the image photographed by the camera 46a (step S135). In response to a submission instruction, such as a press of the upload button on the confirmation screen (step S136), the portable device 40 transmits the photographed image to the test management device 10 (step S137).

[0087] The test management device 10 registers the image transmitted from the portable device 40 as a first image in the storage unit 13. The control unit 12 may be configured to perform a similar matching process on at least one of the identification unit Sk and the identifier W in the image transmitted from the portable device 40. That is, if the control unit 12 can match the information on the identification unit Sk, etc. stored in the storage unit 13 with the information on the identification unit Sk, etc. in the image, it may register the image in the storage unit 13 as a first image. If the match cannot be made, it may cause the display unit 44 to display an error message, etc. The control unit 12 may leave a time signature indicating the time when the first image was registered. If a supervisor is monitoring the status of the test using a PC or the like, the supervisor may perform a final check of the information on the identification unit Sk, etc. before leaving an electronic signature (step S138).

[0088] The test management device 10 again sends a video capture command to the portable device 40 (step S139). The portable device 40 activates video capture mode based on the video capture command (step S140). At this time, the examinee, etc., may adjust the angle of view of the camera 46b so that the examinee and the display unit 34 are visible while checking the monitor unit of the video capture screen. When the portable device 40 receives the command to start video capture (step S141), it resumes video capture by the camera 46b and distributes the video to the test management device 10 as surveillance video (step S142). The test management device 10 starts recording the surveillance video (step S143).

[0089] When the test management device 10 has finished registering the first image for grading, it sends mask prompting data to the test terminal 30 to prompt the testee to mask the answered sheet (step S144). The test terminal 30 displays mask instruction information on the display unit 34 based on the mask prompting data (step S145). The testee or the like masks at least the answer portion Ks of the answered sheet. When the test terminal 30 detects the end of the masking process by, for example, pressing the mask end button P3 (step S146), it sends a mask end notification indicating the end of the masking process to the test management device 10 (step S147).

[0090] Upon receiving the mask end notification, the test management device 10 transmits an image capture command to the portable device 40 (step S148). The portable device 40 starts up an image capture mode based on the image capture command (step S149).

[0091] The examinee or the like holds the camera 46a facing the masked answer sheet (temporarily masked sheet) and adjusts the camera 46a so that the temporarily masked sheet is displayed as large as possible within the angle of view of the camera 46a. At this time, the image captured by the camera 46a may be transmitted to the test management device 10, and the control unit 12 may perform a matching process for at least one of the identification unit Sk and the identifier W. This matching process may also be performed by the portable device 40.

[0092] In response to the photographing operation, the portable device 40 photographs the temporarily masked paper with the camera 46a (step S150) and allows the photographed image to be confirmed on the confirmation screen (step S151). In response to the submission instruction on the confirmation screen (step S152), the portable device 40 transmits the photographed image to the test management device 10 (step S153). The test management device 10 provisionally registers the image transmitted from the portable device 40 as a temporary image in the storage unit 13 (step S154).

[0093] For example, the test management device 10 determines whether the answer portion Ks included in the provisional image is unreadable (step S155). If the test management device 10 determines that the answer portion Ks is unreadable (step S155 / Yes), it permanently registers the provisional image as the second image after the masking process is completed. Here, an answer sheet that has been subjected to the masking process and that has been determined to be unreadable is referred to as a masked sheet Q. The control unit 12 may be configured to perform a similar matching process on at least one of the identification portion Sk and the identifier W in the provisional image. That is, if the control unit 12 can match the information on the identification portion Sk, etc. stored in the memory unit 13 with the information on the identification portion Sk, etc. in the provisional image and the answer portion Ks is unreadable, it may register the provisional image in the memory unit 13 as the second image. If the match cannot be made, it may cause the display unit 44 to display an error message, etc. The control unit 12 may leave a time signature indicating the time when the second image was registered. If the supervisor is monitoring the status of the test using a PC or the like, the supervisor may make a final check of the information in the identification unit Sk and the like before leaving an electronic signature (step S156).

[0094] The test management device 10 transmits a receipt notification to the test terminal 30 indicating the completion of submission of the second image for managing information leakage from the answer sheet (step S157). Upon receiving the receipt notification, the test terminal 30 displays information indicating the completion of submission of the second image (completion information) on the display unit 34 in a subwindow or the like (step S158). The test terminal 30 then displays a test completion screen (not shown) indicating the end of the test on the display unit 34. Note that the test terminal 30 may communicate with the test management device 10 in response to an operation to confirm the completion information, and may display the test completion screen on the display unit 34 based on the information transmitted from the test management device 10 (step S159).

[0095] On the other hand, if the test management device 10 determines that the answer portion Ks included in the provisional image is readable (step S155 / No), it transmits mask addition data to the test terminal 30 to instruct the addition of masking to the answered sheet (step S201).The test terminal 30 displays additional instruction information instructing the addition of masking on the display unit 34 based on the mask addition data (step S202).

[0096] If the answer portion Ks or the like is readable (step S155 / No), the control unit 12 of the test management device 10 may analyze the provisional image to extract the insufficiently masked portion. Then, the control unit 12 may include information about the insufficiently masked portion in the mask addition data (step S201). Based on the mask addition data, the test terminal 30 may display, on the display unit 34, an explanation about the insufficiently masked portion or an image in which the insufficiently masked portion is highlighted in the provisional image as additional instruction information (step S202).

[0097] The examinee or the like re-masks any areas on the answered sheet that are not masked properly. Then, the test management system 100 executes the processes of steps S203 to S210 in the same manner as the processes of steps S146 to S153, moves to the process of step S154, and executes the process according to the result of the determination of whether the answer sheet can be read or not in the same manner as above.

[0098] Although the above processes are described in the order of the step numbers in each figure, the order of the processes is not limited to these examples, and some processes may be omitted. For example, when the login process of the portable device 40 is completed, the test management device 10 may not send a video capture command but may instead display an initial screen or the like on the portable device 40. If necessary, the examinee may switch the portable device 40 to video capture mode and distribute the captured video to the test management device 10. When the login process of the portable device 40 is completed, the test management device 10 may display information on the display unit 34 of the test terminal 30 encouraging the examinee to capture a video, or may output information from the notification unit 48 of the portable device 40 encouraging the examinee to capture a video. However, video capture by the portable device 40 is not required, and the processes related to the distribution and recording of surveillance video may be omitted.

[0099] When the test management device 10 receives the designation information, it may transmit the multiple-choice data together with the previous data to the test terminal 30 (step S107). In this case, the test terminal 30 can display a multiple-choice screen on the display unit 34 without communicating with the test management device 10 (step S116 → step S119). Similarly, if the first question of the test is a written question, the test management device 10 may transmit the written data together with the previous data to the test terminal 30 when it receives the designation information. The test management device 10 may transmit multiple test data collectively to the test terminal 30 when it receives the designation information or in response to a test start request. The initial screen may be a screen at a higher level than the example above, and a screen that allows the user to specify a reserved test may be displayed by transitioning from the initial screen, etc. The test management device 10 may determine whether both the question portion R and the answer portion Ks included in the provisional image are unreadable (step S155).

[0100] 13 to 15 are described assuming a test consisting of two questions, one multiple-choice and one written, and therefore the process proceeds from step S158 to step S159. However, if there are subsequent questions, test data is sent from the test management device 10 to the test terminal 30, and a test question screen based on the test data is displayed on the display unit 34. If the next question is multiple-choice, the test management system 100 executes the same processes as steps S118 to S121. If the next question is written, the test management system 100 executes the same processes as steps S123 to S158. Note that online tests may consist of only multiple-choice questions, only written questions, or any combination of one or more multiple-choice questions and one or more written questions. Some multiple-choice questions may have a free-form entry field where answers can be entered by typing.

[0101] As described above, in the test management device 10 of this embodiment, the control unit 12 acquires a photographed image of the answer sheet and registers it in the memory unit 13 as a first image, and also acquires a photographed image of the masked sheet Q, which is the answer sheet after the masking process is completed, and registers it in the memory unit 13 as a second image. In other words, after securing the first image to be used for grading, a second image in which at least the answer portion Ks is masked is registered. This makes it possible to manage the masking process on the answer sheet without interfering with grading and to prevent at least the answer portion Ks from being leaked by the examinee, thereby ensuring the fairness of the online test and increasing its reliability.

[0102] When the control unit 12 acquires the first image from the portable device 40, the control unit 12 may output information (mask instruction information) instructing the test terminal 30 to perform a masking process. This allows the test taker to quickly recognize the next action to be taken, thereby improving the smoothness of the test operation. The control unit 12 may manage the first image registration process and the second image registration process so that they are completed within the test time or within a set time from the end of the test time. In other words, the control unit 12 may be configured to count the time from the start of the test, and if the first image registration process and the second image registration process are not completed within the test time or by the end of the test time, the control unit 12 may be configured to determine that the test taker has failed due to the failure of the specified image. This prevents processing delays and suppresses information leakage.

[0103] The control unit 12 may be configured to reject the answer to a written question if the registration of the first image is not completed between the end of the written question and the first reference time, i.e., not accept the submission of the answer to the written question. This configuration can prevent the time between the end of the answer and the registration of the first image from being intentionally delayed, thereby reducing the potential for cheating and increasing the sense of tension and smoothness of the test. The control unit 12 may be configured to reject the answer to a written question if the registration of the second image is not completed between the registration of the first image and the second reference time, thereby reducing the potential for cheating and increasing the sense of tension and smoothness of the test. Furthermore, while a masking process is required before the registration of the second image, this configuration can increase the examinee's awareness of time, thereby improving the accuracy and speed of the masking process. However, the control unit 12 may manage various times in the same manner as above, such as the time from the display of the handwriting screen G2 to the registration of the second image.

[0104] When the control unit 12 detects that the examinee has finished answering the answer sheet, the control unit 12 may place the portable device 40, which is equipped with the camera 46a, in an image capture mode to capture a first image. When the control unit 12 detects that the masking process on the answered sheet has finished, the control unit 12 may place the portable device 40 in an image capture mode to capture a second image. The examinee, etc., may activate the camera 46 to capture the first and second images. However, as described above, configuring the camera 46 to automatically activate the capture mode can reduce the examinee, etc.'s efforts and shorten the work time. Furthermore, when the control unit 12 detects that the examinee has finished answering the answer sheet, the control unit 12 may place the portable device 40 in an image capture mode to capture a first image. When the control unit 12 acquires the first image from the portable device 40, the control unit 12 may place the portable device 40 in a video capture mode to capture an image of the examinee and his or her surroundings. By switching the capture mode in this manner, the angle of view of the camera 46b can be adjusted and capture of the masking process can be quickly started, thereby preventing fraudulent behavior during the masking process.

[0105] The control unit 12 may be configured to determine whether the answer section Ks is readable in the captured image of the masked answer sheet, and to register the captured image as a second image if it determines that the answer section Ks is unreadable. In this way, the answer section Ks is reliably rendered unreadable, more reliably preventing the information written on the answer sheet from leaking. The control unit 12 may also display a writing screen G2 on the display unit 34 of the test terminal 30, which limits printing of the answer sheet to one time. In this way, it is possible to prevent the question text from leaking and also to prevent the answer section Ks from leaking due to copying, etc.

[0106] The control unit 12 may transmit written data including information on the answer sheet for the written questions and information on an identifier for uniquely distinguishing the answer sheet to the examination terminal 30, thereby causing the display unit 34 to display the written screen G2 and print the answer sheet including the identifier via the written screen G2. This makes it possible to confirm that the paper has not been replaced between the printing of the answer sheet and the registration process of the second image. In other words, by comparing the identifiers of the answer sheet, the first image, and the second image, it is possible to confirm their commonality, thereby preventing cheating.

[0107] Incidentally, in the above example, masking is mainly performed on the answer section Ks (answer column K), but the present invention is not limited to this. The test management system 100 may also be configured to mask the question section R to prevent the questions from leaking out. The answer sheet may consist of a question sheet on which the questions are written and an answer sheet for writing the answers. In such a configuration, if the test management system 100 is set to perform masking processing on both the question sheet and the answer sheet, the test management system 100 may be configured to photograph the question sheet and answer sheet individually after masking processing to create the second image, or to photograph the question sheet and answer sheet side by side to create the second image.

[0108] The answer sheets may be distributed to the examinees in advance by mail or the like. In this case, the writing screen G2 may be a simple screen that merely displays the question number, and, for example, processes corresponding to steps S125 to S127 in FIG. 14 are not necessary. Masking materials (stickers, etc.) for masking may be distributed to the examinees in advance by mail or the like. The masking materials may be prepared by the examinee by printing out an image provided in advance on the web. In this case, the examinee may attach the masking materials to the answer sheets by gluing or the like. The test management method may include a step of shredding the masked sheets Q. For example, the test management system 100 may be configured to have a camera (such as camera 46b) capture the shredding of the masked sheets Q, and the captured video may be recorded as surveillance footage. This further reduces the risk of information leakage.

[0109] <Variation A> 1, etc., together with Figures 16 to 18, an example of the overall configuration, an example of the functional configuration, and an example of the operation of the test management system 100 according to Modification A of this embodiment will be described. The same reference numerals are used for the configurations common to the figures, and the description thereof will be omitted or simplified as appropriate.

[0110] In the test management device 10 of this modified example A, the control unit 12 (output processing means 12b) displays a masking screen G4, which is used to print a masking section Mn arranged so as to overlap at least the answer column K of the answered sheet, on the display unit 34 of the test terminal 30. That is, the output processing means 12b transmits masking guidance data to the test terminal 30 to guide the tester in masking the answered sheet, and the information processing unit 32 of the test terminal 30 displays the masking screen G4 on the display unit 34 based on the masking guidance data. The masking screen G4 is configured to hide a predetermined part of the answered sheet with a masking section Mn made up of black paint, shading, or the like.

[0111] FIG. 16 is an explanatory diagram showing an example of a masking screen G4. The masking screen G4 shown in FIG. 16 has a print area Tw, a personal information section U, a name section C, a status section S, and a print button Bp. The print area Tw is the area to be printed and has a mask section Mn arranged to overlap a set area on the answered form. The mask section Mn shown in FIG. 16 is sized to overlap almost the entire answer column K. The mask section Mn may be sized to overlap not only the answer section Ks but also the question section R, or may be divided into two. There is no limit on the number of times the print button Bp can be printed. The masking screen G4 may have a mask end button P3, but the print button Bp may have the same function as the mask end button P3.

[0112] When the print button Bp is pressed or the like with the answered paper set in the printer 50, the overprinting data is sent from the test terminal 30 to the printer 50. The printer 50 prints the mask section Mn on the answered paper based on the overprinting data, which is information about the print area Tw. As a result, the answered paper has a mask M corresponding to the mask section Mn printed on it, as shown in FIG. 17. In other words, the masked paper Q of this modified example A has been subjected to a masking process via the mask screen G4. The rest of the configuration of the test management system 100 is the same as that of the main part of the above-mentioned embodiment.

[0113] Next, the test management method in this modified example A will be described based on the sequence chart in Fig. 18. Fig. 18 mainly illustrates the operations related to the masking process by overprinting, and operations that overlap with those in Figs. 13 to 15 are indicated only by step numbers.

[0114] The test management system 100 executes the processes of steps S101 to S143 in the same manner as described with reference to Figs. 13 to 15. After completing the registration of the first image, the test management device 10 transmits mask guidance data to the test terminal 30 to guide the test terminal 30 in masking the answered sheet. The mask guidance data is information for displaying and functioning a mask screen G4 (step S301). Based on the mask guidance data, the test terminal 30 displays a mask screen G4, such as that shown in Fig. 16, on the display unit 34 (step S302).

[0115] The examinee or the like places the answered paper in the printer 50 so that the mask portion Mn is printed on the front side of the answered paper, and issues a printing instruction by pressing the print button P1 or the like. The test terminal 30 receives the printing instruction (step S303) and sends overprinting data for masking the answered paper to the printer 50 (step S304). The printer 50 prints an image of the mask portion Mn on the answered paper, overlaying it based on the overprinting data (step S305).

[0116] When the test terminal 30 detects the end of the masking process (step S146), it sends a mask end notification to the test management device 10 (step S147). Then, the test management system 100 executes the processes of steps S148 to S159 in the same manner as described with reference to FIGS. 13 to 15. That is, in response to the photographing operation, the portable device 40 photographs the answer sheet that has been subjected to masking by overprinting with the camera 46a, and the test management device 10 registers the photographed image for which a determination result of unreadable has been obtained as the second image. However, even in the test management system 100 of this modification A, the process of determining whether or not the sheet can be read may be omitted. The replacement or omission of other processes is also the same as the description based on FIGS. 13 to 15.

[0117] As described above, in the test management device 10 of Modification A, the control unit 12 displays the mask screen G4 on the display unit 34 of the test terminal 30. The mask screen G4 is used to print the mask section Mn, which is positioned so as to overlap at least the answer column K of the answered sheet. In other words, the masked sheet Q in Modification A is masked via the mask screen G4. In this way, in the test management system 100 of Modification A, the mask section Mn is overprinted on the answered sheet via the mask screen G4, thereby improving the accuracy of the masking process on the answered sheet and effectively preventing the leakage of information written on the answered sheet. Furthermore, in the test management system 100 of Modification A, a first image used for grading is secured, and then a second image in which at least the answer section Ks is masked is registered. Therefore, the leakage of at least the answer section Ks can be prevented without interfering with grading, ensuring the fairness of the online test and increasing its reliability. Other effects are the same as those of the main embodiment described above.

[0118] <Variation B> 19 to 21 as well as Fig. 1 etc., an example of the overall configuration, an example of the functional configuration, and an example of the operation of the test management system 100 according to Modification B of this embodiment will be described. The same reference numerals are used for the configurations common to the figures, and the description thereof will be omitted or simplified as appropriate.

[0119] In the test management system 100 of this modification B, the answer sheet does not include question sentences, so the configuration of the writing screen G2 is different from the example in Figure 4, and therefore the configuration of the answer sheet and the processing contents of each device are different from the above example. The following will mainly explain these differences.

[0120] FIG. 19 is an example of a written screen G2 in this modified example B. In the written screen G2 of FIG. 19, the question section Ta is not subject to printing, and the question section Ta has a question section Ro in which the question text and the like are displayed, and the question section Ro includes a question number. The written screen G2 of FIG. 19 has a process explanation section Ex that shows the flow of the process that the examinee should perform when answering the written question. The process explanation section Ex corresponds to mask instruction information. The form and notation method of the process explanation section Ex are not limited to the example of FIG. 19 and can be changed as desired. However, the written screen G2 does not necessarily have to have a process explanation section Ex. In the written screen G2 of FIG. 19, the first question in the exam, "TS-001," is a written question.

[0121] The print button P1 on the writing screen G2 is a virtual button for causing the printer 50 to print an answer sheet on which the examinee will write their answers. The answer sheet of this modification B is characterized in that it does not include questions or the like, as in the example of FIG. 20. While FIG. 20 illustrates an answer sheet O having an identification section Sk, an identifier W, and a guide section Va, the answer sheet O may not have the identification section Sk, the identifier W, or the guide section Va. When the print button P1 is pressed, the information processing section 32 of the examination terminal 30 may cause the display section 34 to display a print screen including a print preview of the answer sheet O.

[0122] FIG. 21 shows an example of the state (masked paper Q) in which the answer sheet O of FIG. 20 has been masked after the answers have been written. FIG. 21 illustrates a masked paper Q in which almost the entire answer column K is covered with a masking material, and the answer portion Ks is hidden. However, the masking process may be performed using a magic marker or the like, or the overprinting method of variant A may be adopted. In any case, when the test management system 100 performs a matching process for at least one of the identification section Sk and the identifier W, it is preferable that the target of matching is not hidden when masking the answered paper P. Other configurations and operations are the same as those of the main part and variant A described above.

[0123] As described above, in the test management system 100 of Modification B, the question text of the written questions is only displayed on the screen and is not printed out. That is, the control unit 12 of the test management device 10 transmits written data containing information about the answer sheet for the written questions to the test terminal 30, causing the display unit 34 to display the written screen G2 and print an answer sheet that does not include the question text via the written screen G2. This effectively prevents the question text from leaking. Furthermore, in the test management system 100 of Modification B, a first image used for grading is secured, and a second image in which at least the answer portion Ks is masked is registered. This prevents the answer portion Ks from leaking without interfering with grading, ensuring the fairness of the online test and increasing its reliability. Other effects are the same as those of the main version and Modification A described above.

[0124] <Variation C> 1, etc., along with Fig. 22 and Fig. 23, an example of the overall configuration, an example of the functional configuration, and an example of the operation of the test management system 100 according to Modification C of this embodiment will be described. The same reference numerals are used for the configurations common to the figures, and the description thereof will be omitted or simplified as appropriate.

[0125] The test management system 100 of this modification C is based on the premise that the examinee or the like prepares the answer sheet in advance, and does not include a printing process for the answer sheet. Therefore, the configuration of the writing screen G2 differs from the examples of Figures 4 and 19, and accordingly, the configuration of the answer sheet and the processing contents of each device differ from the above examples. The following will focus on these differences. The answer sheet may be a blank sheet prepared in advance by the examinee, or it may be a sheet distributed in advance by the administration.

[0126] The process explanation section Ex in the written screen G2 of FIG. 22 assumes that blank paper will be used as the answer sheet. Therefore, the process explanation section Ex requires the question number and examinee ID to be written on the answer sheet. FIG. 23 shows an example of an answer sheet O with the identification section Sk filled in by hand. Even with handwritten answers, image processing technology can be used to perform a matching process on the identification section Sk. When the answer sheet is distributed in advance by the administration, it may have one or more identification sections Sk, and may also have an identifier W. Other configurations and operations are the same as those of the main part, variant A, and variant B described above. For example, the test management system 100 of variant C may employ the overprinting method of variant A as a masking process for answered sheets.

[0127] As described above, in the test management device 10 of Modification C, the control unit 12 also transmits written data to the test terminal 30, causing the display unit 34 to display a written screen G2 containing the question text for the written question. However, the control unit 12 does not have the function of printing answer sheets for the written questions, and the answer sheets of Modification C do not contain the question text for the written question. In other words, the test management system 100 of Modification C does not require test takers to print answer sheets, and the printer 50 is not required in the first place, thereby easing the constraints of the test environment. Furthermore, the time required to print answer sheets is saved, and the impact of printer 50 malfunctions, etc., is eliminated, thereby facilitating the operation of online tests. Furthermore, in the test management system 100 of Modification C, a first image used for grading is secured, and a second image in which at least the answer portion Ks is masked is registered. Therefore, it is possible to prevent the leakage of the answer part Ks without interfering with the grading, thereby ensuring the fairness of the online exam and increasing its reliability. Other effects are the same as those of the main version, Variation A, and Variation B described above.

[0128] The above-described embodiments are merely examples of the test management device, test management system, test management program, and test management method, and the technical scope of the present invention is not limited to these embodiments. For example, the above description illustrates an example in which an image of an answer sheet captured by the camera 46a of the portable device 40 is registered as the first image, but this is not limiting. For example, the first image may be an image of the answer sheet captured by a scanner (an image captured by a scanner). In this case, the test management device 10 acquires the captured image of the answer sheet from the scanner via, for example, the test terminal 30, and registers it in the memory unit 13 as the first image. Because the first image is used for grading, capturing it by a scanner has the advantage of facilitating grading. However, it is considered that the work of the examinee, etc., is relatively cumbersome.

[0129] The various sentences displayed on each screen may be replaced by voice output from the notification unit 48, etc. For example, the shooting instruction information and mask instruction information may be output from the internal memory of the test terminal 30. storehouseThe information may be output as audio from a speaker, an external speaker, or the notification unit 48 of the portable device 40. While displaying or notifying various pieces of information is unnecessary if the test taker is informed of the flow of the written questions in a manual or other format, displaying or notifying information facilitates the online test. The various screens (pages) illustrated in each figure are merely examples. The layout, shape, font, and presentation of each element displayed on each screen can be modified as appropriate, and elements can be freely selected and discarded. For example, the name section C, schedule display section D, and personal display section E on the standby screen G1 are not required, and the test management system 100 may be configured so that the standby screen G1 is not displayed at all (see Figures 2 and 3). The personal information section U, name section C, status section S, and print button P1 on the written screen G2 are not required (see Figures 4, 19, and 22). In the masking screen G4, the personal information section U, name section C, status section S, and print button Bp are not essential (see FIG. 16). The appearance of the various virtual buttons and the character structure are not limited to the examples in the figures and can be changed as desired. While the figures are shown in grayscale for formatting purposes, in actual screens, appropriate colors are used for the characters, figures, etc. Note that each screen (especially the image capture screen G3) may differ slightly depending on the type of browser, the model of the portable device 40, etc. [Explanation of symbols]

[0130] 10 test management device, 11, 31, 41 communication unit, 12 control unit, 12a information processing means, 12b output processing means, 12c photography management means, 12m command processing means, 12n registration processing means, 13, 33, 43 memory unit, 13p test management program, 20 operation terminal, 30 test terminal, 32 information processing unit, 34, 44 display unit, 35, 45 input unit, 36, 46a, 46b camera, 40 portable device, 42 portable control unit, 47 sound collection unit, 48 notification unit, 50 printer, 100 test management system, Bp, P1 print button, Bs shutter button, C name unit, D schedule display unit, E personal display unit, Ex processing explanation unit, F start button, G1 standby screen, G2 writing screen, G3 image capture screen, G4 mask screen, H Title section, J Starting information section, K Answer column, Ko Answer section, Ks Answer section, M Mask, Mn Mask section, Mo Monitor section, N Network, O Answer sheet, P Answered sheet, P2 Answer end button, P3 Mask end button, Q Masked sheet, R, Ro Question section, S Status section, Sk Identification section, Ta Question section, Tw Print area, U Personal information section, V, Va, Vb Guide section, W Identifier.

Claims

1. A control unit is provided for acquiring a photographed image of an answered sheet, which is an answer sheet after the completion of answers to written questions, and registering the photographed image in a storage unit as a first image, and for acquiring a photographed image of a masked sheet, which is an answer sheet after the completion of a masking process for masking at least the answer portion, and registering the photographed image in the storage unit as a second image, The control unit A test management device that manages the registration process of the first image and the registration process of the second image so that they are performed within a predetermined test time or within a time range that includes the test time plus a set time.

2. A control unit is provided for acquiring a photographed image of an answered sheet, which is an answer sheet after the completion of answers to written questions, and registering the photographed image in a storage unit as a first image, and for acquiring a photographed image of a masked sheet, which is an answer sheet after the completion of a masking process for masking at least the answer portion, and registering the photographed image in the storage unit as a second image, The storage unit includes: a reference time that is a reference for the time from the registration of the first image to the registration of the second image is stored; The control unit A test management device that rejects an answer to a written question if the registration of the second image is not completed within the reference time period from the registration of the first image.

3. The control unit 3. The test management device according to claim 1, wherein a written screen including a question for a written question and limiting printing of the answer sheet to one time is displayed on a display unit of the test terminal.

4. The control unit when it is detected that the examinee has finished answering the answer sheet, the portable device having a camera is set to an image capturing mode to capture the first image; 3. The test management device according to claim 1, wherein when the end of the masking process is detected, the portable device is set to an image capture mode to capture the second image.

5. The control unit when it is detected that the examinee has finished answering the answer sheet, the portable device having a camera is set to an image capturing mode to capture the first image; When the first image is acquired from the portable device, the portable device is set to a video shooting mode to capture an image of the examinee and his / her surroundings; 3. The test management device according to claim 1, wherein when the end of the masking process is detected, the portable device is set to an image capture mode to capture the second image.

6. The control unit A mask screen for printing a mask portion arranged so as to overlap at least the answer column portion of the answer sheet is displayed on the display unit of the test terminal; The masked paper is 3. The test management device according to claim 1, wherein the masking process is performed via the mask screen.

7. The control unit A test management device as described in claim 1 or 2, which determines whether the answer portion of a photographed image of the answer sheet that has been subjected to the masking process can be read, and if it determines that the answer portion cannot be read, registers the photographed image as the second image.

8. The control unit 3. The test management device of claim 1 or 2, wherein by sending written data including information on the answer sheet for the written question and information on an identifier for uniquely distinguishing the answer sheet to an examination terminal, a written screen including the question text of the written question is displayed on the display unit of the examination terminal, and the answer sheet including the identifier is printed via the written screen.

9. The control unit By transmitting written data including information on the answer sheet of the written question to the examination terminal, a written screen including the question sentence of the written question is displayed on the display unit of the examination terminal, 3. The test management device according to claim 1, wherein the answer sheet does not include a question statement for a written question.

10. a test terminal having a display unit for displaying a written screen including a question sentence for a written question; a portable device equipped with a camera for photographing an answer sheet, which is an answer sheet for written questions after the answer has been completed; a control unit that acquires a photographed image of the answer sheet from the portable device and registers the photographed image in a storage unit as a first image; The portable device is The camera photographs the masked paper, which is the answer sheet after the masking process of masking at least the answer portion is completed, The control unit A test management system that acquires a photographed image of the masked paper from the portable device and registers it in the memory unit as a second image, and manages the registration process of the first image and the registration process of the second image so that they are performed within a predetermined test time or within a time range that adds a set time to the test time.

11. a test terminal having a display unit for displaying a written screen including a question sentence for a written question; a portable device equipped with a camera for photographing an answer sheet, which is an answer sheet for written questions after the answer has been completed; a control unit that acquires a photographed image of the answer sheet from the portable device and registers the photographed image in a storage unit as a first image; The portable device is The camera photographs the masked paper, which is the answer sheet after the masking process of masking at least the answer portion is completed, The control unit An exam management system that obtains a photographed image of the masked paper from the portable device and registers it in the memory unit as a second image, and if the registration of the second image is not completed within a reference time from the registration of the first image, rejects the answer to the written question.

12. acquiring a photographed image of the answered answer sheet, which is the answer sheet after the completion of answering the written questions, and registering the photographed image in the storage unit as a first image; acquiring a photographed image of the masked paper, which is the answer sheet after the masking process of masking at least the answer portion is completed, and registering the photographed image in the storage unit as a second image; and a test management program that causes one or more processors to manage the first image registration process and the second image registration process so that they are performed within a predetermined test time or within a time range that is the test time plus a set time.

13. acquiring a photographed image of the answered answer sheet, which is the answer sheet after the completion of answering the written questions, and registering the photographed image in the storage unit as a first image; acquiring a photographed image of the masked paper, which is the answer sheet after the masking process of masking at least the answer portion is completed, and registering the photographed image in the storage unit as a second image; and a test management program that causes one or more processors to reject the answer to the written question if the registration of the second image is not completed within a reference time period from the registration of the first image.

14. An exam management method in which one or more processors execute a first registration step of acquiring a photographed image of an answered sheet, which is an answer sheet after answers to written questions have been completed, and registering it in a memory unit as a first image, and a second registration step of acquiring a photographed image of a masked sheet, which is an answer sheet after a masking process that masks at least the answer portion, is completed, and registering it in the memory unit as a second image, and a management step of managing the steps so that they are performed within a predetermined exam time or within a time range that is the exam time plus a set time.

15. a first registration step of acquiring a photographed image of the answered answer sheet, which is the answer sheet after the completion of answering the written questions, and registering the photographed image in a storage unit as a first image; a second registration step of acquiring a photographed image of the masked paper, which is the answer sheet after the masking process of masking at least the answer portion, and registering the photographed image in the storage unit as a second image; and a management step of rejecting the answer to the written question if the registration of the second image is not completed within a reference time period from the registration of the first image, in an exam management method executed by one or more processors.

Images