Test system, test method, and computer-readable storage medium

Abstract

Provided is a test system, a test method, and a computer-readable storage medium. The test system is capable of implementing an online test while preventing fraudulent behavior. In a test management server (20) connected to a test taker terminal (50) via a network (1), a test question data transmission unit (24), an answer data reception unit (25), a doffing state data reception unit (26) that receives doffing state data detected by a doffing detection device (66) of a non-transmissive head-mounted display (60) worn by a test taker and transmitted from the test taker terminal (50) via the network (1), and a fraudulent behavior determination unit (32) that determines whether the doffing state is appropriate with respect to the test question category of a given test question using the doffing state data of the question presentation period and the doffing state data of the answer period that are received, thereby constituting a test system (10).

Description

Technical Field

[0001] This invention relates to a computer-based examination system and program for administering examinations to remote examinees via a network. For example, it can be used to conduct various examinations, such as assessment examinations, certification examinations, qualification examinations, entrance examinations, job entrance examinations, graduation examinations, completion examinations, final examinations, promotion examinations, mock examinations, and daily learning effectiveness confirmation examinations, for assessing abilities and knowledge such as language ability, conversational ability, communication ability, skills, etc. Background Technology

[0002] In recent years, online learning guidance, where instructors and students communicate via the internet for language learning and other subjects, has become increasingly popular. In addition, online lectures aimed at acquiring various skills and knowledge necessary for employment or managing social life are also gaining popularity, not limited to language learning guidance for students.

[0003] On the other hand, examinations are necessary to measure the completion of language learning, the consolidation of knowledge, and the mastery of skills. The results of these examinations directly impact success in obtaining qualifications, employment, enrollment, graduation, completion of studies, promotion, and other advancements; therefore, examinations should be implemented rigorously and strictly. However, in the past, it has been common for practices such as proxy testing (where a third party takes the exam on behalf of the examinee) and improper conduct (where examinees receive information from third parties to answer questions during the exam).

[0004] Furthermore, in this invention, an examination is conducted using a head-mounted display (hereinafter sometimes abbreviated as HMD). Therefore, from the viewpoint of information processing using a head-mounted display, as a technology related to this invention, the following technology is known: enabling the wearer of a non-transmissive head-mounted display to easily grasp the surrounding situation even when browsing image content on a non-transmissive head-mounted display (see Patent Document 1). This non-transmissive head-mounted display includes: a camera unit that captures external images; an external image acquisition unit that acquires the external images captured by the camera unit; an image content acquisition unit that acquires image content; a display unit that displays at least one of the external images acquired by the external image acquisition unit and the image content acquired by the image content acquisition unit; a proximity detection unit that detects the approach of an object; and a display control unit that, when the approach of an object is detected while the display unit is displaying image content, causes the display unit to display a superimposed image obtained by superimposing the external images captured by the camera unit and the image content, so that the external images and the image content can be visually identified. Video content can be anything that includes both images and sound, such as movies, TV shows, games, etc.

[0005] Furthermore, a system is known in which a non-transmissive head-mounted display switches between a transmissive mode and a non-transmissive mode (see Patent Document 2). In this system, at least a portion of an image of the real world is displayed on a portion of the screen presenting an interactive scene of a game. The switch from non-transmissive mode to transmissive mode occurs in response to a change in the gaze direction of the user wearing the head-mounted display.

[0006] Existing technical documents

[0007] Patent documents

[0008] Patent Document 1: Japanese Patent Application Publication No. 2015-191124 (Abstract)

[0009] Patent Document 2: Japanese Patent Publication No. 2016-532178 (Abstract) Summary of the Invention

[0010] The problem the invention aims to solve

[0011] As mentioned earlier, online learning guidance and online lectures using the Internet are prevalent. However, as an extension, it would be more convenient if examinations could also be conducted online via the Internet, creating a need for such examinations. In this case, the examinations are used to assess an individual's abilities and knowledge, and the results directly relate to the success of obtaining qualifications, employment, enrollment, graduation, completion of studies, promotion, and other advancements. Therefore, it is necessary to eliminate unfair practices and conduct examinations strictly and rigorously.

[0012] However, in traditional exams where a large number of test takers gather in exam venues or classrooms, exam monitors and instructors patrol the exam venues and classrooms to prevent misconduct. But in online exams, this kind of patrolling is not possible.

[0013] Therefore, it is desirable to develop a system that allows remote test takers to conduct online examinations while preventing misconduct.

[0014] The purpose of this invention is to provide an examination system and program that can conduct online examinations while preventing improper conduct.

[0015] Solution for solving the problem

[0016] This invention is an examination system that administers examinations to remote examinees via a network. The examination system is composed of computers.

[0017] The examination system has an examination management server that connects to the candidate's terminal via a network.

[0018] The exam management server has the following features:

[0019] The test data sending unit performs the following processing: sending test data for the examination to the examinee's terminal via the network, and displaying the test data for the examination on the display section of the non-transmissive head-mounted display worn by the examinee;

[0020] The answer data receiving unit performs the following processing: receiving the answer data of the examinee sent from the examinee's terminal via the network;

[0021] The don / wear status data receiving unit performs the following processing: receiving don / wear status data of the non-transmissive head-mounted display detected by the don / wear detection device installed on the non-transmissive head-mounted display and transmitted from the testee's terminal via a network; and

[0022] The improper behavior determination unit performs the following processing: using the undress status data during the question-setting period and the undress status data during the answering period received by the undress status data receiving unit, it determines whether the undress status is appropriate relative to the question category of the given test questions.

[0023] Here, the "processing of sending test question data for the examination to the examinee's terminal via the network and displaying the test question data for the examination on the display section of the non-transparent head-mounted display worn by the examinee" of the "test question data sending unit" includes the following cases: sending the test question data for the examination to the main body of the examinee's terminal (a device independent of the non-transparent HMD) via the network, and sending it from the main body to the non-transparent HMD; and sending the test question data for the examination directly to the non-transparent HMD via the network.

[0024] Furthermore, the purpose of the "Unfair Conduct Judgment Unit" regarding "question category relative to the given questions" is that it is not necessary to judge the appropriateness of the wearing / removal status for all questions; it is sufficient to judge the appropriateness of the wearing / removal status for questions that require wearing a non-transmissive head-mounted display. Therefore, for questions where wearing a non-transmissive head-mounted display is not required, it is not necessary to judge the appropriateness of the wearing / removal status. However, if all questions in a certain exam require wearing a non-transmissive head-mounted display, then the appropriateness of the wearing / removal status should be judged for all questions in that exam.

[0025] In this examination system of the present invention, since the test questions are displayed using a non-transmissive head-mounted display, no one other than the test taker can see the questions. Furthermore, because the test taker wears a non-transmissive head-mounted display, it creates an environment where improper behavior, such as secretly looking in a dictionary, is difficult to engage in.

[0026] Furthermore, since the appropriateness of the wearing / unwearing status relative to the question category is determined using wearing / unwearing status data detected by a wearing / unwearing detection device installed on a non-transparent head-mounted display (HMD), it is possible to detect, for example, situations where questions requiring the wearing of a non-transparent HMD are answered without wearing one, or situations where a non-transparent HMD is not worn when it should be used to view the questions. Therefore, examinations can be conducted while preventing improper behavior, thereby achieving the aforementioned objective.

[0027] <Structure for performing attention-grabbing display processing on the monitor terminal>

[0028] Furthermore, in the aforementioned examination system, the expectation is that...

[0029] It is equipped with a monitor terminal, which is connected to the examination management server to display information for monitors to supervise the examination.

[0030] The exam management server also has a monitoring unit that performs the following processing: receiving facial image data of the examinee captured by a camera device installed on the examinee's terminal and transmitted via the network; and displaying the received facial image data as a moving image on the monitor's terminal.

[0031] The misconduct detection unit is configured to perform the following processing: if it determines that the wear status data during the question-setting period indicates wearing of a non-transmissive head-mounted display in the processing of test questions requiring wear of a non-transmissive head-mounted display, and the wear status data during the answer-setting period indicates non-wearing, it conveys information to the monitoring unit that misconduct may exist.

[0032] The monitoring unit is configured to receive a message from the misconduct determination unit and perform attention-grabbing display processing around or around the candidate's image data displayed on the monitor's terminal.

[0033] In a configuration where attention-grabbing display processing is performed on the monitor's terminal, a monitor who is monitoring multiple candidates can become aware of candidates who may be engaging in inappropriate behavior, thus reducing the monitor's workload and improving monitoring efficiency.

[0034]

[0035] Furthermore, in the aforementioned examination system, the expectation is that...

[0036] The exam management server also has:

[0037] The facial image acquisition unit performs the following processing: at the start and / or end of the exam, and during the exam when the data of the unworn state becomes data indicating non-wearing, it acquires facial image data from the human image data containing the examinee's face captured by the human camera device set on the examinee's terminal and transmitted via the network.

[0038] The facial feature extraction unit performs the following processing: extracting facial features from multiple facial image data acquired by the facial image acquisition unit; and

[0039] The certification production unit performs the following processing: producing electronic or paper certification certificates for the examinees.

[0040] The improper conduct determination unit also performs the following processing: determining whether multiple facial feature quantities extracted by the facial feature quantity extraction unit are all identical or all approximately identical; if they are not all identical or all approximately identical, it is determined that improper conduct has occurred.

[0041] The certification production unit performs the following processing: when the misconduct determination unit determines that multiple facial feature quantities are all identical or all substantially identical, the facial image data that most clearly represents the examinee's face among the multiple facial image data is adopted as the facial photograph published on the certification certificate.

[0042] Here, in the "facial image acquisition unit," the phrase "at the start of the exam" refers to the period before the processing of sending and receiving test question data and answer data begins, including the time before the exam starts, and encompassing a certain time span. However, while it includes the time before the exam starts, it does not mean including a point in time such as the previous day or a few hours ago, but rather the preparation phase before entering a routine such as viewing and answering the test questions. Similarly, "at the end of the exam" refers to the period after the processing of sending and receiving test question data and answer data ends, including the time span after the exam ends. However, while it includes the time after the exam ends, it does not mean including a point in time such as the next day or a few hours later, but rather the period immediately following. The same applies to the invention described below.

[0043] In a configuration where facial features are extracted from multiple facial image data and it is determined whether all or approximately all facial features are identical, it is possible to determine whether a substitution occurred during the examination, thereby detecting improper behavior, and to obtain an appropriate facial photograph for publication on the certification certificate.

[0044] <Structure that issues a removal indicator for a non-transmissive head-mounted display>

[0045] Furthermore, given the aforementioned structure of extracting facial features from multiple facial image data separately and determining whether all facial features are identical or substantially identical, the desired outcome is that...

[0046] The exam management server also has a facial image acquisition determination unit. This unit performs the following processing: if a predetermined number of questions or a predetermined time period require the wearing of a non-transmissive head-mounted display, and the data on the wearing / removal status during the determined continuous period indicates wearing, an instruction to remove the non-transmissive head-mounted display is sent to the examinee's terminal via the network at an arbitrary time interval to acquire facial image data for that period of the exam.

[0047] The facial image acquisition unit is configured to perform the following processing: when a removal instruction for removing the non-transmissive head-mounted display is sent to the testee's terminal by a facial image acquisition determination unit, and the removal instruction is followed by a determination that the removal status data indicates that the display is not being worn, facial image data is acquired from the person image data sent from the testee's terminal via the network.

[0048] In configurations like this, where a removal instruction for a non-transmissive head-mounted display is issued, facial image data can still be acquired even when the test questions requiring the non-transmissive head-mounted display are continuous, making it difficult to obtain facial image data during the test period, thus enabling the detection of inappropriate behavior. Furthermore, the removal instruction for the non-transmissive HMD is sent at arbitrary timings by a facial image acquisition determination unit under certain conditions, making it unpredictable at the test-taker's terminal. Therefore, an environment can be created where, for example, the test-taker cannot detect when the removal instruction has been issued and is relayed from the assistant, making it difficult to engage in inappropriate behavior.

[0049] <A structure that displays the wearer's gaze image captured by the wearer's gaze camera on a non-transmissive head-mounted display and also on the monitor's terminal>

[0050] Furthermore, in the case of the aforementioned structure where attention-grabbing display processing is performed on the monitor's terminal, it is desirable that...

[0051] A wearer's gaze camera is provided in a non-transmissive head-mounted display. This wearer's gaze camera can capture images of the space outside the non-transmissive head-mounted display according to the wearer's gaze.

[0052] The test data transmission unit is configured to further perform the following processing: In processing test questions that require wearing a non-transmissive head-mounted display and require answering with actions, during the timing of the transition from the question-setting period to the answering period, a switching instruction to switch to a display mode for action-based answering is sent via the network to the test taker's terminal. In this action-based answering display mode, at least a portion of the wearer's gaze image data captured by the wearer's gaze camera device is displayed as a moving image on the display unit of the non-transmissive head-mounted display.

[0053] The answer data receiving unit is configured to perform the following processing: receive wearer gaze image data sent from the test taker's terminal via a network, and use it as answer data.

[0054] The monitoring unit is configured to also perform the following processing: simultaneously with or while displaying the person's image data, displaying the wearer's gaze image data sent from the examinee's terminal via the network as a moving image on the monitor's terminal.

[0055] Here, "test questions that require answers with actions" refers to test questions that are answered in written form, test questions that demonstrate the practical application of sign language, test questions that demonstrate the practical application of the use of tools, props, or appliances, test questions that demonstrate the methods of tying ropes on ships, etc.

[0056] In configurations where the wearer's gaze image captured by the wearer's gaze camera is displayed on both a non-transmissive head-mounted display and a monitor's terminal, when given questions requiring action-based answers, even while wearing the non-transmissive head-mounted display, the test-taker can visually observe the movements of their hands or fingers while answering. Furthermore, because the wearer's gaze image is displayed on the non-transmissive head-mounted display, although this creates an environment conducive to improper behavior due to the test-taker's view of the outside of the display, the simultaneous display of the gaze image on the monitor's terminal helps prevent such behavior.

[0057] <A structure for performing character reading, processing, and evaluation on written solutions>

[0058] Furthermore, in the configuration described above, where the wearer's gaze image captured by the wearer's gaze camera is displayed on a non-transmissive head-mounted display and also on the monitor's terminal, it is desirable that...

[0059] The exam management server also has an evaluation unit that, for questions answered in written form, uses the wearer's gaze image data received by the answer data receiving unit as answer data and performs character reading processing.

[0060] In a configuration like this, character reading and evaluation are performed on written answers, enabling the automation of the evaluation of test takers' answers (correctness determination, scoring, etc.).

[0061]

[0062] Furthermore, in the aforementioned configuration where the wearer's gaze image captured by the wearer's gaze camera is displayed on a non-transmissive head-mounted display and also on the monitor's terminal, it is desirable that...

[0063] The exam management server also includes an evaluation unit. For questions requiring answers based on actions performed in real-world space using physical testing tools, this evaluation unit uses wearer gaze image data received by the answer data receiving unit as answer data and performs pattern recognition processing.

[0064] The evaluation unit is configured to perform pattern recognition processing using a pattern recognition model, which is obtained by learning through the wearer's gaze image data that is judged as the correct answer and the wearer's gaze image data that is judged as the incorrect answer, as well as the corresponding labels for the correct and incorrect answers.

[0065] In a configuration where pattern recognition processing is performed and evaluation is conducted on answers to actions performed in real space using physical testing equipment, it is possible to automate the evaluation of the test taker's answers (correctness determination, scoring, etc.).

[0066] <To enable test takers to take written notes, the structure displays the wearer's gaze image data on a non-transmissive head-mounted display and also on the monitor's terminal.>

[0067] Furthermore, in the case of the aforementioned structure where attention-grabbing display processing is performed on the monitor's terminal, it is desirable that...

[0068] A wearer's gaze camera is provided in a non-transmissive head-mounted display. This wearer's gaze camera can capture images of the space outside the non-transmissive head-mounted display according to the wearer's gaze.

[0069] The test data transmission unit is configured to further perform the following processing: In the processing of test questions that require wearing a non-transmissive head-mounted display and allow written note-taking during the question-setting and answering periods, a switching instruction to switch to a note-taking display mode is sent to the test taker's terminal via the network. In this note-taking display mode, the test question data is displayed on the display unit of the non-transmissive head-mounted display, and the wearer's gaze image data captured by the wearer's gaze camera is also displayed, so that the test taker can take written notes.

[0070] The monitoring unit is configured to also perform the following processing: simultaneously with or while displaying the person's image data, displaying the wearer's gaze image data sent from the examinee's terminal via the network as a moving image on the monitor's terminal.

[0071] In configurations where the wearer's gaze image data is displayed on both a non-transmissive head-mounted display and a monitor's terminal to enable test-takers to take written notes, test-takers can perform actions such as taking notes on the main points or keywords of long questions during the question-setting phase, or calculating or thinking in writing during the answer-writing phase, even while wearing the non-transmissive head-mounted display. Furthermore, since the wearer's gaze image data is displayed on the non-transmissive head-mounted display, although this creates an environment conducive to improper behavior due to the test-taker's view of the outside of the non-transmissive head-mounted display, the fact that the wearer's gaze image data is also displayed on the monitor's terminal prevents improper behavior from occurring.

[0072]

[0073] Furthermore, in the aforementioned examination system, the expectation is that...

[0074] A light-emitting component is provided in the non-transmissive head-mounted display.

[0075] The examination management server also includes a light emission management unit, which performs the following processing: In the processing of test questions requiring a wearable non-transmissive head-mounted display, it sends a light emission instruction via the network to the test taker's terminal to activate the light emission unit at arbitrary time intervals. Furthermore, at the activation time, it receives image data of a person captured by a camera device installed on the test taker's terminal and transmitted via the network as image data for light emission confirmation, and determines whether the received image data for light emission confirmation has captured the light emission of the light emission unit.

[0076] The improper conduct determination unit is configured to perform the following processing: if the light emission management unit fails to confirm light emission based on the light emission confirmation image data, it determines that improper conduct has been performed.

[0077] In cases where a light-emitting unit is installed on a non-transmissive head-mounted display (HMD) to detect misconduct, misconduct can be prevented before it occurs because it can detect the following types of misconduct: an assistant (someone other than the examinee) wears the HMD that the examinee should wear and views the questions displayed on the display to answer them; that is, the assistant views questions that only the examinee should be able to see while the examinee wears a non-transmissive HMD of the same or similar shape to pretend to take the exam; or a photograph of the examinee wearing the non-transmissive HMD is placed beforehand. Furthermore, since the light emission occurs at arbitrary timings, it cannot be predicted at the examinee's terminal, making it difficult to return to a normal state just before the light emission, thus creating an environment where misconduct is difficult to commit.

[0078] <A structure that displays the illumination period in sync with the light-emitting part of the non-transmissive head-mounted display at the monitor terminal.>

[0079] Furthermore, in the case of the structure described above, which uses a light-emitting part in a non-transmissive head-mounted display to detect improper behavior, it is desirable that...

[0080] It is equipped with a monitor terminal, which is connected to the examination management server to display information for monitors to supervise the examination.

[0081] The exam management server also has a monitoring unit that performs the following processing: receiving facial image data of the examinee captured by a camera device installed on the examinee's terminal and transmitted via the network; and displaying the received facial image data as a moving image on the monitor's terminal.

[0082] The monitoring unit is configured such that multiple person image display units on the screen of the monitor terminal display multiple person image display units display the person image data of multiple examinees in the form of moving images, and multiple light emission period display units on the screen of the monitor terminal corresponding to these multiple person image display units display the light emission period in a timed manner that is synchronized with the light emission of the light emission unit of the non-transmissive head-mounted display when a light emission instruction is received from the light emission management unit.

[0083] In a configuration where the light-emitting portion of a non-transmissive head-mounted display is synchronized with the light-emitting portion of the monitor's terminal to indicate the light-emitting period, the monitor can easily identify candidates who may be engaging in inappropriate behavior from among many candidates' images, thus reducing the monitor's workload and improving monitoring efficiency.

[0084]

[0085] Alternatively, in the aforementioned examination system, it could also be...

[0086] The exam management server also has:

[0087] The facial image acquisition unit performs the following processing: at the start of the exam, and during the exam period when the data on the removal of the mask changes to represent data indicating non-wearing, or at the end of the exam in addition to the start of the exam and the exam period, it acquires facial image data from human image data containing the examinee's face captured by a human image device installed on the examinee's terminal and transmitted via the network.

[0088] The facial feature extraction unit performs the following processing: extracting facial features from multiple facial image data acquired by the facial image acquisition unit; and

[0089] The certification production unit performs the following processing: producing electronic or paper certification certificates for the examinees;

[0090] The pre-registration acceptance unit performs the following processing: at the start of the exam, it receives voice data for voiceprint extraction, acquired by a microphone located on the examinee's terminal or a microphone on a non-transmissive head-mounted display and transmitted via the network; it uses the received voice data to perform voiceprint analysis; and it stores the obtained voiceprint data, as the basis data for calculating the examinee's identity, in association with the examinee's ID and exam ID, in the examinee information storage unit; and

[0091] The data acquisition unit performs the following processing: during the examination period, or at the end of the examination (excluding the examination period), it receives voice data for voiceprint extraction acquired by a microphone located on the examinee's terminal or a microphone of a non-transmissive head-mounted display and transmitted via the network; it uses the received voice data to perform voiceprint analysis; and it stores the obtained voiceprint data as reference data for personal score calculation, associating it with the examinee's ID and examination ID, in the examinee information storage unit.

[0092] The facial feature extraction unit is configured to perform the following processing:

[0093] At the start of the exam, facial feature data extracted from the facial image data obtained by the facial image acquisition unit will be used as the baseline data for calculating the individual's identity and stored in the examinee information storage unit in association with the examinee ID and the exam ID.

[0094] During the examination period, or at the end of the examination (excluding the examination period), facial feature values ​​extracted from the facial image data acquired by the facial image acquisition unit are used as reference data for calculating the individuality score. These data are then stored in the examinee information storage unit in association with the examinee ID and the examination ID. A facial feature value score is calculated, which represents the similarity between the facial feature values ​​used as the reference data for calculating the individuality score and the facial feature values ​​stored in the examinee information storage unit as the baseline data for calculating the individuality score.

[0095] The facial image acquisition unit is configured to perform the following processing:

[0096] At the start of the exam, facial image data obtained from the person image data will be used as the facial photograph to be uploaded to the certification certificate produced by the certification certificate production unit and stored in the examinee information storage unit in association with the examinee ID and exam ID.

[0097] During the examination period, or at the end of the examination (excluding the examination period), facial image data obtained from the person image data will be stored in the examinee information storage unit in association with the examinee ID and examination ID, only if the facial feature score calculated by the facial feature extraction unit is less than or below a predetermined threshold.

[0098] The unit for determining improper conduct shall perform the following processing:

[0099] The system calculates multiple facial feature scores, representing the similarity between each facial feature value stored in the examinee information storage unit (used for calculating individuality) and the facial feature values ​​of the baseline data (used for calculating individuality). Alternatively, it acquires multiple facial feature scores calculated by the facial feature extraction unit and stored in the examinee information storage unit along with the facial feature values ​​and associated with the examinee ID and exam ID. The system then calculates an average facial feature score obtained by averaging the calculated or acquired facial feature scores.

[0100] Further, multiple voiceprint scores are calculated to represent the similarity between each voiceprint data stored in the test taker's information storage unit (used as control data for calculating personality) and the voiceprint data used as baseline data for calculating personality. Then, an average voiceprint score is calculated by averaging these multiple voiceprint scores.

[0101] The average scores of facial features and voiceprints are used to calculate the individuality score, which is obtained by integrating these average scores.

[0102] The certificate production unit consists of:

[0103] If the degree of self-worth calculated by the misconduct determination unit is below or less than a predetermined threshold, no certification will be issued.

[0104] In configurations like this, where facial feature scores and voiceprint scores are used to calculate identity, it is possible to more reliably determine whether a candidate has been impersonated during an exam. Furthermore, the candidate information storage unit stores facial image data only when the facial feature score is below a predetermined threshold (in cases of low facial feature similarity), and stores facial feature data but not facial image data only when the facial feature score is above or exceeds the predetermined threshold (in cases of high facial feature similarity). This reduces the amount of data that needs to be stored.

[0105] <Structure that emits indicators for removing and emitting sound from a non-transmissive head-mounted display>

[0106] Furthermore, in the aforementioned structure that uses facial feature scores and voiceprint scores to calculate individual identity, the desired outcome is...

[0107] The exam management server also has:

[0108] The facial image acquisition determination unit performs the following processing: If a predetermined number of questions or a predetermined time period require the wearing of a non-transmissive head-mounted display, and the data on the wearing / removal status during this continuous period indicates wearing, it sends a removal instruction for the non-transmissive head-mounted display to the examinee's terminal via the network at an arbitrary time interval, thereby acquiring facial image data for that period of the examination; and

[0109] Whether or not voiceprint recognition is needed, the following processing is performed: If, during the intervals between questions (excluding those requiring verbal answers), a predetermined number of questions or a predetermined time period are consecutively asked, a voice instruction is sent to the examinee's terminal via the network at an arbitrary time interval to obtain voiceprint extraction data for the specified time period during the exam.

[0110] The facial image acquisition unit is configured to perform the following processing: when a removal instruction for removing the non-transmissive head-mounted display is sent to the test subject's terminal by a facial image acquisition determination unit, and the removal instruction is followed by a determination that the removal status data indicates that the device is not being worn, facial image data is acquired from the person image data sent from the test subject's terminal via the network.

[0111] The comparison data acquisition unit is configured to perform the following processing: when the voiceprint acquisition determination unit sends a voice instruction to the testee's terminal, it uses the voiceprint extraction sound data sent from the testee's terminal via the network to perform voiceprint analysis, thereby obtaining voiceprint data.

[0112] In cases where a non-transmissive head-mounted display is configured to issue removal and voice instructions, facial feature data and voiceprint data can be obtained as reference data for personal degree calculations, even when there are continuous questions in the exam other than those requiring the non-transmissive head-mounted display to be worn or those requiring voice answers.

[0113] <The Invention of Programs>

[0114] The program of this invention enables a computer to function as an examination management server constituting the examination system described above.

[0115] Furthermore, the aforementioned program, or a portion thereof, can be recorded on recording media such as optical discs (MO), compact optical discs (CD), digital multifunction optical discs (DVD), floppy disks (FD), magnetic tape, read-only memory (ROM), electrically erasable and rewritable read-only memory (EEPROM), flash memory, random access memory (RAM), hard disk drives (HDD), solid-state drives (SSD), and flash drives for storage and distribution. It can also be transmitted using transmission media such as wired networks (LAN), metropolitan area networks (MAN), wide area networks (WAN), the Internet, intranets, extranets, or wireless communication networks, and combinations thereof. Additionally, it can be transmitted using carrier waves. Moreover, the aforementioned program can be part of another program, or it can be recorded on the recording medium along with another program.

[0116] The effects of the invention

[0117] As described above, according to the present invention, the following effects are achieved: the test questions are displayed using a non-transmissive head-mounted display, so that no one other than the test taker can see the test questions; in addition, the test taker is placed in an environment where it is difficult to engage in improper behavior because he / she is wearing the non-transmissive head-mounted display; and the appropriateness of the wearing / unwearing status is determined by using the wearing / unwearing status data of the wearing / unwearing detection device provided on the non-transmissive head-mounted display, so that the examination can be conducted while preventing improper behavior. Attached Figure Description

[0118] Figure 1 This is an overall structural diagram of an examination system according to one embodiment of the present invention.

[0119] Figure 2 This is a perspective view of the non-transmissive head-mounted display of the described embodiment.

[0120] Figure 3 This is a structural diagram of the non-transmissive head-mounted display of the embodiment described.

[0121] Figure 4 This is a flowchart illustrating the overall process involved in the examination of the described implementation method.

[0122] Figure 5 This is a timing diagram of the processes involved in the examination of the described embodiment.

[0123] Figure 6 This is a diagram showing an example of a monitor terminal screen in the described embodiment.

[0124] Figure 7 This is a diagram illustrating an example of a certification certificate for the described implementation.

[0125] Figure 8 This is a structural diagram illustrating a variation of the present invention.

[0126] Figure 9 This is a structural diagram illustrating another variation of the present invention.

[0127] Explanation of reference numerals in the attached figures

[0128] 1: Network; 10, 500: Examination System; 20, 510, 520: Examination Management Server; 22: Facial Image Acquisition Unit; 23: Facial Feature Extraction Unit; 24: Test Question Data Sending Unit; 25: Answer Data Receiving Unit; 26: Wearing / Removing Status Data Receiving Unit; 27: Evaluation Unit; 28: Facial Image Acquisition Requirement Judgment Unit; 30: Certificate Production Unit; 31: Light Emitting Management Unit; 32: Inappropriate Behavior Judgment Unit; 33: Monitoring Unit; 50: Examinee Terminal; 60: Non-transmissive Head-Mounted Display; 63: Display Unit; 66: Wearing / Removing Detection Device; 67: Light Emitting Unit; 68: Wearer's Gaze Camera Device; 80: Monitor Terminal. Detailed Implementation

[0129] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. Figure 1 The overall structure of the examination system 10 of this embodiment is shown in the figure. Figure 2 , Figure 3 A perspective view and structural diagram of a non-transmissive head-mounted display 60 are shown. Additionally, in... Figure 4 The flowchart illustrates the overall process involved in the exam. Figure 5 The timing diagram is shown. And, in Figure 6 The image shown is an example of the screen of the monitor terminal 80. Figure 7 An example of a 300 certification is shown in the image.

[0130] <Overall Structure of Examination System 10>

[0131] exist Figure 1 In the examination system 10, there is an examination management server 20, which is connected via network 1 to multiple (usually a large number) examinee terminals 50, one or more monitor terminals 80, one or more evaluator terminals 90, one or more administrator terminals 100, and multiple (usually a large number) self-confirmation requester terminals 110.

[0132] Here, Network 1 is an external network primarily composed of the Internet, or it can be a combination of the Internet and internal networks such as LANs and intranets (e.g., limited networks built within a company or group enterprise). Whether wired, wireless, or a hybrid of both, it is acceptable as long as information can be transmitted at a certain speed between multiple locations (regardless of distance). Furthermore, the examination management server 20 and the monitor terminal 80 do not necessarily need to be connected through Network 1; a communication line is sufficient. Therefore, the monitor terminal 80 can be located at a remote location relative to the examination management server 20, or it can be directly connected to the examination management server 20.

[0133] The examination management server 20 consists of one or more computers and includes a processing unit 20A that performs various processes involved in the examination, a question storage unit 40 that stores various data used in the various processes performed by the processing unit 20A, an answer storage unit 41, a score storage unit 42, an examinee information storage unit 43, an examination information storage unit 44, and a light-emitting confirmation result storage unit 45.

[0134] In addition, the processing unit 20A is configured to include a pre-registration acceptance unit 21, a facial image acquisition unit 22, a facial feature extraction unit 23, a test data sending unit 24, an answer data receiving unit 25, a donning / wearing status data receiving unit 26, an evaluation unit 27, a facial image acquisition determination unit 28, a score calculation unit 29, a certificate production unit 30, a light emission management unit 31, an improper behavior determination unit 32, a monitoring unit 33, and a personal confirmation unit 34.

[0135] The processing unit 20A includes units 21 to 34, which are implemented by a central processing unit (CPU) located inside the computer body constituting the examination management server 20, as well as one or more programs that define the operation of the CPU, and working memory such as main memory and flash memory. Details of these units 21 to 34 will be described later.

[0136] Furthermore, each storage unit 40-45 is preferably implemented using, for example, a hard disk drive (HDD) or a solid-state drive (SSD). However, other recording media such as USB storage devices, DVDs, CDs, MOs, and magnetic tapes can be used as long as storage capacity and access speed are not problematic. Details of each storage unit 40-45 will be described later.

[0137] Furthermore, when the examination management server 20 is composed of multiple computers, various functions can be distributed. For example, the processing unit 20A can be composed of a web server and a web application server, and each storage unit 40-45 can be composed of a database server. Alternatively, the functions of the processing unit 20A can be distributed using multiple computers, and each storage unit 40-45 can be composed of multiple database servers. Moreover, the data in each storage unit 40-45 can be stored not in a database, but in a file system.

[0138] The test taker terminal 50 is a terminal operated by the test taker, such as... Figure 1As shown, the device is configured to include a main body 50A consisting of a computer, a display unit 51 such as a liquid crystal display connected to the main body 50A as a peripheral device, an input unit 52 such as a keyboard, mouse, and touch panel, a human imaging device 53 consisting of a CCD camera, a CMOS camera, etc., an auxiliary imaging device 54, a microphone 55, a speaker 56, a fingerprint reader 57, and a non-transmissive head-mounted display (HMD) 60.

[0139] Here, a web browser is mounted on the main body 50A. Additionally, an examination-specific program can also be mounted. The main body 50A can also be a portable device such as a tablet or smartphone. Furthermore, the person-facing camera 53, like a webcam used in typical Web RTC (Web Real-Time Communication), is primarily designed to capture images of a person (in this case, the examinee) including their face. It can also capture images other than those including the face; for example, if the examinee leaves the room, images other than the person, such as a background image, will be captured. On the other hand, the auxiliary camera 54 is primarily designed to capture objects other than the person (examinee) including their face (e.g., hands operating the keyboard, surrounding conditions, etc.), and may be omitted. This auxiliary camera 54, as a device (camera), can have the same performance and structure as the person-facing camera 53. The microphone 70 and speaker 71 (see reference) of the non-transmissive head-mounted display 60 are also included. Figure 3 In some cases, microphone 55 and speaker 56 may not be used. Figure 2 and Figure 3 The details of the non-transmissive head-mounted display 60 will be described later.

[0140] The monitor terminal 80 is a terminal operated by a monitor to monitor the actions of each examinee in the examination, such as... Figure 1 As shown, the device comprises a main body 80A consisting of a computer, a display unit 81 such as an LCD monitor connected to the main body 80A as a peripheral device, and an input unit 82 such as a keyboard, mouse, and touch panel. Here, the main body 80A is equipped with a web browser. Furthermore, it may also be equipped with monitoring-specific software. The main body 80A may also be a portable device such as a tablet.

[0141] The evaluator terminal 90 is a terminal operated by the evaluator to evaluate (determine correctness, score) the examinee's answers. It is composed of a computer; although the illustration is omitted, it includes a display unit such as an LCD screen, and input units such as a keyboard, mouse, and touch panel. The evaluator terminal 90 can also be a portable device such as a tablet. The examinee's answers are sometimes automatically evaluated by the evaluation unit 27, and sometimes evaluated by the evaluator on the evaluator terminal 90. In the case of automatic evaluation (the former), the evaluation is usually performed in real-time or near real-time, but it can also be performed retrospectively. In the case of evaluation by the evaluator (the latter), the evaluation is performed retrospectively.

[0142] Specifically, in the latter case, in the evaluator terminal 90, when the evaluator requests the answer data to be used as the object of the evaluation task from the evaluation unit 27 of the examination management server 20, the answer data stored in the answer storage unit 41 is sent via network 1. Therefore, the obtained answer data is evaluated, and the evaluation result data is sent to the evaluation unit 27 of the examination management server 20 via network 1. In the examination management server 20, the evaluation result data is received by the evaluation unit 27, and the evaluation result data is stored in the answer storage unit 41 in association with the examination ID, examinee ID, and question ID.

[0143] The administrator terminal 100 is a terminal operated by the administrator of the examination system 10. It is composed of a computer; although not illustrated, it includes a display unit such as an LCD screen and input units such as a keyboard, mouse, and touch panel. The administrator terminal 100 can also be a portable device such as a tablet. The administrator performs the following operations on the administrator terminal 100, for example: setting examination-related information (examination ID, examination name, examination date, accrediting organization, certificate format, etc.), and storing this examination-related information in the examination information storage unit 44. Additionally, the administrator performs the following operations: setting information related to each question constituting each examination (examination ID, examination category, question ID, question type, question duration, answer duration, question data, correct answer data, etc.), and storing this information related to each question in the question storage unit 40.

[0144] Here, the exam name is, for example, "Exam X of Y Certification (Level 1)," used when issuing certification. Furthermore, the exam category here is not differentiated by English conversation exam, bar exam, etc., but rather indicates the type of questions that constitute the exam. For example, it might be "Exams consisting solely of questions requiring the wearing of an HMD (exams consisting solely of questions requiring the wearing of a non-transparent HMD)," "Exams consisting solely of questions not requiring the wearing of an HMD," or "A mixture of questions requiring and not requiring the wearing of an HMD (exams requiring the wearing of an HMD comprise 80% or more)," or it might indicate the rigor / comprehension of the exam (for example, whether it's a highly rigorous exam like a national exam or a relaxed exam like a daily lesson assessment, thus relating to whether or not a non-transparent HMD is required). Additionally, the exam category also includes information indicating whether note-taking is permitted during the exam.

[0145] Furthermore, the test question categories here refer to "test questions requiring HMD (non-transmissive HMD must be worn)," "test questions not requiring HMD," or "test questions allowing note-taking (test questions where note-taking is allowed during the exam)," "test questions not allowing note-taking," "test questions requiring verbal answers (e.g., answering a question aloud, such as speaking the foreign language in a foreign language exam)," and "test questions requiring silent answers by selecting from options," etc. Test presentation time refers to the time required to present a test question. For example, in the case of test questions where the question is read aloud, the presentation time is the duration required for that reading. In the case of test questions where only the question title or a diagram is displayed without verbal reading, the presentation time is a predicted duration based on the average time required for the test taker to read the question title or grasp the diagram. Answer time refers to the limited time for answering the question, which can be set to a duration such as 20 seconds to prevent improper behavior (e.g., insufficient time for improper dictionary lookup).

[0146] The self-verification requester terminal 110 is a terminal for self-verification requesters who, when receiving a certificate of authentication from another person, wish to verify whether the person presenting the certificate is the same person who was granted the certificate. Figure 1 As shown, the device comprises a main body 110A consisting of a computer, a display unit 111 such as an LCD screen connected to the main body 110A as a peripheral device, an input unit 112 such as a keyboard, mouse, and touch panel, a camera device 113, a microphone 114, and a fingerprint reader 115. The main body 110A is equipped with a web browser. Additionally, it may also be equipped with a user-specific verification program. The main body 110A can also be a portable device such as a tablet or smartphone.

[0147] Specifically, when a person holding a certification (who acts as an examinee during an exam) presents their certification in a situation such as a company job interview, the company accepting the presentation of the certification becomes the person verification requester and can verify the person's identity by communicating with the person verification unit 34 of the exam management server 20. Details of this will be described later in the description of the person verification unit 34 of the exam management server 20.

[0148] <Structure of Examination Management Server 20 / Pre-registration Acceptance Unit 21, Facial Image Acquisition Unit 22, Facial Feature Extraction Unit 23>

[0149] The pre-registration acceptance unit 21 performs the following processing: Based on a request from the examinee's terminal 50, it sends display data for a pre-registration screen (e.g., a web screen) via network 1, and receives personal information from the examinee's terminal 50 via network 1, such as the examinee's address, name, date of birth, interests, occupation, and student ID. It then stores the received personal information in the examinee information storage unit 43, associating it with an automatically assigned examinee ID (examination number, etc.) and examination ID. At this time, image data of photographic certificates for personal verification, such as driver's licenses, can also be registered. This image data can be used for comparison processing with the facial image data obtained by the facial image acquisition unit 22 (comparison processing performed by the misconduct determination unit 32).

[0150] In addition, the pre-registration acceptance unit 21 performs the following processing: receiving iris data captured by the person camera device 53 or auxiliary camera device 54 installed on the candidate terminal 50, or the inner direction camera device 69 of the non-transmissive HMD 60 and sent via the network 1, and storing the received iris data in the candidate information storage unit 43 in association with the candidate ID and the examination ID.

[0151] Furthermore, the pre-registration acceptance unit 21 performs the following processing: receiving voice data for voiceprint extraction acquired by the microphone 55 of the test taker terminal 50 or the microphone 70 of the non-transmissive HMD 60 and transmitted via the network 1; performing voiceprint analysis using the received voice data; and storing the obtained voiceprint data in the test taker information storage unit 43 in association with the test taker ID and the test ID. At this time, the voiceprint analysis method can use existing methods, either a text-dependent method that uses voice data obtained by speaking fixed content, or a text-independent method that uses voice data of non-fixed utterances.

[0152] In addition, the pre-registration acceptance unit 21 performs the following processing: receiving fingerprint data read by the fingerprint reading device 57 installed on the candidate terminal 50 and sent via the network 1, and storing the received fingerprint data in the candidate information storage unit 43 in association with the candidate ID and the examination ID.

[0153] The facial image acquisition unit 22 performs the following processing: receiving image data (moving or still images) of a person captured by a person-facing camera device 53 installed on the examinee terminal 50 via network 1 from the examinee terminal 50; acquiring facial image data by detecting and cropping facial portions from the received image data; and storing the acquired facial image data in the examinee information storage unit 43 in association with the examinee ID and the examination ID. The facial portion detection processing can employ existing methods. For example, feature-based methods that detect facial organs such as eyes and mouth, image-based methods that use pattern recognition via neural networks or support vector machines (SVMs), and methods combining both can be used. Alternatively, methods utilizing skin color information for facial detection can also be employed. Furthermore, image data of a person captured by an inward-facing camera device 69 of a non-transmissive head-mounted display 60 can be used instead of image data captured by the person-facing camera device 53; in this case, the inward-facing camera device 69 is a person-facing camera device. At this point, instead of wearing a non-transparent HMD 60, the non-transparent HMD 60 is held in hand to capture the entire face, and the distance between the non-transparent HMD 60 and the face is selected for shooting.

[0154] In addition, the facial image acquisition unit 22 also performs the following processing: when the face image acquisition determination unit 28 sends a removal instruction for the non-transparent head-mounted display 60 to the testee terminal 50, and determines after the removal instruction that the removal status data indicates that the device is not being worn, facial image data is acquired from the person image data sent from the testee terminal 50 via the network 1. That is, when the testee removes the non-transparent HMD 60 according to the removal instruction, facial image data is acquired from the person image data obtained in the removed state.

[0155] The facial feature extraction unit 23 performs the following processing: extracting facial features from the facial image data acquired by the facial image acquisition unit 22, and storing the extracted facial features in the examinee information storage unit 43 in association with the examinee ID and the examination ID. These facial features can also be features used in existing facial authentication methods performed after facial detection, such as the facial contour, the positional relationships of facial feature points such as the eyes, nose, and mouth.

[0156] <Structure of Examination Management Server 20 / Question Data Sending Unit 24 and Answer Data Receiving Unit 25>

[0157] The test data sending unit 24 performs the following processing: It sends the test data for the examination, which is stored in the test storage unit 40 and associated with the examination ID of the examination to be administered, to the examinee terminal 50 via network 1, so that it can be displayed on the display section 63 (see reference) of the non-transmissive head-mounted display 60 worn by the examinee. Figure 2 , Figure 3 This displays the test question data used in the exam.

[0158] At this time, the test data can be sent to the non-transmissive head-mounted display 60 for display on the display unit 63 via the main body 50A of the test taker terminal 50, or it can be sent directly to the non-transmissive head-mounted display 60 for display on the display unit 63 without going through the main body 50A.

[0159] Furthermore, the order in which test questions are sent can be a pre-determined order by all test takers, a random order that varies from test taker to test taker, or the test questions can be changed based on each test taker's performance (such as the accumulation of correct and incorrect judgments in the ongoing exam). Even for test takers taking the same exam at the same time, their speed of answering the same questions will differ. Additionally, sometimes the order in which the questions are presented is different, and sometimes the questions presented are different. Therefore, while the specific questions each test taker is working on may occasionally be the same, they are usually different at any given moment.

[0160] Furthermore, the test data sending unit 24 performs voice synthesis processing when necessary, converting the text data used as test data into voice data before sending it to the test taker terminal 50. Alternatively, voice synthesis processing can also be performed on the test taker terminal 50 side.

[0161] In addition, the test data transmission unit 24 also performs the following processing: In the processing of test questions that require wearing a non-transmissive head-mounted display 60 and require answering with actions, at the timing of the transition from the question-setting period to the answering period (the timing after the question-setting duration stored in the test question storage unit 40 has elapsed from the question-setting start time), a switching instruction to switch to the display mode for action answering is sent to the test taker terminal 50 via network 1. In this display mode for action answering, the wearer's gaze camera device 68 (see reference) will... Figure 2 , Figure 3 The captured image data of the wearer's gaze is displayed as a moving image on the display unit 63 of the non-transmissive HMD 60 (see reference). Figure 2 , Figure 3At least a portion of the wearer's gaze image data. Here, displaying the wearer's gaze image data as a moving image on at least a portion of the display unit 63 of the non-transmissive HMD 60 means that the wearer's gaze image data can be displayed on the entire display unit 63, or, during the answering period, the wearer's gaze image data can be displayed on a portion of the display unit 63 while the test questions, charts, etc., remain on a portion of the display unit 63. Alternatively, the test questions, charts, etc., can be overlaid on the wearer's gaze image data in the display unit 63.

[0162] The answer data receiving unit 25 performs the following processing: receiving the answer data of the examinee sent from the examinee terminal 50 via the network 1, and storing the received answer data in the answer storage unit 41 in association with the examination ID, examinee ID, and question ID.

[0163] At this time, the test taker, on the test taker terminal 50, uses the input unit 52 to input the answer corresponding to the test question, or uses the microphone 55 or the microphone 70 of the non-transmissive HMD 60 (see reference). Figure 3 Answers can be obtained by voice input. When voice input is made, voice recognition processing is performed on the answer data receiving unit 25 or the test taker terminal 50. In addition, mouse operations (movement operations, click operations, drag and drop operations, etc.) as input unit 52 can also be reflected on the virtual keyboard, buttons, and other operation objects displayed on the display unit 63 of the non-transparent HMD 60.

[0164] Furthermore, the answer data receiving unit 25 performs the following processing: when the display of the non-transmissive HMD 60's display unit 63 is switched to the display mode for action answering, it receives wearer gaze image data sent from the test taker's terminal 50 via the network 1 as answer data. In other words, the wearer gaze image data is the answer data. Specifically, for example, if the question is answered in written form, wearer gaze image data (moving or still image) containing characters and graphics written down by the test taker is received as answer data. Questions answered in written form include, for example, questions that broadcast "Good morning" in Japanese and ask the test taker to write it down in Chinese, or questions that broadcast "Please draw a circle" in Chinese and ask the test taker to draw a circle. If the answer data consists of written characters (including numbers and symbols), the evaluation unit 27 can perform character reading processing using OCR to convert the answer data into text data, thereby performing an evaluation (correctness judgment, scoring). If the image is written down, the evaluation unit 27 can perform pattern recognition processing using, for example, a neural network, to evaluate the depicted image (correctness judgment, scoring). In this case, a pattern recognition model is built in advance using correct and incorrect answer data as learning data. That is, a learning process (determining parameters) for building a pattern recognition model is performed in advance using wearer gaze image data judged as correct and incorrect, as well as the corresponding labels for correct and incorrect answers. Furthermore, this written input of characters (including numbers and symbols) and graphics can also be performed using a digital pen and digital paper. Here, answer data is obtained based on wearer gaze image data of characters and graphics written down on ordinary paper. Therefore, test takers can use ordinary note-taking tools (non-digital note-taking tools) such as pencils and ballpoint pens and ordinary paper to answer questions, thus experiencing the feeling of a normal paper-based exam.

[0165] Alternatively, test tools (physical objects) such as red and white building blocks may be used. For example, when a test question is given in a language other than the test subject's native language, such as "Please place the white building block on top of the red building block," or "Please place the red building block from the right in the second position out of the five building blocks," the test subject actually performs the action. The answer data receiving unit 25 receives the wearer's gaze image data (motion image) containing the action or the wearer's gaze image data (still image) containing the state after the action is completed, as the answer data. The evaluation unit 27 can perform pattern recognition processing, such as using a neural network, on this action and the state after the action is completed, thereby performing evaluation (correctness judgment, scoring). In this case, a pattern recognition model is built in advance using correct and incorrect answer data as learning data. Furthermore, by displaying virtual building blocks or similar objects on the display unit 63 of the non-transmissive HMD60 and allowing the user to manipulate them in virtual space, it is possible to fulfill test questions that require such actions from the test taker. However, here, the test taker does not perform actions in virtual space, but rather answers by performing actions in real space. This allows them to physically grasp and move the testing tools (physical objects) such as building blocks, thus avoiding the cumbersome experience of moving virtual objects using a mouse. Additionally, depending on the content of the test, it can be answered as if it were a practical exam. For example, if the test question involves rope work on a ship (rope tying methods), the answer is performed using ropes in real space, thus providing a practical exam-like experience. Moreover, it is also possible to simultaneously have a display mode for answering questions by performing actions in real space using the wearer's gaze image data and a display mode for answering questions using VR operation. The answer is chosen based on the test, the question, or the test taker's selection.

[0166] <Structure of Examination Management Server 20 / Dismount / Wear Status Data Receiving Unit 26>

[0167] The don / wear status data receiving unit 26 performs the following processing: receiving data from the don / wear detection device 66 (see reference 66) installed on the non-transmissive head-mounted display 60. Figure 2 , Figure 3 The system detects and receives the non-transmissive head-mounted display 60's wear / don't status data sent from the test taker's terminal 50 via network 1. It then stores the received wear / don't status data for the question-setting period and the answer-setting period (more specifically, data obtained by combining information indicating the difference between the question-setting period and the answer-setting period with information indicating the difference between wearing and not wearing) in association with the test ID, test taker ID, and question ID in the answer storage unit 41 (in this embodiment, the answer storage unit 41 also serves as the wear / don't status storage unit).

[0168] At this time, the donning / wearing status data from the donning / wearing detection device 66 of the non-transmissive HMD 60 is continuously transmitted from the testee terminal 50, so the donning / wearing status data receiving unit 26 can... Figure 5 As shown, the device receives wear / don't status data for both the question-setting and answer-setting periods for each question. Furthermore, during the question-setting period of a particular question, if the wear / don't status data sometimes indicates wearing and sometimes indicates not wearing, it is treated as non-wearing data and stored in the answer storage unit 41. Similarly, during the answer-setting period of a particular question, if the wear / don't status data sometimes indicates wearing and sometimes indicates not wearing, it is also treated as non-wearing data and stored in the answer storage unit 41.

[0169] <Structure of Examination Management Server 20 / Evaluation Unit 27>

[0170] Evaluation unit 27 performs the following processing: it uses the answer data stored in answer storage unit 41 and the correct answer data stored in question storage unit 40 to evaluate the examinee's answer data (correctness judgment, scoring), and stores the evaluation result data in answer storage unit 41 in association with the exam ID, examinee ID, and question ID.

[0171] As described in the description of evaluator terminal 90, the test taker's answers are sometimes automatically evaluated by evaluation unit 27, and sometimes evaluated by the evaluator in evaluator terminal 90.

[0172] In the case of automatic evaluation, the evaluation unit 27 performs evaluation (correctness determination, scoring) by comparing the answer data stored in the answer storage unit 41 with the correct answer data stored in the question storage unit 40. When the wearer's gaze image data becomes the answer data, as described in the description of the answer data receiving unit 25, the evaluation unit 27 performs character reading processing on the written characters (including numbers and symbols) contained in the wearer's gaze image data, or performs pattern recognition processing on the written graphics contained in the wearer's gaze image data, or performs pattern recognition processing on the actions and the state after the actions are completed contained in the wearer's gaze image data.

[0173] In the latter case where the evaluation is conducted by an evaluator, the evaluation unit 27 responds to a request from the evaluator from the evaluator terminal 90 by sending the answer data stored in the answer storage unit 41 and the correct answer data stored in the question storage unit 40 to the evaluator terminal 90 via the network 1. It also receives the evaluation result data sent from the evaluator terminal 90 via the network 1 and stores the received evaluation result data in the answer storage unit 41 in association with the exam ID, examinee ID, and question ID.

[0174] <Structure of Examination Management Server 20 / Whether Facial Image Acquisition Determination Unit 28 is Required>

[0175] Whether it is necessary to obtain facial image judgment unit 28 performs the following processing: if the test questions that require wearing non-transmissive head-mounted display 60 have been continuous for a predetermined number of test questions or for a predetermined time, and it is determined that the wearing status data during the continuous period is data indicating wearing, at any time interval, a non-transmissive head-mounted display 60 removal instruction is sent to the test taker terminal 50 via network 1 to obtain facial image data during the test period, that is, to obtain facial image data that is different from the facial image data before the start of the test and after the end of the test.

[0176] Then, as described in the description of the facial image acquisition unit 22, when the testee terminal 50 is sent with the above-mentioned non-transmissive HMD 60 removal instruction, and after the removal instruction is sent, it is determined that the removal status data received by the removal status data receiving unit 26 is data indicating non-wearing, the facial image acquisition unit 22 acquires facial image data from the person image data sent from the testee terminal 50 via the network 1.

[0177] <Structure of Examination Management Server 20 / Score Calculation Unit 29 and Certificate Production Unit 30>

[0178] The score calculation unit 29 performs the following processing: It calculates the scores of each examinee using the evaluation result data stored in the answer storage unit 41, and stores the judgment result of whether or not a certification (qualification certificate) will be issued as score data, associated with the exam ID, examinee ID, and certification certificate ID (which is the certification number, but not assigned if no certification certificate is issued), in the score storage unit 42. Alternatively, in the case of an exam where a certification certificate will be issued even if the score is poor, the certification level and total score to be recorded on the certification certificate are stored as score data, associated with the exam ID, examinee ID, and certification certificate ID, in the score storage unit 42. Furthermore, if the misconduct judgment unit 32 determines that misconduct has occurred, the score calculation unit 29 may not perform the processing.

[0179] The certification production unit 30 performs the following processing: using the examination name, examination date, accrediting organization, certification certificate format, etc., stored in the examination information storage unit 44 and associated with the examination ID of the examination to which the certification certificate is to be issued, as well as the score data stored in the score storage unit 42, to produce the electronic or paper certification certificate 300 to be issued to the examinee (see reference). Figure 7 Furthermore, if the misconduct determination unit 32 determines that misconduct has occurred, a certificate will not be issued. Additionally, a certificate will not be issued if the performance does not meet the certification criteria. However, a certificate will be issued in cases where an examination recognizes a candidate's level regardless of the performance (and therefore, even a poor performance), such as a score in a language learning exam or a grade determined based on the performance.

[0180] like Figure 7 As shown, the certification certificate 300 contains the certification title such as "Certificate of Qualification" or "Certificate of Completion," the certification ID (certification number, etc.), the name, the examination name, the certification date (or the examination implementation date), and the certifying organization. Additionally, the certification certificate 300 contains a facial photograph 310, a two-dimensional barcode 321 for facial features, a two-dimensional barcode 322 for iris data, a two-dimensional barcode 323 for voiceprint data, a two-dimensional barcode 324 for fingerprint data, and a two-dimensional barcode 325 for personal information such as interests.

[0181] At this point, if the misconduct determination unit 32 determines that all or approximately all facial feature values ​​are identical, the certificate production unit 30 uses the facial image data that most clearly represents the examinee's face from the multiple facial image data stored in the examinee information storage unit 43 as the facial photograph 310 to be published on the certificate 300, and publishes the two-dimensional barcode 321 of the facial feature values ​​extracted from this facial image data on the certificate 300. Regarding the state that most clearly represents the face, for example, the size of the eyes and the orientation towards the front can be appropriately set. Each examinee can choose whether or not to have their facial photograph 310 published.

[0182] Furthermore, the certificate production unit 30 encrypts personal information such as facial features, iris data, voiceprint data, fingerprint data, and interests, and then converts it into two-dimensional barcodes. Each applicant can choose whether to display each two-dimensional barcode 321-325. In addition, the evidentiary value of the certificate 300 decreases when neither a facial photograph 310 nor each two-dimensional barcode 321-325 is displayed.

[0183] <Structure of Examination Management Server 20 / Light Management Unit 31>

[0184] The light emission management unit 31 performs the following processing: In the processing of test questions that require wearing a non-transmissive head-mounted display 60, it sends a signal via network 1 to the test taker terminal 50 to activate the light emission unit 67 (see reference). Figure 2 , Figure 3 The system provides a light emission indicator at any given time. When the light emission is scheduled, it receives image data of a person captured by a person camera device 53 installed on the examinee terminal 50 and sent via network 1 as image data for light emission confirmation. It confirms whether the received image data for light emission confirmation has captured the light emission of the light-emitting part 67, and stores the light emission confirmation result data in association with the examinee ID and the examination ID in the light emission confirmation result storage unit 45.

[0185] At this time, as Figure 5 As shown, the duration of light emission from the light-emitting section 67 of the non-transmissive head-mounted display 60 under a single light emission instruction from the light emission management unit 31 is not instantaneous, but rather constitutes a light emission period of a certain length (e.g., 1 second, several seconds, etc.). Furthermore, during this light emission period, image data of a person captured by the person-viewing device 53 (image data for light emission confirmation) is transmitted via the network 1. Therefore, at least one image data for light emission confirmation is obtained for each light emission instruction (one light emission period). If the light emission were instantaneous, and the frame rate (FPS: frames per second) of the moving image data was low when transmitting the person-view image data in the form of a moving image, it might be possible that although light emission actually occurred, it could not be confirmed. This situation is avoided by forming a light emission period.

[0186] <Structure of Examination Management Server 20 / Unfair Behavior Judgment Unit 32>

[0187] The improper behavior determination unit 32 performs the following processing: using the undress status data of the question-setting period and the undress status data of the answer-setting period received by the undress status data receiving unit 26 and stored in the answer storage unit 41, it determines whether the undress status is appropriate relative to the question category of the given test questions.

[0188] Specifically, the improper conduct determination unit 32 performs the following processing: In cases where it is determined that the data on the wearing / unwearing status during the question-setting period in the processing of test questions requiring the wearing of a non-transmissive head-mounted display 60 is data indicating wearing, and the data on the wearing / unwearing status during the answer-setting period is data indicating not wearing (e.g., Figure 5In the case of question (N-2), information such as the possibility of improper behavior is conveyed to the monitoring unit 33 (for example, indicating that the monitoring level needs to be displayed with a red box to attract attention). In addition, sometimes the non-transmissive HMD 60 is temporarily removed due to reasons such as itchy eyes, so if the above-mentioned removal state is detected, it will not be directly judged as improper behavior.

[0189] In addition, the improper behavior determination unit 32 performs the following processing: in the case where the data on the wearing / unwearing status during the question-setting period in the process of determining that the test question requires wearing a non-transmissive head-mounted display 60 is data indicating non-wearing (e.g., Figure 5 In the case of question (N-1) and question N, since the test taker cannot see the question from the beginning, it is possible to directly move on to the next question. However, in this embodiment, the processing of the question continues, and the monitoring unit 33 is informed that there may be improper behavior (for example, that the monitoring level is at a level that needs to be displayed with a yellow box to attract attention).

[0190] Furthermore, in processing test questions where it is not necessary to wear the non-transmissive head-mounted display 60, the improper conduct determination unit 32 determines that improper conduct is impossible unless it is determined based on judgment factors other than the wearing / unwearing status data.

[0191] In addition, the improper behavior determination unit 32 also performs the following processing: if the light emission confirmation result data stored in the light emission confirmation result storage unit 45 is not confirmed during the processing of the light emission management unit 31, it is determined that improper behavior has been performed.

[0192] Furthermore, the improper behavior determination unit 32 also performs the following processing: determining whether the multiple facial feature quantities extracted by the facial feature quantity extraction unit 23 are all consistent or all roughly consistent, and determining that improper behavior has been committed if they are not all consistent or all roughly consistent.

[0193] <Structure of Examination Management Server 20 / Monitoring Unit 33>

[0194] The monitoring unit 33 performs the following processing: receiving image data containing the examinee's face captured by the human image camera device 53 installed on the examinee's terminal 50 and transmitted via the network 1, such as... Figure 6 As shown, the received image data of the person is displayed as a moving image on the monitoring screen 200 of the display unit 81 of the monitor terminal 80.

[0195] exist Figure 6In the monitoring screen 200, there is an overall display unit 201 and an individual display unit 202. The overall display unit 201 displays images of multiple examinees, etc., and the individual display unit 202 displays images of a specific person or a small number of examinees selected by the monitor.

[0196] The overall display unit 201 includes a person image display unit 210 and a light-emitting period display unit 220. The person image display unit 210 displays the person image data of multiple examinees in a moving image format. The light-emitting period display unit 220 displays the light-emitting period in sync with the light-emitting unit 67 of the non-transmissive HMD 60 by using coloring or other methods when the light-emitting management unit 31 issues a light-emitting instruction. The monitoring unit 33 receives the light-emitting instruction from the light-emitting management unit 31 and executes the display of the light-emitting period display unit 220.

[0197] In the image display unit 210, if the examinee is wearing a non-transparent HMD 60, the wearing status is displayed on the image display unit 210, so the monitor can confirm whether the light-emitting part 67 of the non-transparent HMD 60 is emitting light. Furthermore, the light emission is not always continuous. Therefore, if the image is always emitting light, it indicates either a malfunction of the light-emitting part 67 of the non-transparent HMD 60 (the examinee can avoid loss if the malfunction is later proven), or improper conduct such as placing a photograph in a luminous state. On the other hand, if it does not emit light at all, it indicates wearing a non-transparent HMD 60 different from the one displaying the test questions, or improper conduct such as placing a photograph. Additionally, if the light emission of the light-emitting part 67 of the non-transparent HMD 60 displayed on the image display unit 210 is not synchronized with the display of the illumination period indication in the illumination period display unit 220 (using coloring, etc.), it indicates improper conduct except a malfunction of the light-emitting part 67 of the non-transparent HMD 60.

[0198] Furthermore, in the processing of test questions that require answers with actions, when the display of the non-transmissive HMD 60's display unit 63 is switched to the display mode for action answers, the wearer's gaze image data captured by the wearer's gaze camera device 68 is displayed on the person image display unit 210 instead of the person image data.

[0199] Individual display units 202 are equipped with a person image display unit 210, a light emission period display unit 220, and one or more auxiliary image display units 230. The person image display unit 210 displays the person image data of the examinee selected by the monitor in the form of a moving image. The light emission period display unit 220 shows the light emission period of the examinee. The one or more auxiliary image display units 230 display the auxiliary image data captured by one or more auxiliary camera devices 54 in the case where one or more auxiliary camera devices 54 are provided on the examinee terminal 50, in the form of a moving image. Similar to the overall display unit 201, in the processing of test questions that require answers with action, when the display of the non-transmissive HMD 60 is switched to the display mode for action answers, the person image display unit 210 of the individual display unit 202 also displays the wearer's gaze image data captured by the wearer's gaze camera device 68 instead of the person image data. Alternatively, in individual display units 202, instead of switching displays, two display units can be set up: one for the person's image data and the other for the wearer's gaze image data. Furthermore, the monitor selects the examinee using the input unit 82, and the monitoring unit 33 handles this operation to switch, add, or delete examinees as the display objects. Additionally, the monitoring unit 33 receives auxiliary image data sent from the examinee's terminal 50 via network 1 to perform the display on the auxiliary image display unit 230.

[0200] Furthermore, the monitoring unit 33 receives a message from the misconduct determination unit 32 and performs attention-grabbing display processing around or near the candidate's image data displayed on the display unit 81 of the monitor terminal 80. For example... Figure 6 As shown, when the improper conduct determination unit 32 receives information that improper conduct may exist, for example, by surrounding the image display unit 210 with a red frame, attention-grabbing display processing is performed (see reference). Figure 6 (Examination number 2). Furthermore, when the system receives (slightly lower) information from the misconduct determination unit 32 regarding the potential existence of misconduct, it performs attention-grabbing display processing, for example, by surrounding the image display unit 210 with a yellow frame (see reference 2). Figure 6 Exam number 7).

[0201] <Structure of Exam Management Server 20 / Personal Confirmation Unit 34>

[0202] The self-verification unit 34 performs the following processing: using various data for self-verification sent from the self-verification requester terminal 110 via network 1, it verifies that an authentication certificate 300 has been presented to the self-verification requester (see reference). Figure 7The system determines whether the person presenting the certification (the person who actually took the exam) is the one who accepted the certification and performs the following processing: It sends the self-confirmation result data via network 1 to the self-confirmation requester terminal 110 and displays the self-confirmation result data on the display unit 111. For example, when a candidate presents their certification 300 to the company for a job interview, the company (the interviewer) is the self-confirmation requester. By referring to the self-confirmation result displayed on the display unit 111 of the self-confirmation requester terminal 110, the self-confirmation requester can confirm whether the person presenting the certification 300 (the candidate for the job interview) is the one who took the exam related to the presented certification 300.

[0203] Specifically, firstly, if the presented certification certificate 300 contains a facial photograph 310, the applicant confirms that they visually compare the face of the person presented with the certification certificate 300 (the person who came to accept the admission interview) with the facial photograph 310 on the certification certificate 300 to determine whether they are the same person.

[0204] In addition, if the presented certification certificate 300 contains a two-dimensional barcode 321 containing facial features, the applicant for personal verification can use the camera device 113 to capture a person image data containing the face of the person who came for the recruitment interview in the applicant for personal verification terminal 110. The captured person image data is sent to the personal verification unit 34 of the examination management server 20 via the network 1. Furthermore, the applicant can use the camera device 113 to capture the two-dimensional barcode 321 containing facial features on the presented certification certificate 300. The captured two-dimensional barcode 321 containing facial features (in an encrypted state) is sent to the personal verification unit 34 of the examination management server 20 via the network 1. Then, in the examination management server 20, the self-confirmation unit 34 receives the current person image data sent from the self-confirmation requester terminal 110 via the network 1, obtains facial image data from the received person image data, extracts the current facial feature quantity from the facial image data, and receives the two-dimensional barcode 321 of the facial feature quantity sent from the self-confirmation requester terminal 110 via the network 1, performs decryption processing to obtain the facial feature quantity at the time of the examination, determines whether the facial feature quantities of both parties are consistent or approximately consistent, and sends the self-confirmation result data to the self-confirmation requester terminal 110 via the network 1.

[0205] Furthermore, when the presented certification certificate 300 contains a two-dimensional barcode 322 of iris data, the applicant for personal verification uses the camera device 113 to capture the iris data of the person applying for the interview in the applicant for personal verification terminal 110, and sends the captured iris data to the personal verification unit 34 of the examination management server 20 via network 1. The applicant also uses the camera device 113 to capture the two-dimensional barcode 322 of the iris data on the presented certification certificate 300, and sends the two-dimensional barcode 322 of the captured iris data (in an encrypted state) to the personal verification unit 34 of the examination management server 20 via network 1. Then, in the examination management server 20, the self-confirmation unit 34 receives the current iris data sent from the self-confirmation requester terminal 110 via network 1, and receives the two-dimensional barcode 322 of the iris data sent from the self-confirmation requester terminal 110 via network 1, performs decryption processing to obtain the iris data at the time of the examination, determines whether the iris data of both parties are consistent or approximately consistent, and sends the self-confirmation result data to the self-confirmation requester terminal 110 via network 1.

[0206] In addition, when the presented certification certificate 300 contains a two-dimensional barcode 323 containing voiceprint data, the applicant for self-verification uses a microphone 114 in the applicant for self-verification terminal 110 to obtain the voice data of the person who came for the admission interview. The obtained voice data is sent to the self-verification unit 34 of the examination management server 20 via network 1. The applicant also uses a camera device 113 to capture the two-dimensional barcode 323 of the voiceprint data on the presented certification certificate 300. The captured two-dimensional barcode 323 of the voiceprint data (in an encrypted state) is sent to the self-verification unit 34 of the examination management server 20 via network 1. Then, in the examination management server 20, the self-confirmation unit 34 receives the voice data sent from the self-confirmation requester terminal 110 via network 1, uses the received voice data to perform voiceprint analysis (using the same method as the voiceprint analysis performed by the pre-registration acceptance unit 21) to obtain the current voiceprint data, and receives the two-dimensional barcode 323 of the voiceprint data sent from the self-confirmation requester terminal 110 via network 1, performs decryption processing to obtain the voiceprint data at the time of the examination, determines whether the voiceprint data of both parties are consistent or substantially consistent, and sends the self-confirmation result data to the self-confirmation requester terminal 110 via network 1.

[0207] Furthermore, when the presented certification certificate 300 contains a two-dimensional barcode 324 displaying fingerprint data, the applicant for personal verification, in the applicant's terminal 110, obtains the fingerprint data of the person applying for the interview through the fingerprint reader 115, and sends the obtained fingerprint data to the personal verification unit 34 of the examination management server 20 via network 1. The applicant also uses the camera device 113 to capture the two-dimensional barcode 324 of the fingerprint data on the presented certification certificate 300, and sends the captured two-dimensional barcode 324 (in an encrypted state) to the personal verification unit 34 of the examination management server 20 via network 1. Then, in the examination management server 20, the personal verification unit 34 receives the current fingerprint data sent from the applicant's terminal 110 via network 1, and also receives the two-dimensional barcode 324 of the fingerprint data sent from the applicant's terminal 110 via network 1. It decrypts the barcode to obtain the fingerprint data at the time of the examination, determines whether the fingerprint data of both parties is consistent or substantially consistent, and sends the personal verification result data to the applicant's terminal 110 via network 1.

[0208] In addition, when the presented certification certificate 300 contains a two-dimensional barcode 325 containing personal information, the applicant can inquire about the applicant's name, date of birth, interests, and other personal information from the interviewee. The applicant can then input the obtained personal information into the input unit 112 on the applicant terminal 110 and send the input personal information to the applicant verification unit 34 of the examination management server 20 via the network 1. Furthermore, the applicant can use the camera device 113 to capture the two-dimensional barcode 325 of personal information on the presented certification certificate 300 and send the captured two-dimensional barcode 325 (in an encrypted state) of personal information to the applicant verification unit 34 of the examination management server 20 via the network 1. Then, in the examination management server 20, the self-confirmation unit 34 receives the current personal information sent from the self-confirmation requester terminal 110 via the network 1, and receives the two-dimensional barcode 325 of the personal information sent from the self-confirmation requester terminal 110 via the network 1, performs decryption processing to obtain the personal information at the time of the examination, determines whether the personal information of both parties is consistent or substantially consistent, and sends the self-confirmation result data to the self-confirmation requester terminal 110 via the network 1.

[0209] <Structure of Examination Management Server 20 / Question Storage Unit 40, Answer Storage Unit 41, Score Storage Unit 42, Examinee Information Storage Unit 43, Examination Information Storage Unit 44, and Illuminated Confirmation Result Storage Unit 45>

[0210] like Figure 4As shown, the test question storage unit 40 stores the test ID, test category, test question ID, test question type, question creation time, answering time, test question data, and correct answer data in a related manner.

[0211] like Figure 4 As shown, the answer storage unit 41 stores the exam ID, examinee ID, question ID, answer data, wear-off status data during the question-setting period, wear-off status data during the answer-setting period, and evaluation result data in a related manner. Furthermore, the answer storage unit 41 in this embodiment also serves as a wear-off status storage unit. In the case of a separate wear-off status storage unit, the exam ID, examinee ID, question ID, wear-off status data during the question-setting period, and wear-off status data during the answer-setting period are stored in a related manner.

[0212] like Figure 4 As shown, the score storage unit 42 stores the exam ID, examinee ID, score data, and certification ID in association.

[0213] like Figure 4 As shown, the candidate information storage unit 43 stores candidate ID, examination ID, address, name, date of birth, interests, occupation, facial image data (including multiple candidates), facial feature data (including multiple candidates), iris data, voiceprint data, fingerprint data, etc. in a related manner.

[0214] like Figure 4 As shown, the examination information storage unit 44 stores the examination ID, examination name, examination implementation date, accrediting organization, and accreditation certificate format in a related manner.

[0215] like Figure 4 As shown, the light emission confirmation result storage unit 45 stores the examinee ID, the examination ID, and multiple light emission confirmation result data in association.

[0216] Structure of the non-transmissive head-mounted display 60: Figure 2 , Figure 3 >

[0217] exist Figure 2 and Figure 3The non-transmissive head-mounted display 60 comprises: a main body 60A; a first strap 61 (a strap that contacts the top of the head) and a second strap 62 (a strap that wraps around the left and right sides and the back of the head) for fixing the main body 60A to the wearer's head; a display unit 63 embedded in the main body 60A; a control unit 64 for performing various controls, including display, input / output control, and communication control; a communication unit 65 for communicating with the main body 50A of the test taker terminal 50 or the test management server 20; a removal detection device 66 for detecting the removal status of the non-transmissive head-mounted display 60; a light-emitting unit 67 for emitting light upon receiving a light-emitting instruction from the light-emitting management unit 31; a wearer's gaze imaging device 68 capable of capturing the space outside the non-transmissive head-mounted display 60 according to the wearer's gaze; an inner-direction imaging device 69 capable of capturing the inner direction (the direction of the wearer's face) of the non-transmissive head-mounted display 60; a microphone 70; and a speaker 71.

[0218] In this embodiment, as an example, the don / wear detection device 66 is provided at least one of the connecting portions 61A of the first strap 61 and 62A and 62B of the second strap 62. When there are three don / wear detection devices 66A, 66B, and 66C, if all don / wear detection devices are in a wearing state, the overall output indicates wearing data; if any one don / wear detection device is in a non-wearing state, the overall output indicates non-wearing data. Therefore, it can also be considered that the whole constitutes one don / wear detection device 66. This don / wear detection device 66 can be a structure that detects the don / wear state by detecting the contact / non-contact of the hook constituting the connecting portion, a structure that detects the don / wear state by capturing the situation where the laser is blocked when one side of the connecting portion is inserted into the other, or a structure that detects the don / wear state by using a gap sensor to detect the gap between one side of the connecting portion and the other. It can be any don / wear detection method. Furthermore, in this embodiment, the donning / wearing detection device 66 is provided at the connecting part in the middle of the strap, but it may also be provided at the connecting part between the strap and the main body 60A. In addition, it does not necessarily have to be provided at the connecting part. For example, it may be provided at the main body 60A and configured as a donning / wearing detection method that measures the distance between the main body 60A and the wearer's head.

[0219] The wearer's line-of-sight camera 68 and the inward-facing camera 69 are, for example, composed of a CCD camera, a CMOS camera, etc. Furthermore, if the non-transparent head-mounted display 60 is not required for the exam or test, the wearer's line-of-sight camera 68 and the inward-facing camera 69 can both be used as a person-viewing camera 53 for capturing images of a person primarily including their face (in this case, the examinee), and can also be used as an auxiliary camera 54 for capturing images of things other than the person including their face (the examinee) (e.g., hands operating the keyboard, the surrounding environment, etc.). In this case, it is necessary to fix the camera direction (direction of the camera's center line) of the wearer's line-of-sight camera 68 and the inward-facing camera 69 towards the person including their face and other things (hands operating the keyboard, etc.), depending on the purpose. Therefore, it is preferable to prepare a dedicated support for fixing the main body 60A of the non-transparent HMD 60 in the desired posture, or to make the shape of the main body 60A of the non-transparent HMD 60 suitable for fixing. The former refers to a dedicated support device, such as a camera tripod. The latter refers to a shape suitable for fixing, such as the following: the bottom part of the main body 60A is formed so that when the non-transparent HMD 60 is placed on a table, the camera directions of the wearer's line of sight camera 68 and the inner direction camera 69 are oriented towards the target direction; a hook-shaped part (similar to the hook-shaped part used for fixing on a typical webcam) is provided on the bottom part of the main body 60A, which can be installed by hanging the hook-shaped part on the upper end of the display unit 51.

[0220] The display unit 63 includes a normal display mode, a display mode for answering questions, and a display mode for taking notes. In the normal display mode, the test questions, charts, and other information are displayed on the screen of the display unit 63.

[0221] In the display mode for action-based answers, when processing test questions that require wearing a non-transparent head-mounted display 60 and require action-based answers, during the timing of the transition from the question-setting period to the answering period, wearer gaze image data captured by the wearer gaze camera 68 is displayed as a moving image on at least a portion of the display unit 63 of the non-transparent HMD 60. Details of this action-based answer display mode have been described in detail in the description of the answer data receiving unit 25, and therefore, detailed descriptions are omitted here.

[0222] In the note-taking display mode, for test questions requiring the wearing of a non-transparent head-mounted display 60 and allowing written note-taking during both the question-setting and answer-setting periods, the test question data and wearer gaze image data captured by the wearer's gaze camera device 68 are displayed on the display unit 63 of the non-transparent HMD 60, enabling the test taker to take written notes. At this time, the display area for the test question data and the display area for the wearer's gaze image data in the display unit 63 can be divided, or the two types of data can be superimposed. In the case of dividing the display area as described above, for example, one side (the display area for the wearer's gaze image data) can be divided into left-right or top-bottom sections, or into upper right and other sections, lower right and other sections, upper left and other sections, or lower left and other sections. Thus, during the question-setting period, if the question is long, the test taker can take notes focusing on its main points or keywords in the question title. That is, they can use their own hands to write notes on paper (not number paper, but regular paper) using note-taking tools such as pencils and ballpoint pens. In addition, during the problem-solving period, they can calculate or think in written form.

[0223] The display unit 63 can also be constructed by mounting a smartphone onto the main body 60A of a non-transmissive HMD 60. In this structure, when a light-emitting unit 67 is provided, the light-emitting unit 67 needs to be powered by the smartphone constituting the display unit 63. This is because the main body 60A with the light-emitting unit 67 and the smartphone mounted on the main body 60A are not integrated but can be separated. Therefore, a person other than the test taker (an assistant) can remove the smartphone from the main body 60A and hide it in another location to view the smartphone's display screen and thus understand the test questions. Therefore, the smartphone is connected to the main body 60A by a cable or the like, and the light-emitting unit 67 is powered by a signal from the smartphone. Alternatively, a mirror or the like can be used to refract a portion of the light (the light used to form the light-emitting unit 67) from the smartphone's display screen (the side facing the wearer's face) so that the light is directed in the opposite direction.

[0224] The microphone 70 and speaker 71 can be configured by connecting an earphone, which is a separate entity from the main body 60A of the non-transmissive HMD 60, to the main body 60A (in...). Figure 2 (Not shown in the figure) It can also be built into the main body 60A. In addition, when using a microphone 55 and a speaker 56 connected to the main body 50A of the test taker terminal 50, the microphone 70 and speaker 71 can be omitted.

[0225] The overall process of processing involved in the exam: Figure 4 >

[0226] In this embodiment, various examinations are conducted through the examination system 10 via a processing flow as follows.

[0227] exist Figure 4 First, the examinee operates the examinee terminal 50 to input their personal information, such as address, name, date of birth, interests, and occupation, as pre-registration data, and sends it to the examination management server 20 via network 1 (step S1). In the examination management server 20, the pre-registration acceptance unit 21 receives the examinee's personal information, such as interests, sent from the examinee terminal 50 via network 1, and stores the received personal information in the examinee information storage unit 43 in association with the automatically assigned examinee ID (examination number, etc.) and examination ID (step S2). At this time, the examinee can also send image data of a photo ID certificate (such as a driver's license), iris data, voiceprint data, and fingerprint data as needed, so that the examinee information storage unit 43 stores the aforementioned data. Details of these processing steps have been described in detail in the description of the pre-registration acceptance unit 21, and therefore, detailed descriptions are omitted here.

[0228] Next, the examinee operates the examinee terminal 50 to capture a portrait image containing their face using the portrait camera device 53 and sends the captured portrait image data to the examination management server 20 via network 1 for registration of facial image data and facial feature values ​​before the start of the examination (step S3). In the examination management server 20, the facial image acquisition unit 22 receives the portrait image data sent from the examinee terminal 50 via network 1, acquires facial image data by detecting and cropping parts of the face from the received portrait image data, and stores the acquired facial image data in the examinee information storage unit 43 in association with the examinee ID and examination ID. Furthermore, the facial feature extraction unit 23 extracts facial feature values ​​from the facial image data and stores the extracted facial feature values ​​in the examinee information storage unit 43 in association with the examinee ID and examination ID (step S4). Details of these processing operations have been described in detail in the descriptions of the facial image acquisition unit 22 and the facial feature extraction unit 23, so detailed descriptions are omitted here.

[0229] Then the exam begins. Here, we will describe the exam scenario where a non-transparent head-mounted display (HMD) 60 is required. At the examinee terminal 50, the examinee wears the non-transparent HMD 60 to prepare for the exam. Then, in the exam management server 20, the question data sending unit 24 sends the exam question data, associated with the exam ID of the exam to be performed, stored in the question storage unit 40, to the examinee terminal 50 via network 1, so that it can be displayed on the display unit 63 (see reference 60) of the non-transparent HMD 60 worn by the examinee. Figure 2 , Figure 3Display the test question data for the exam (step S5).

[0230] In the test taker terminal 50, the test question data sent from the examination management server 20 via network 1 is received either directly or via the main body 50A into the non-transmissive head-mounted display 60, and the test question data (test questions, charts, etc.) begins to be reproduced (step S6). This reproduction is only displayed on the display unit 63, but may also be accompanied by sound output. The presentation (questioning) of the test questions continues for the duration stored in the test question storage unit 40 after the reproduction begins; this period is the question-setting time period.

[0231] Then, during the question-setting period, the donning / wearing status data output from the donning / wearing detection device 66 of the non-transmissive head-mounted display 60 is sent to the examination management server 20 via network 1 (step S7). This transmission can be sent either through the main body 50A of the test taker terminal 50 or directly from the non-transmissive HMD 60 to network 1 without going through the main body 50A.

[0232] In the examination management server 20, the don-wear status data receiving unit 26 receives the don-wear status data sent from the non-transparent HMD 60 via the network 1, and stores the received don-wear status data of the question setting period in the answer storage unit 41 in association with the examination ID, examinee ID, and question ID (step S8).

[0233] Furthermore, the improper conduct determination unit 32 uses the undressing / wearing status data stored in the answer storage unit 41 during the question-setting period to determine whether the undressing / wearing status is appropriate relative to the question category of the given questions (whether a noticeable display is required). If the condition is met, information indicating possible improper conduct is transmitted to the monitoring unit 33. The monitoring unit 33 receives this transmission and displays a noticeable display on the monitor terminal 80 (step S8). Details of these processes have been described in detail in the descriptions of the improper conduct determination unit 32 and the monitoring unit 33, therefore, detailed descriptions are omitted here.

[0234] If the question requires answers involving actions, at the timed end of the question-setting period and the start of the answering period, the question data sending unit 24 sends a switching instruction to the test taker terminal 50 via network 1 to switch to the display mode for action-based answers (step S9). In the test taker terminal 50, when the non-transmissive head-mounted display 60 receives the switching instruction to the display mode for action-based answers via the main body 50A or directly, the wearer's gaze camera device 68 (refer to...) Figure 2 , Figure 3 The captured image data of the wearer's gaze is displayed as a moving image on at least a portion of the display unit 63 of the non-transmissive HMD 60 (step S10).

[0235] Furthermore, during the answering period, the donning / wearing status data output from the donning / wearing detection device 66 of the non-transmissive head-mounted display 60 will also be sent to the examination management server 20 via the network 1 (step S11).

[0236] In the examination management server 20, the don-wear status data receiving unit 26 receives the don-wear status data sent from the non-transparent HMD 60 via the network 1, and stores the received don-wear status data of the answering period in the answering storage unit 41 in association with the examination ID, examinee ID, and question ID (step S12).

[0237] Furthermore, the improper conduct determination unit 32 uses the undressing status data of the question-setting period and the undressing status data of the answer-setting period stored in the answer storage unit 41 (that is, since the answer-setting period has begun, the undressing status data of the previous question-setting period is also used) to determine whether the undressing status is appropriate relative to the question category of the given questions (whether it is necessary to make a judgment to draw attention). If the condition is met, the information that there may be improper conduct is transmitted to the monitoring unit 33. The monitoring unit 33 receives the transmission and makes a judgment to draw attention on the monitor terminal 80 (step S12).

[0238] Furthermore, the light-emitting management unit 31 determines whether to activate the light-emitting part 67 (see reference) of the non-transmissive HMD 60. Figure 2 , Figure 3 The light-emitting part 67 emits light (at any arbitrary time interval). When the light-emitting part 67 emits light, a light emission instruction is sent to the examinee terminal 50 via network 1 (step S13). In the examinee terminal 50, the non-transmissive HMD 60 receives the light emission instruction via the main body 50A or directly, and emits light from the light-emitting part 67. The image data of the person captured by the person-facing camera device 53 at the time of the light emission is sent to the examination management server 20 via network 1 as light emission confirmation image data (step S14). In the examination management server 20, the light emission management unit 31 receives the light emission confirmation image data sent via network 1, confirms whether the received light emission confirmation image data has captured the light emission of the light-emitting part 67, and stores the light emission confirmation result data in association with the examinee ID and the examination ID in the light emission confirmation result storage unit 45 (step S13). The details of these processing contents have been described in detail in the description of the light emission management unit 31, so detailed descriptions are omitted here. Furthermore, in steps S13 and S14, for ease of explanation, it is recorded that the light is emitted during the answering period. However, the light can be emitted during the question-setting period, the answering period, or even across both periods. In this embodiment, the light emission management is performed at a time other than the question-setting / answering period for each question.

[0239] Next, in the test-taker terminal 50, the test-taker inputs the answer to the question and sends the answer data to the examination management server 20 via network 1 (step S15). At this time, if the question requires an answer accompanied by actions, the test-taker answers the question while viewing the wearer's gaze image data captured on the display 63 of the non-transmissive HMD 60. In the examination management server 20, the answer data receiving unit 25 receives the test-taker's answer data sent from the test-taker terminal 50 via network 1 and stores the received answer data in the answer storage unit 41 in association with the examination ID, test-taker ID, and question ID (step S16). Details of these processing steps have been described in detail in the description of the answer data receiving unit 25, and therefore, detailed descriptions are omitted here.

[0240] Subsequently, in the examination management server 20, the evaluation unit 27 uses the answer data stored in the answer storage unit 41 and the correct answer data stored in the question storage unit 40 to evaluate the examinee's answer data (correctness judgment, scoring), and stores the evaluation result data in the answer storage unit 41 in association with the examination ID, examinee ID, and question ID (step S17). Details of these processes have been described in detail in the description of the evaluation unit 27, so detailed descriptions are omitted here.

[0241] Next, in the examination management server 20, the facial image acquisition determination unit 28 determines whether to acquire facial image data for a given period of time during the examination (i.e., facial image data different from facial image data before and after the examination) if the number of questions requiring the wearing of the non-transmissive head-mounted display 60 has been continuously determined for a predetermined number of questions or for a predetermined period of time, and determines that the wearing status data during the continuous period indicates wearing data. If the acquisition is successful, the non-transmissive HMD 60 removal instruction is sent to the examinee terminal 50 via the network 1 (step S18).

[0242] In the examinee terminal 50, a removal instruction from the non-transparent HMD 60 is received and displayed on the display unit 63 (step S19). The removal instruction can also be given via audio output. Then, after the examinee removes the non-transparent HMD 60 according to the removal instruction, a person image data containing their face is captured by the person image device 53, and the captured person image data is sent to the examination management server 20 via the network 1 (step S20). In the examination management server 20, the facial image acquisition unit 22 receives the person image data sent from the examinee terminal 50 via the network 1, acquires facial image data by detecting and cropping portions of the face from the received person image data, and stores the acquired facial image data in the examinee information storage unit 43 in association with the examinee ID and examination ID. Furthermore, the facial feature extraction unit 23 extracts facial features from the facial image data and stores the extracted facial features in the examinee information storage unit 43 in association with the examinee ID and examination ID (step S21). This process is the same as the process described in step S4 above.

[0243] Then, it is determined whether to proceed to the next question (step S22). If the next question is to be entered, the process returns to the aforementioned step S5, and then steps S5 to S22 are repeated until it is determined that the next question should not be entered. On the other hand, if the next question is not to be entered, the exam ends.

[0244] After the exam, the examinee, having removed the non-transparent HMD 60, takes a picture of their face using the portrait camera device 53 and sends the captured image data to the exam management server 20 via network 1 (step S23). In the exam management server 20, the facial image acquisition unit 22 receives the image data sent from the examinee's terminal 50 via network 1, acquires facial image data by detecting and cropping the face portion from the received image data, and stores the acquired facial image data in the examinee information storage unit 43 in association with the examinee's ID and exam ID. Furthermore, the facial feature extraction unit 23 extracts facial features from the facial image data and stores the extracted facial features in the examinee information storage unit 43 in association with the examinee's ID and exam ID (step S24). This process is the same as the processes described in steps S4 and S21 above.

[0245] Next, in the examination management server 20, the score calculation unit 29 uses the evaluation result data stored in the answer storage unit 41 to calculate the scores of each examinee, and determines whether to issue a certification 300 (refer to...). Figure 7The judgment result is stored in the score storage unit 42 as score data, associated with the exam ID, examinee ID, and certification certificate ID (which is the certification number, but no number is assigned if a certification certificate is not issued). Alternatively, in the case of an exam where a certification certificate is issued even if the score is poor, the certification level and total score to be recorded on the certification certificate are stored in the score storage unit 42 as score data, associated with the exam ID, examinee ID, and certification certificate ID (step S25). Alternatively, the improper conduct judgment unit 32 may also be used to determine whether improper conduct has occurred. If improper conduct is determined, the score calculation unit 29 is not processed.

[0246] Subsequently, the certification production unit 30 uses the examination name, examination date, accrediting organization, and certification certificate format stored in the examination information storage unit 44, which are associated with the examination ID of the examinee, as well as the score data of each examinee stored in the score storage unit 42, to produce electronic or paper certification certificates 300 to be issued to each examinee (see reference). Figure 7 (Step S26).

[0247] <Effects of this implementation method>

[0248] According to this embodiment, the following effects exist: Since the test questions are displayed using a non-transmissive head-mounted display 60 in the examination system 10, no one other than the test taker can see the questions. Furthermore, since the test taker wears a non-transmissive HMD 60, an environment that makes it difficult for improper behavior, such as secretly looking in a dictionary, can be created.

[0249] Furthermore, since the improper conduct determination unit 32 uses the dismount / wearing status data detected by the dismount / wearing detection device 66 of the non-transparent head-mounted display 60 to determine whether the dismount / wearing status is appropriate relative to the question category of the given test questions, it can, for example, capture situations such as answering questions that require wearing the non-transparent HMD 60 without wearing it, or failing to wear the non-transparent HMD 60 when it should be worn to view the test questions. Therefore, it is possible to conduct the examination while preventing improper conduct.

[0250] Furthermore, since the examination system 10 has a monitoring unit 33 and a monitor terminal 80, it is possible to display attention-grabbing information on the monitor terminal 80 (see reference). Figure 6 Therefore, it enables monitors who are focusing on monitoring multiple candidates to identify candidates who may be engaging in misconduct, thus reducing the monitors' workload and improving monitoring efficiency.

[0251] Furthermore, since the examination system 10 possesses a facial image acquisition unit 22, a facial feature extraction unit 23, an improper behavior determination unit 32, and a certificate production unit 30, it can extract facial features from multiple facial image data separately, determine whether all facial features are identical or largely identical, and if all are identical or largely identical, adopt the facial image data that most clearly represents the examinee's face from among the multiple facial image data as the certificate 300 (see reference). Figure 7 The facial photograph 310 is published on the certificate. Therefore, it is possible to determine whether someone impersonated another person during the examination, thereby detecting misconduct, and to obtain an appropriate facial photograph 310 for publication on the certificate 300.

[0252] Furthermore, since the examination system 10 has a facial image acquisition determination unit 28, it can issue a removal instruction for the non-transmissive head-mounted display 60. Therefore, even in situations where the test questions requiring the non-transmissive HMD 60 are continuous, making it difficult to obtain facial image data during the test, the necessary facial image data can still be obtained for inappropriate behavior detection. Moreover, the removal instruction for the non-transmissive HMD 60 is sent at arbitrary timings by the facial image acquisition determination unit 28 under certain conditions, making it unpredictable on the examinee's terminal 50 side. Therefore, an environment can be created where, for example, the examinee cannot detect when the removal instruction is issued and is relayed from the assistant to the examinee, making it difficult to engage in inappropriate behavior.

[0253] Furthermore, since the non-transparent HMD 60 in the examination system 10 is equipped with a wearer's gaze camera 68, if a question requires answers involving actions, the wearer's gaze image captured by the wearer's gaze camera 68 can be displayed on the display unit 63 of the non-transparent HMD 60 and also on the monitor terminal 80. Therefore, when given a question requiring answers involving actions, even while wearing the non-transparent HMD 60, the examinee can answer the question while visually observing the movements of their hands or fingers. Additionally, since the wearer's gaze image is displayed on the non-transparent HMD 60, although the examinee can see the exterior of the non-transparent HMD 60, creating an environment conducive to improper behavior, the display of the wearer's gaze image data on the monitor terminal 80 prevents improper behavior from occurring.

[0254] Furthermore, when the wearer's gaze image data captured by the wearer's gaze camera device 68, as described above, is displayed on the display unit 63 of the non-transmissive HMD 60, the evaluation unit 27 can perform character reading processing on the wearer's gaze image data to evaluate the answer (correctness judgment, scoring, etc.) when the examinee provides answers in written form. Therefore, the evaluation can be automated.

[0255] Furthermore, since the examination system 10 includes a wearer's gaze camera 68 on the non-transparent HMD 60, for questions that allow note-taking, the wearer's gaze image data can be displayed on the display unit 63 of the non-transparent HMD 60, allowing the examinee to take written notes. The wearer's gaze image data can also be displayed on the monitor terminal 80. Therefore, even while wearing the non-transparent HMD 60, the examinee can perform actions such as: taking notes on the main points or keywords of long questions during the question-setting period, and performing written calculations or thinking during the answering period. Additionally, since the wearer's gaze image data is displayed on the display unit 63 of the non-transparent HMD 60, although the examinee can see the exterior of the non-transparent HMD 60, creating an environment conducive to improper behavior, the display of the wearer's gaze image data on the monitor terminal 80 prevents improper behavior from occurring.

[0256] Furthermore, since the examination system 10 has a light-emitting management unit 41 and a light-emitting part 67 is provided on the non-transmissive head-mounted display 60, it can detect the following improper behaviors: an assistant (someone other than the examinee) wearing the non-transmissive HMD 60 that the examinee should wear and viewing the questions displayed on the display 63 to answer them; that is, the assistant viewing questions that only the examinee should be able to see; on the other hand, the examinee wearing a non-transmissive HMD with the same or similar shape (another non-transmissive HMD that does not display questions) to pretend to take the exam; or improper behaviors such as placing a photo of the examinee wearing the non-transmissive HMD 60 beforehand. Therefore, improper behaviors can be prevented before they occur. In addition, the light emission of the light-emitting part 67 occurs at arbitrary timings, making it impossible to predict on the examinee's terminal 50 side. Therefore, it is difficult to restore the normal state just before the light emission, creating an environment where improper behaviors are difficult to perform.

[0257] <Deformation Method>

[0258] Furthermore, the present invention is not limited to the embodiments described above, and variations and the like that within the scope of achieving the purpose of the present invention are also included in the present invention.

[0259] <The test taker terminal 50 is only the structure of a non-transparent HMD 60, and the display unit 63 is formed by assembling a smartphone into the main body 60A of the non-transparent HMD 60.>

[0260] For example, in the described embodiment, the test taker terminal 50 is configured to include a main body 50A composed of a computer and a non-transparent HMD 60. However, the test taker terminal may also be configured solely of the non-transparent HMD 60 without using the main body 50A composed of a computer. Furthermore, in the case where the test taker terminal is configured solely of the non-transparent HMD 60 and without using the main body 50A composed of a computer, the following structure can be adopted: a smartphone is attached to the main body 60A of the non-transparent HMD 60 to form a display unit 63. With these structures, there is no longer a person-viewing device 53 for externally photographing the test taker wearing the non-transparent HMD 60, so the monitor at the monitor terminal 80 cannot monitor the test taker. Additionally, it is no longer possible to acquire image data for confirming the emission of the light-emitting part 67 of the non-transparent HMD 60, but the wearing / unwearing status data can be used to prevent improper behavior.

[0261] <Structure utilizing camera devices installed in portable devices such as smartphones and tablets>

[0262] Furthermore, in the described embodiment, the human imaging device 53, the auxiliary imaging device 54, and the main body 50A of the test taker terminal 50 are connected (see reference). Figure 1 However, these portrait imaging devices 53 and auxiliary imaging devices 54 can also be constructed using camera devices (cameras) installed in portable devices such as smartphones and tablets. In this case, the image data captured by the portable device can be sent from the portable device to the examination management server 20 via the main body 50A, or it can be sent directly from the portable device to the examination management server 20 without going through the main body 50A. Furthermore, the main body 50A can also be constructed using portable devices such as smartphones and tablets. Therefore, in this case, the test questions can be displayed on the screen of the first portable device (e.g., a tablet), while the camera devices (cameras) of the second, third, ... portable devices (e.g., smartphones, other tablets) capture images of the examinee's face or hands.

[0263] The structure of advertising and selling study materials that aid in exam preparation, and utilizing data on material buyers (exam takers): Figure 8 >

[0264] In addition, such as Figure 8As shown, the implementation can also be structured as follows: advertising and selling teaching materials that aid in exam preparation, and utilizing data on the purchasers (exam takers) of the teaching materials. In this structure, although... Figure 8 The illustrations are omitted, but it can possess all the functions set in the described embodiment. Therefore, Figure 8 This description focuses on the additional functions added to the structure of the aforementioned embodiment. Specifically, the processing unit 20A of the examination management server 20 includes a textbook purchase acceptance unit 35, a textbook usage results statistics unit 36, an advertising data production unit 37, and an advertising posting unit 38. Furthermore, the examination management server 20 includes a textbook usage status storage unit 46, a textbook usage results storage unit 47, and an advertising data storage unit 48.

[0265] Textbook purchase acceptance unit 35 performs the following processing for example: the reason for acceptance is after the exam (as described in the implementation method) Figure 4 After processing in step S25, etc., the examinee who clicked on the textbook advertisement displayed on the display unit 63 of the non-transmissive head-mounted display 60 submits a textbook purchase application. The examinee's name and date of birth (address, phone number, etc., can also be used as personal information; this personal information is stored in the examinee information storage unit 43 in association with the examinee ID), the textbook ID of the purchased textbook, and the textbook purchase date are stored in the textbook usage status storage unit 46. Furthermore, each time the examinee actually uses the textbook, the textbook usage date and time are stored in the textbook usage status storage unit 46 in association with the examinee's name, date of birth, and textbook ID. The writing of the textbook usage date and time is performed by the learning system 120, which assists in learning using the textbook.

[0266] The textbook usage outcome statistics unit 36 ​​performs the following processing: It uses data stored in the textbook usage status storage unit 46, examination information storage unit 44, examinee information storage unit 43, and score storage unit 42 to statistically analyze the textbook usage outcomes of each examinee who used each textbook. The statistical results are then linked to personal information such as name and date of birth, as well as the textbook ID, and stored in the textbook usage outcome storage unit 47. Specifically, for example... Figure 8As shown at the bottom, similar exams are sometimes administered multiple times, such as the first time, the second time, and so on. Therefore, the following information is collected: how much did each examinee's score improve by using different teaching materials during the repeated administration of these similar exams? Furthermore, regarding exam IDs, even for similar exams, different exam IDs are assigned for the first and second exams. However, if the exams are of the same type, a portion of the exam IDs is common to identify them as similar exams, or a table (similar exam association storage unit) is prepared to associate the exam IDs of similar exams. Additionally, examinee IDs include exam numbers, etc., and usually, even for the same person, the examinee ID is different for each exam. Therefore, personal information such as name and date of birth, which is stored in the examinee information storage unit 43 in association with the examinee ID, is used to collect the score data of the same person in each exam they have taken.

[0267] Right now, Figure 8 The textbook usage date and time indicated by the △ mark at the bottom is stored as cumulative data in the textbook usage status storage unit 46. Therefore, the textbook usage results statistics unit 36 ​​first obtains these textbook usage dates and times (cumulative), determines the temporal relationship between them and the examination implementation dates (examination implementation dates associated with the examination IDs of similar examinations) stored in the examination information storage unit 44, and determines "the examination ID of the last examination (1) accepted during the period before the start of textbook use" and "the examination ID of the examination (2) accepted immediately after the last use of the textbook or the last examination (2) during the continuous use of the textbook." Figure 8 In the bottom statistical example A, the fourth exam belongs to "the last exam taken during the period before the start of textbook use (1)", and the sixth exam belongs to "the exam taken immediately after the last use of textbook (2)". In statistical example B, the fourth exam belongs to "the last exam taken during the period before the start of textbook use (1)", and the seventh exam belongs to "the last exam during the continuous use of textbook (2)".

[0268] Next, the textbook usage results statistics unit 36 ​​uses the exam IDs of exams (1) and (2) determined as described above, along with the personal information of the textbook user (name and date of birth, etc.) as the statistical object, to retrieve the examinee IDs of the textbook users corresponding to the exam IDs of exams (1) and (2) from the examinee information storage unit 43. Then, the textbook usage results statistics unit 36 ​​uses the exam IDs and examinee IDs to retrieve score data from the score storage unit 42, and stores the retrieved score data and exam IDs in association with the personal information of the textbook user (name and date of birth, etc.) as the statistical object, and the textbook ID in the textbook usage results storage unit 47. Furthermore, the textbook usage results statistics unit 36 ​​calculates the difference between the score data of exams (1) and (2) taken by the same person (textbook user) stored in the textbook usage results storage unit 47, that is, the change in the score data of exam (2) relative to the score data of exam (1), and stores the calculated change (provided that the change is positive) as textbook usage results data in the textbook usage results storage unit 47.

[0269] The advertising data production unit 37 performs the following processing: It statistically analyzes the textbook usage results data of each textbook user stored in the textbook usage results storage unit 47, calculates various indicator values ​​such as the average, median, mode, and maximum scores, and uses these calculated indicator values ​​to produce advertising data for each textbook. The produced advertising data is then stored in the advertising data storage unit 48 in association with the exam ID (the exam ID of the next exam in the same category), textbook ID, textbook category, and the score data of the target audience for the advertisement. Textbook categories include, for example, textbooks for Chinese language learning, textbooks for English language learning, law-related textbooks for the bar exam, and textbooks related to electrical technology. The exam content (e.g., Chinese language exam, bar exam, etc.) is determined by the exam ID, thus determining the textbook category corresponding to the exam ID. The segmentation of target audience's performance data in the advertisement, when the advertisement is published after the exam, indicates information about the recommended textbook for test takers at different performance levels, such as those with poor scores, average scores, and high scores. For example, it might indicate segmentation such as "less than 10 points," "10 points or more but less than 30 points," "30 points or more but less than 69 points," or "70 points or more." The advertisement data created here is intended for use in the next exam (e.g., advertisement data published after the next exam), and the advertisement data stored in the advertisement data storage unit 48 is constantly updated. Specifically, for example, if the average score increase for each textbook user using textbook α is statistically analyzed, and the average score increase is 5 points, then advertisement data such as "Those who used textbook <Textbook α> edited by Professor Y of Space University saw an average score increase of 5 points. The usage fee is XXX yen / month" is created (see reference). Figure 8 ).

[0270] The advertising placement unit 38 performs the following processing, for example: After the exam, using the exam ID and the examinee's score data in the exam, it retrieves the advertising data of each textbook (advertising data of textbooks suitable for recommending to the examinee) from the advertising data storage unit 48, which is associated with the score data of the target audience for the advertisements corresponding to the examinee's score data. The retrieved advertising data is then placed, for example, on the score display screen 400 after the exam (see reference). Figure 8 For example, such as Figure 8As shown, the score display screen 400 includes a score display unit 410 and multiple (or one) advertising display units 420. The advertising placement unit 38 displays advertisements on the advertising display units 420 using advertising data obtained from the advertising data storage unit 48. Then, when a test taker who has seen an advertisement on the advertising display unit 420 clicks on the advertising display unit 420 for a particular textbook, the textbook purchase processing unit 35 is executed as described previously. Furthermore, this advertising display can be performed not only on the display unit 63 of the non-transmissive head-mounted display 60, but also during examinations that do not use the non-transmissive HMD 60.

[0271] A structure where the person providing the exam questions (the practitioner) and the person conducting the exam properly (the practitioner) through monitoring, etc., are not the same: Figure 9 >

[0272] Furthermore, in the described embodiment, the person providing the exam questions (practitioner) is the same as the person conducting monitoring or other procedures to properly administer the exam (practitioner), but these individuals (practitioners) do not necessarily have to be the same. For example, Figure 9 The examination system 500 shown is operated and managed by multiple people (practitioners). The examination system 500 includes a first examination management server 510 operated and managed by a first administrator (e.g., a practitioner administering various examinations) and a second examination management server 520 operated and managed by a second administrator (e.g., a practitioner who creates, generates, receives, and evaluates examination questions). The first examination management server 510 and the second examination management server 520 each consist of one or more computers.

[0273] With this structure, a business model can be adopted, for example, as follows: Multiple (numerous) second managers provide exam questions, etc., and these multiple second managers, under the operation and management of a first manager (of a company) who oversees the exam implementation, conduct exams based on prepared questions. Furthermore, the relationship between the first and second managers is not limited to this one-to-many relationship; it can also be many-to-many or many-to-one. In the many-to-one scenario, a business model can be adopted, for example, as follows: A second manager of a company creates and provides exam questions in both Chinese and English, and exams based on these questions are conducted under the operation and management of different first managers.

[0274] The processing unit 510A of the first examination management server 510 is consistent with the embodiment described above. Figure 1Similarly, it includes a pre-registration acceptance unit 21, a facial image acquisition unit 22, a facial feature extraction unit 23, a donning / wearing status data receiving unit 26, a facial image acquisition determination unit 28, a score calculation unit 29, a certificate production unit 30, a light emission management unit 31, an improper behavior determination unit 32, a monitoring unit 33, and a personal confirmation unit 34, and is consistent with the above. Figure 8 Similarly, it includes a textbook purchase acceptance unit 35, a textbook usage results statistics unit 36, an advertising data production unit 37, and an advertising posting unit 38. Additionally, the first examination management server 510 is consistent with the implementation method described above. Figure 1 Similarly, it includes a score storage unit 42, an examinee information storage unit 43, an examination information storage unit 44, and a light-emitting confirmation result storage unit 45, and is consistent with the above. Figure 8 Similarly, it has a textbook usage status storage unit 46, a textbook usage results storage unit 47, and an advertising data storage unit 48.

[0275] Furthermore, the first examination management server 510 has a don / wear status storage unit 540, but this is part of the solution storage unit 41 in the aforementioned embodiment. Therefore, the solution storage unit 41 in the aforementioned embodiment also serves as a don / wear status storage unit. Specifically, as... Figure 9 As shown, the don / wear status storage unit 540 stores the exam ID, examinee ID, question ID, don / wear status data during the question-setting period (a combination of information indicating the difference between wearing / not wearing) and don / wear status data during the answering period (a combination of information indicating the difference between wearing / not wearing) in association.

[0276] The monitor terminal 80, the self-verification requester terminal 110, and the first administrator terminal 530 (operated by the first administrator, such as a practitioner conducting various examinations including monitoring) are connected to the first examination management server 510 via network 1. The first administrator terminal 530 is functionally compatible with the described embodiment. Figure 1 It is obtained by segmenting the administrator terminal 100.

[0277] The processing unit 520A of the second examination management server 520 is consistent with the embodiment described above. Figure 1 Similarly, it includes a test question data sending unit 24, a solution data receiving unit 25, and an evaluation unit 27. Additionally, the second examination management server 520 is consistent with the implementation described above. Figure 1 Similarly, it includes a question storage unit 40. Furthermore, the second examination management server 520 includes a solution storage unit 541, but this is the solution storage unit 41 of the described embodiment (see reference). Figure 4 Part of ). Specifically, such as Figure 9 As shown, the solution storage unit 541 stores the exam ID, examinee ID, question ID, solution data, and evaluation result data in a related manner.

[0278] Additionally, the evaluator terminal 90 and the second administrator terminal 531, operated by the second administrator (e.g., a professional who creates, generates, and evaluates exam questions), are connected to the second exam management server 520 via network 1. The second administrator terminal 531 is functionally compatible with the aforementioned embodiment. Figure 1 It is obtained by segmenting the administrator terminal 100.

[0279] In setting as Figure 9 In that structure, the processing of sending and receiving test data (as described in the embodiment) Figure 4 The processing of steps S5 and S6) and the transmission of the image to the wearer's gaze-based camera device 68 (refer to the embodiment described above) Figure 2 , Figure 3 The processing of sending and receiving switching instructions for the display mode switching used in the action answer (as described in the embodiment) Figure 4 Steps S9 and S10 involve processing data from the second examination management server 520 to the examinee's terminal 50. Additionally, the processing of sending and receiving answer data (as described in the embodiment) Figure 4 Steps S15 and S16 involve processing data from the examinee's terminal 50 to the second examination management server 520. Furthermore, the processing of answer evaluation (correctness determination, scoring) (as described in the embodiment) is also included. Figure 4 Step S17 is executed by the second exam management server 520.

[0280] On the other hand, the processing of sending and receiving pre-registered data (as described in the embodiment) Figure 4 The processing of steps S1 and S2), and the processing of sending and receiving person image data (as described in the embodiment). Figure 4 The processing of steps S3, S4 and S23, S24), and the processing of sending and receiving data on the wearing / unwearing status (in the embodiments described). Figure 4 The processing in steps S7, S8, and S11, S12 is the processing from the examinee terminal 50 to the first examination management server 510. Additionally, the light-emitting part 67 for the non-transmissive HMD 60 (refer to the embodiment described above) Figure 2 , Figure 3 The processing of sending and receiving image data for illumination management, illumination indication, and illumination confirmation (as described in the embodiment) Figure 4Steps S13 and S14 involve processing between the first examination management server 510 and the examinee's terminal 50. Furthermore, the processing of transmitting and receiving the removal instruction of the non-transmissive HMD 60 and the accompanying transmission and reception of the person's image data (as described in the embodiment) Figure 4 The processing steps S18 to S21 are also the processing between the first examination management server 510 and the examinee terminal 50. Furthermore, the score calculation processing (as described in the embodiment) Figure 4 Step S25 processing), advertisement posting processing (refer to...) Figure 8 ), and the production and processing of certification certificates (the implementation method described above) Figure 4 Step S26 is executed by the first examination management server 510. Furthermore, in the score calculation process, the evaluation result data stored in the answer storage unit 541 of the second examination management server 520 is used; therefore, the score calculation unit 29 of the first examination management server 510 obtains the evaluation result data from the second examination management server 520 via network 1.

[0281] Additionally, when set as follows Figure 9 In that structure, the display section 63 of the non-transmissive head-mounted display 60 (see reference) Figure 2 , Figure 3 The screen displayed on the candidate's terminal 50 (or on the display unit 51 of the candidate's terminal 50, except for a display unit other than a transmissive HMD 60) when the candidate does not need to wear a non-transmissive HMD 60 for the exam or test questions, displays an administrative screen sent from the first exam management server 510 and a test question presentation screen sent from the second exam management server 520. At this time, the administrative screen sent from the first exam management server 510 can be used as the outer frame and the test question presentation screen sent from the second exam management server 520 can be displayed within that frame, or the administrative screen and the test question presentation screen can be switched on and off. In the latter case, for example, it is sufficient to make the screen to be switched on contain the information (URL, etc.) of the screen that was just switched on. Furthermore, for example, the screen display processing and its additional processing in the examinee terminal 50 can be performed either by a program (e.g., JavaScript (ECMAScript): JavaScript is a registered trademark) provided from the first examination management server 510 or the second examination management server 520 and included in a web browser and web page, or by installing a dedicated program with browsing capabilities on the examinee terminal 50 (the main body 50A of the examinee terminal 50 or the main body 60A of the non-transparent HMD 60) to perform the screen display processing and its additional processing in the examinee terminal 50.

[0282] <The structure of recording electronic certification certificates in a distributed ledger>

[0283] Furthermore, in the described embodiment, the certificate creation unit 30 is as follows: Figure 7 The system is configured as shown to issue a certification certificate 300 that includes (optionally) a facial photograph 310 and two-dimensional barcodes 321-325. However, it is also possible that, according to the examinee's wishes, after issuing the electronic certification certificate, the electronic certification certificate is linked to the examinee's ID or other identification information for safekeeping and recorded in a distributed ledger (e.g., a blockchain), thereby being stored in a state where the data is difficult to alter. When the examinee needs it (when there is an examinee's request to obtain it), the examinee's electronic certification certificate is retrieved from the distributed ledger using the examinee's ID and other identification information and sent to the examinee's terminal 50 (which may also be a different terminal than the one used during the examination). In this case, the registration of the electronic certification certificate on the distributed ledger and the retrieval from the distributed ledger can be performed either by accessing the structure node of the distributed ledger (blockchain, etc.) (any computer among multiple computers connected on a peer-to-peer network used to form the distributed ledger) from the examination management server 20, or the examination management server 20 itself can be a structure node.

[0284]

[0285] Then, if the exam management server 20 can access the distributed ledger (blockchain, etc.) structure node as described above, or if the exam management server 20 itself is a structure node, the exam management server 20 can also be a structure for processing virtual currency for examinees. Specifically, the following service can be provided: if the score data calculated by the score calculation unit 29 and stored in the score storage unit 42 is good (above a predetermined threshold), or if the usage time of the exam system 10 is long (above a predetermined threshold), virtual currency can be granted to the examinee. At this time, the threshold can also be set in stages, and the amount of virtual currency granted can be increased or decreased according to the score or the length of usage time. That is, the better the score or the longer the usage time, the more virtual currency can be granted. Alternatively, if the score is good or the usage time is long, points that can be used as purchase money for teaching materials or points that can be used as purchase or rental money for the non-transmissive head-mounted display 60 can be granted to the examinee instead of virtual currency. More specifically, the examinee assistance unit (not shown) located on the exam management server 20 performs the calculation for assigning virtual currency or points to each examinee, records the assigned virtual currency in the examinee's account (e.g., an Ethereum address) in a distributed ledger (blockchain, etc.), and stores the assigned points in the points storage unit (not shown) located on the exam management server 20. Furthermore, if the examinee's bank account information and credit card information are stored in the examinee information storage unit 43, the assignment of virtual currency can be replaced by the deposit of real currency. This deposit processing is also performed by the examinee assistance unit (not shown).

[0286] <A structure that uses wear / unwearing status data to estimate usage time for assigning virtual currency, points, and real-world currency>

[0287] Furthermore, when virtual currency, points, and real currency are assigned in accordance with usage time as described above, the usage time can be estimated using the undressing status data stored in the answer storage unit 41. Specifically, the test taker assistance unit (not shown) may take the undressing status data obtained at certain time intervals as a premise, and estimate the duration based on the quantity of undressing status data obtained, or may assign virtual currency, points, and real currency based on the quantity of undressing status data obtained. At this time, the improper conduct determination unit 32 performs processing to determine whether the undressing status is appropriate relative to the question category of the given test questions, using the undressing status data received by the undressing status data receiving unit 26 and stored in the answer storage unit 41 during the question-setting period and the answer-setting period. Therefore, the test taker assistance unit (not shown) may only count the cases where the undressing status is judged to be appropriate by the improper conduct determination unit 32, and set this as the quantity of undressing status data (the quantity itself or the duration estimated based on the quantity). That is, it is also possible to not use the data on the wearing and removing of the mask obtained under circumstances where there may be improper behavior, and not to count it.

[0288] <Using human image data to detect the structure of unnatural movements in test takers during the processing of test items that do not require wearing a non-transparent HMD 60>

[0289] Furthermore, in the aforementioned embodiment, when processing test questions requiring the wearing of a non-transmissive head-mounted display 60, the improper behavior determination unit 32 uses the detachment status data received by the detachment status data receiving unit 26 and stored in the answer storage unit 41 to determine whether improper behavior may exist. Information indicating the potential for improper behavior (e.g., information suggesting a monitoring level requiring attention using red or yellow frames) is transmitted to the monitoring unit 33. In processing test questions not requiring the wearing of the non-transmissive head-mounted display 60, for example, the monitoring unit 33 in this embodiment can perform the following processing: receiving image data containing the examinee's face captured by the person-facing camera device 53 installed on the examinee's terminal 50 and transmitted via the network 1, such as... Figure 6The process involves displaying the received image data of a person as a moving image on the monitoring screen 200 of the display unit 81 of the monitor terminal 80, as shown. However, at this time, the monitoring unit 33 may also pass the received image data of a person to the misconduct determination unit 32. Alternatively, the misconduct determination unit 32 may use the received image data of a person to detect unnatural movements of the examinee (e.g., movements that may indicate cheating, such as frequently turning the face to the side or frequently turning the gaze to the side). If such movements are detected, the monitoring unit 32 may transmit information indicating that misconduct may exist (e.g., information indicating that the monitoring level needs to be displayed with a red or yellow box to attract attention) to the monitoring unit 33.

[0290] <A structure for calculating individuality using facial feature scores, voiceprint scores, etc.>

[0291] Furthermore, in the aforementioned embodiment, the configuration is as follows: the misconduct determination unit 32 performs a judgment on whether all facial features extracted by the facial feature extraction unit 23 and stored in the examinee information storage unit 43 are completely identical or substantially identical; if they are not completely identical or substantially identical, it is determined that misconduct has occurred. Additionally, the certificate production unit 30 performs a process where, if the misconduct determination unit 32 determines that all facial features are completely identical or substantially identical, the facial image data that most clearly represents the examinee's face from the multiple facial image data is used as the certificate 300 (see reference). Figure 7 The processing of facial photos published online can also be configured as follows: the improper behavior determination unit and the certificate production unit of the present invention use facial feature quantity scores, voiceprint scores, etc. to calculate the personal score, and decide whether to issue a certificate based on the personal score 300.

[0292] That is, in the case of this structure (hereinafter referred to as "the structure for calculating the individual's degree using facial feature scores, voiceprint scores, etc."), the facial image acquisition unit performs the following processing: at the start of the exam, and during the exam when the data of the unworn state becomes data indicating non-wearing, or at the end of the exam in addition to the start of the exam and the exam period, facial image data is acquired from the person image data containing the examinee's face captured by the person camera device 53 set on the examinee terminal 50 and transmitted via the network 1.

[0293] More specifically, at the start of the examination, the facial image acquisition unit will extract facial image data from the person image data as the data to be included in the certification certificate 300 (see reference) produced by the certification certificate production unit. Figure 7The facial image data used in the facial photograph is stored in the examinee information storage unit 43 in association with the examinee ID and the examination ID. Therefore, in the above embodiment, the facial image data that most clearly represents the examinee's face among the multiple facial image data acquired by the facial image acquisition unit 22, that is, one facial image data among the multiple facial image data, is used as the certificate of qualification 300 (see reference). Figure 7 The facial photographs 310 published on the website, however, in cases where facial feature scores, voiceprint scores, etc., are used to calculate the individual's identity, this applies at the start of the exam (as already described in detail, including the period before the exam begins). Figure 4 In the example, the facial image data obtained at the time points of steps S3 and S4 must be the facial image data used for the facial photograph 310 published on the certification 300. Therefore, it is necessary to obtain the facial image data at the start of the exam (including before the start of the exam).

[0294] Furthermore, during the examination period, or even after the examination (as detailed below, including after the examination), the facial image acquisition unit will only store the facial image data obtained from the person image data in the examinee information storage unit 43 as facial image data for determining improper conduct, associated with the examinee ID and examination ID, if the facial feature quantity score calculated by the facial feature quantity extraction unit is less than or below a predetermined threshold (in the case of low facial feature quantity similarity).

[0295] If there are more cases with low facial feature scores (low similarity of facial features), as in the former case, then the average facial feature score will decrease, leading to a decrease in the individuality described later, and thus, the reason for not issuing a certificate (refer to 300). Figure 7 In such cases, if the examinee claims not to have engaged in inappropriate behavior, the facial image data stored in the examinee information storage unit 43 is used to determine whether inappropriate behavior has occurred based on human judgment. On the other hand, in cases where the facial feature score is high (high similarity of facial features), the facial image data is not stored in the examinee information storage unit 43, thereby reducing the amount of data to be stored.

[0296] The facial feature extraction unit performs the process of extracting facial features from the multiple facial image data obtained by the facial image acquisition unit described above.

[0297] Specifically, the facial feature extraction unit performs the following processing: at the start of the exam (including before the exam begins), facial features are extracted from the facial image data acquired by the facial image acquisition unit described above. The extracted facial features are used as reference data for personal score calculation and stored in the examinee information storage unit 43 in association with the examinee ID and exam ID. Furthermore, during the exam period, or at the end of the exam (including after the exam ends), facial features are extracted from the facial image data acquired by the facial image acquisition unit described above. The extracted facial features are used as reference data for personal score calculation and stored in the examinee information storage unit 43 in association with the examinee ID and exam ID. A facial feature score is calculated, which represents the similarity between the facial features used as reference data for personal score calculation and the facial features stored in the examinee information storage unit 43 as reference data for personal score calculation. The facial feature score calculated here can be stored in the examinee information storage unit 43 along with the facial feature score used as the reference data for calculating the examinee's score, and associated with the examinee ID and the examination ID. Alternatively, the misconduct determination unit may choose not to store it, provided that it will be recalculated.

[0298] The pre-registration acceptance unit is the same as the pre-registration acceptance unit 21 in the described embodiment, and therefore is marked with the same labels. The pre-registration acceptance unit 21 performs the following processing: at the start of the exam (including before the start of the exam). Figure 4 In the example, at the time points of steps S1 and S2, voice data for voiceprint extraction is received from the microphone 55 of the test taker terminal 50 or the microphone 70 of the non-transmissive head-mounted display 60 and transmitted via network 1. The received voice data is used to perform voiceprint analysis, and the obtained voiceprint data is used as the reference data for calculating the individual's identity and stored in the test taker information storage unit 43 in association with the test taker ID and the test ID. At this time, the voiceprint analysis method can use existing methods, which can be either a text-dependent method that uses voice data obtained by speaking fixed content or a text-independent method that uses voice data of non-fixed speech.

[0299] In addition, the pre-registration acceptance unit 21 performs the following processing: at the start of the exam (including before the start of the exam). Figure 4 In the example, at the time points of steps S1 and S2, iris data is received from the person camera device 53 or auxiliary camera device 54 set on the candidate terminal 50, or the inner direction camera device 69 of the non-transmissive HMD 60 and sent via network 1. The received iris data is used as the reference data for calculating the candidate's identity and is stored in the candidate information storage unit 43 in association with the candidate ID and the examination ID.

[0300] Furthermore, the pre-registration acceptance unit 21 performs the following processing: at the start of the exam (including before the start of the exam). Figure 4 In the example, at the time points of steps S1 and S2, fingerprint data is received from the fingerprint reading device 57 installed on the test taker terminal 50 and sent via the network 1. The received fingerprint data is used as the reference data for calculating the test taker's identity and is stored in the test taker information storage unit 43 in association with the test taker ID and the test ID.

[0301] In addition, the pre-registration acceptance unit 21 performs the following processing: at the start of the exam (including before the start of the exam). Figure 4 In the example, at the time points of steps S1 and S2, according to the request from the examinee terminal 50, the display data of the pre-registered screen (e.g., web screen) is sent via network 1, and the personal information of the examinee, such as address, name, date of birth, interests, occupation, and student ID number, sent from the examinee terminal 50 via network 1 is received. The received personal information is used as the basis data for calculating the examinee's score and is associated with the automatically assigned examinee ID (exam number, etc.) and exam ID and stored in the examinee information storage unit 43.

[0302] Furthermore, in cases where facial feature scores, voiceprint scores, etc., are used to calculate the individual's score, unlike the implementation described above, a reference data acquisition unit is provided in the examination management server 20. This reference data acquisition unit performs the following processing: during the examination period, or at the end of the examination (including after the examination), it receives voice data for voiceprint extraction acquired by the microphone 55 of the examinee terminal 50 or the microphone 70 of the non-transmissive head-mounted display 60 and transmitted via the network 1; it performs voiceprint analysis using the received voice data; and it stores the obtained voiceprint data as reference data for calculating the individual's score, associated with the examinee ID and the examination ID, in the examinee information storage unit 43. At this time, the voiceprint analysis method can use existing methods, either a text-dependent method using voice data obtained by speaking fixed content, or a text-independent method using voice data of non-fixed utterances. The case of using spoken answer data is a text-independent method.

[0303] In addition, the data acquisition unit performs the following processing: during the examination period, or at the end of the examination (including after the examination), it receives iris data captured by the person-viewing device 53 or auxiliary camera device 54 installed on the examinee terminal 50, or the inner-side camera device 69 of the non-transmissive HMD 60 and transmitted via network 1, and stores the received iris data as reference data for personal identity calculation in the examinee information storage unit 43 in association with the examinee ID and examination ID.

[0304] Furthermore, the data acquisition unit performs the following processing: during the examination period, or at the end of the examination (including after the examination), it receives fingerprint data read by the fingerprint reader 57 installed on the examinee terminal 50 and sent via the network 1, and stores the received fingerprint data as reference data for personal identity calculation in the examinee information storage unit 43 in association with the examinee ID and the examination ID.

[0305] In addition, the comparison data acquisition unit performs the following processing: during the examination period, or at the end of the examination (including after the examination), it sends display data for the comparison screen (e.g., a web screen) to the examinee terminal 50 via network 1, and receives personal information such as the examinee's address, name, date of birth, interests, occupation, and student ID number sent from the examinee terminal 50 via network 1, and stores the received personal information as comparison data for personal score calculation in the examinee information storage unit 43 in association with the examinee ID and examination ID.

[0306] The misconduct determination unit performs the following processing: calculates multiple facial feature scores, multiple voiceprint scores, multiple iris scores, multiple fingerprint scores, and multiple personal information scores (e.g., multiple interest scores), averages them separately to calculate the average facial feature score, average voiceprint score, average iris score, average fingerprint score, and average personal information score (e.g., average interest score), and then integrates these average scores (simple average, weighted average, harmonic average, etc.) to calculate the identity score (a numerical value representing the degree to which the person resembles the individual). If the calculated identity score is low (below or less than a predetermined threshold), it is determined that misconduct has occurred.

[0307] Specifically, the misconduct determination unit uses the facial feature quantities of the control data used for identity verification calculation and the facial feature quantities of the benchmark data used for identity verification calculation stored in the examinee information storage unit 43 to calculate multiple facial feature quantity scores representing the similarity of these facial feature quantities (the degree of similarity between each control data and the benchmark data). Furthermore, if the facial feature quantity scores are calculated by the aforementioned facial feature quantity extraction unit and stored in the examinee information storage unit 43 along with the facial feature quantities (facial feature quantities of the control data used for identity verification calculation) and associated with the examinee ID and examination ID, multiple facial feature quantity scores can also be obtained from the examinee information storage unit 43. The facial feature quantity scores, i.e., the numerical values ​​representing the similarity of facial feature quantities, can be numerical values ​​used in existing facial authentication, representing the likelihood, probability, etc., of the possibility of the person being identified. Furthermore, the misconduct determination unit calculates an average facial feature quantity score obtained by averaging (which can be a simple average) the calculated or obtained multiple facial feature quantity scores.

[0308] Furthermore, the misconduct determination unit uses the voiceprint data stored in the examinee information storage unit 43—both as control data for calculating personality and as baseline data for calculating personality—to calculate multiple voiceprint scores representing the similarity of these voiceprint data (the degree to which each control data is similar to the baseline data). The voiceprint score, i.e., the numerical value representing the similarity of the voiceprint data, can be a value used in existing voiceprint authentication, representing the likelihood, probability, etc., of the person's identity. The misconduct determination unit then calculates an average voiceprint score by averaging the calculated multiple voiceprint scores (which can be a simple average).

[0309] Furthermore, the misconduct determination unit uses the iris data stored in the examinee information storage unit 43—both as control data for calculating identity and as baseline data for calculating identity—to calculate multiple iris scores representing the similarity of these iris data (the degree to which each control data is similar to the baseline data). The iris score, i.e., the numerical value representing the similarity of the iris data, can be a value used in existing iris authentication, representing the likelihood, probability, etc., of the person's identity. The misconduct determination unit then calculates an average iris score by averaging the calculated multiple iris scores (which can be a simple average).

[0310] Furthermore, the misconduct determination unit uses the fingerprint data stored in the examinee information storage unit 43—both as control data for calculating identity and as baseline data for calculating identity—to calculate multiple fingerprint scores representing the similarity of these fingerprint data (the degree to which each control data is similar to the baseline data). The fingerprint score, i.e., the numerical value representing the similarity of the fingerprint data, can be a value used in existing fingerprint authentication, representing the likelihood, probability, etc., of the person's identity. The misconduct determination unit then calculates an average fingerprint score by averaging the calculated multiple fingerprint scores (which can be a simple average).

[0311] Furthermore, the misconduct determination unit uses the personal information (e.g., interests) stored in the examinee information storage unit 43 as reference data for calculating personality, and the personal information (e.g., interests) of the benchmark data for calculating personality, to calculate multiple personal information scores (e.g., multiple interest scores) representing the similarity of these personal information (the degree to which each reference data is similar to the benchmark data). For example, when interests are entered through options, the unit checks whether the selected options are consistent. When interests are entered through text, piano playing is similar to instrument playing, so the interest score is higher. The misconduct determination unit also calculates an average personal information score (e.g., average interest score) by averaging the calculated multiple personal information scores (e.g., multiple interest scores) (which can be a simple average).

[0312] Then, the misconduct determination unit integrates the average scores of facial features, voiceprint, iris, fingerprint, and personal information (e.g., interest average scores) to calculate the personal score, and stores the calculated personal score in the examinee information storage unit 43 in association with the examinee ID and examination ID. At this time, integration can be performed, for example, using simple averaging, weighted averaging, or harmonic averaging. Furthermore, the misconduct determination unit performs the following process: comparing the calculated personal score with a predetermined threshold; if the calculated personal score is low (below or less than the threshold), it is determined that misconduct has occurred. In addition, average scores other than the "facial feature average score and voiceprint average score" are not required and may not be used in the integration.

[0313] The certification production unit performs the following processing: Produces 300 electronic or paper certification certificates for the examinees (refer to...). Figure 7 This is the same as the certification production unit 30 in the described embodiment.

[0314] On the other hand, the certificate production unit 30 of the aforementioned embodiment is configured to perform the following process: when the improper conduct determination unit 32 determines that all or approximately all of the multiple facial feature values ​​are identical, the facial image data that most clearly represents the examinee's face among the multiple facial image data acquired by the facial image acquisition unit 22 is adopted as the certificate 300 (see reference). Figure 7 The facial photograph 310 is published on [the website]. In contrast, if the determination of identity is based on facial feature scores, voiceprint scores, etc., and the identity score calculated by the misconduct determination unit is below or less than a predetermined threshold (in cases where misconduct is determined), the certificate issuance unit will not issue a certificate 300 (see [reference]). Figure 7 Additionally, if the degree of self-identity calculated by the misconduct determination unit exceeds or is above a predetermined threshold, a certificate of recognition 300 will be issued (see reference). Figure 7 At this time, the facial image data acquired by the facial image acquisition unit at the start of the exam (including before the start of the exam) will be used as the facial image data for the facial photograph 310 published on the certification certificate 300.

[0315]

[0316] In addition, in the above embodiment, the examination management server 20 is provided with a facial image acquisition determination unit 28. However, if the configuration is to calculate the identity of the examinee using facial feature scores, voiceprint scores, etc., it is preferable to also provide a voiceprint acquisition determination unit. This voiceprint acquisition determination unit performs the following processing: if a predetermined number of questions or a predetermined time period of questions other than those requiring verbal answers are asked consecutively, during the interval between questions, a voice instruction is sent to the examinee's terminal 50 via network 1 at an arbitrary time interval to obtain voice data for voiceprint extraction during the examination period.

[0317] Furthermore, the facial image acquisition unit 22 of the embodiment is configured to perform the following process: when the non-transmissive head-mounted display 60 is removed by the face image acquisition determination unit 28 to the testee terminal 50, and the removal state data is determined to be non-wearing data after the removal instruction, facial image data is acquired from the person image data sent from the testee terminal 50 via the network 1. Under roughly the same thinking, the data acquisition unit is preferably structured as follows.

[0318] That is, the reference data acquisition unit is preferably configured to perform the following processing: when the voiceprint acquisition determination unit sends a voice instruction to the test taker terminal 50, it receives the voiceprint extraction voice data sent from the test taker terminal 50 via the network 1, uses the received voice data to perform voiceprint analysis, and stores the obtained voiceprint data as reference data for personal score calculation in the test taker information storage unit 43 in association with the test taker ID and the test ID.

[0319] Industrial availability

[0320] As described above, the examination system and program of the present invention are suitable for use in various examinations, such as assessment examinations, certification examinations, qualification examinations, entrance examinations, job entrance examinations, graduation examinations, completion examinations, final examinations, promotion examinations, mock examinations, and daily learning effectiveness confirmation examinations, for assessing abilities and knowledge such as language ability, conversational ability, communication ability, skills, etc.

Claims

1. An examination system for administering examinations to remote examinees via a network, the examination system comprising computers, characterized in that, An examination management server is equipped with a network connection to candidate terminals operated by the candidates. The exam management server has the following features: The test data sending unit performs the following processing: sending test data for the examination to the examinee's terminal via a network, so as to display the test data for the examination on the display section of the non-transmissive head-mounted display worn by the examinee; The answer data receiving unit performs the following processing: receiving the answer data of the examinee sent from the examinee's terminal via the network; The data receiving unit for wearing / removing the device performs the following processing: receiving data on the wearing / removing status of the non-transmissive head-mounted display, detected by the wearing / removing detection device installed on the non-transmissive head-mounted display and sent from the testee's terminal via a network. as well as The improper behavior determination unit performs the following processing: using the undress status data during the question-setting period and the undress status data during the answering period received by the undress status data receiving unit, it determines whether the undress status is appropriate relative to the question category of the given test questions.

2. The examination system according to claim 1, characterized in that, The system includes a monitor terminal, which is connected to the examination management server to display information for monitors to oversee the examination. The examination management server also includes a monitoring unit, which performs the following processing: receiving facial image data of the examinee captured by a camera device installed on the examinee's terminal and transmitted via the network; and displaying the received facial image data as a moving image on the monitor's terminal. The improper behavior determination unit is configured to perform the following process: if it determines that in the process of testing questions requiring the wearing of the non-transmissive head-mounted display, the data on the wearing / unwearing status during the question-setting period indicates wearing data and the data on the wearing / unwearing status during the answer-answering period indicates not wearing data, it conveys information to the monitoring unit that improper behavior may exist. The monitoring unit is configured to receive a message from the misconduct determination unit and perform attention-grabbing display processing around or in the periphery of the candidate's image data displayed on the monitor terminal.

3. The examination system according to claim 1 or 2, characterized in that, The examination management server also has: The facial image acquisition unit performs the following processing: at the start and / or end of the exam, and during the exam when the de-wearing status data becomes data indicating non-wearing, it acquires facial image data from person image data containing the examinee's face captured by a person camera device set on the examinee's terminal and transmitted via the network. The facial feature extraction unit performs the following processing: extracting facial features from multiple facial image data acquired by the facial image acquisition unit; as well as The certification production unit performs the following processing: producing electronic or paper certification certificates for the examinees. The improper behavior determination unit is configured to further perform the following processing: determine whether all facial feature quantities extracted by the facial feature quantity extraction unit are consistent; if they are not all consistent, it is determined that improper behavior has been committed. The certificate production unit is configured to perform the following process: when the misconduct determination unit determines that all facial feature values ​​are identical, the facial image data that most clearly represents the examinee's face among the multiple facial image data is adopted as the facial photograph published on the certificate.

4. The examination system according to claim 1 or 2, characterized in that, The examination management server also has: The facial image acquisition unit performs the following processing: at the start and / or end of the exam, and during the exam when the de-wearing status data becomes data indicating non-wearing, it acquires facial image data from person image data containing the examinee's face captured by a person camera device set on the examinee's terminal and transmitted via the network. The facial feature extraction unit performs the following processing: extracting facial features from multiple facial image data acquired by the facial image acquisition unit; as well as The certification production unit performs the following processing: producing electronic or paper certification certificates for the examinees. The improper behavior determination unit is configured to further perform the following processing: determine whether all facial feature quantities extracted by the facial feature quantity extraction unit are approximately consistent; if they are not all approximately consistent, it is determined that improper behavior has been committed. The certificate production unit is configured to perform the following process: when the misconduct determination unit determines that all facial feature quantities are approximately the same, the facial image data that most clearly represents the examinee's face among the multiple facial image data is adopted as the facial photograph published on the certificate.

5. The examination system according to claim 3, characterized in that, The examination management server also includes a facial image acquisition determination unit. This unit performs the following processing: if a predetermined number of questions or a predetermined time period require the use of the non-transmissive head-mounted display, and the data indicating whether the display is worn during this continuous period is data indicating wearing, then at any given time, a removal instruction to remove the non-transmissive head-mounted display is sent to the examinee's terminal via the network to acquire facial image data for that specific time period during the examination. The facial image acquisition unit is configured to perform the following process: when the face image acquisition determination unit sends a removal instruction to the test subject terminal to remove the non-transmissive head-mounted display, and determines after the removal instruction that the removal status data is data indicating non-wearing, facial image data is acquired from the person image data sent from the test subject terminal via the network.

6. The examination system according to claim 2, characterized in that, The non-transmissive head-mounted display is equipped with a wearer's gaze camera, which is capable of capturing images of the space outside the non-transmissive head-mounted display according to the wearer's gaze. The test data transmission unit is configured to further perform the following processing: In the processing of test questions that require wearing the non-transmissive head-mounted display and require answering with actions, at the timing of the transition from the question-setting period to the answering period, a switching instruction to switch to a display mode for action-based answering is sent to the test taker's terminal via the network. In the display mode for action-based answering, at least a portion of the wearer's gaze image data captured by the wearer's gaze camera device is displayed as a moving image on the display section of the non-transmissive head-mounted display. The answer data receiving unit is configured to perform the following processing: receiving the wearer's gaze image data sent from the test taker's terminal via a network, and using it as the answer data. The monitoring unit is configured to also perform the following processing: simultaneously with or while displaying the person image data, displaying the wearer's gaze image data transmitted from the examinee's terminal via the network as a moving image on the monitor's terminal.

7. The examination system according to claim 6, characterized in that, The examination management server also includes an evaluation unit. For questions answered in written form, the evaluation unit uses the wearer's gaze image data, which is received by the answer data receiving unit as the answer data, and performs text reading processing.

8. The examination system according to claim 6, characterized in that, The examination management server also includes an evaluation unit. For questions answered by actions performed in real space using a physical testing tool, the evaluation unit uses the wearer's gaze image data, received by the answer data receiving unit, as the answer data, and performs pattern recognition processing. The evaluation unit is configured to perform the pattern recognition process using a pattern recognition model, which is obtained by learning through the wearer's gaze image data that is judged as the correct answer and the wearer's gaze image data that is judged as the incorrect answer, as well as the labels of the correct and incorrect answers.

9. The examination system according to claim 2, characterized in that, The non-transmissive head-mounted display is equipped with a wearer's gaze camera, which is capable of capturing images of the space outside the non-transmissive head-mounted display according to the wearer's gaze. The test question data transmission unit is configured to further perform the following processing: In the processing of test questions that require wearing the non-transmissive head-mounted display and allow written note-taking during the question-setting and answering periods, a switching instruction to switch to a note-taking display mode is sent to the test taker's terminal via the network. In the note-taking display mode, the test question data for the examination is displayed on the display screen of the non-transmissive head-mounted display, and the wearer's gaze image data captured by the wearer's gaze camera is also displayed, so that the test taker can take written notes. The monitoring unit is configured to also perform the following processing: simultaneously with or while displaying the person image data, displaying the wearer's gaze image data transmitted from the examinee's terminal via the network as a moving image on the monitor's terminal.

10. The examination system according to claim 1 or 2, characterized in that, The non-transmissive head-mounted display is equipped with a light-emitting component. The examination management server also includes a light emission management unit, which performs the following processing: In the processing of test questions requiring the wearable non-transmissive head-mounted display, a light emission instruction is sent via the network to the examinee's terminal to cause the light-emitting part to emit light at any given time. Furthermore, at the designated time for emitting light, image data of a person captured by a camera device installed on the examinee's terminal and transmitted via the network is received as image data for light emission confirmation. The server then determines whether the received image data for light emission confirmation has captured the emission of the light-emitting part. The improper behavior determination unit is configured to perform the following process: if the light emission management unit fails to confirm light emission based on the light emission confirmation image data, it determines that improper behavior has been committed.

11. The examination system according to claim 10, characterized in that, The system includes a monitor terminal, which is connected to the examination management server to display information for monitors to oversee the examination. The examination management server includes a monitoring unit, which performs the following processing: receiving facial image data of the examinee captured by a camera device installed on the examinee's terminal and transmitted via the network; and displaying the received facial image data as a moving image on the monitor's terminal. The monitoring unit is configured such that: multiple image display units on the screen of the monitor terminal display multiple image display units display the image data of multiple examinees in the form of moving images; and, in multiple light-emitting period display units on the screen of the monitor terminal corresponding to the multiple image display units, when the light-emitting management unit receives a message indicating that the light-emitting instruction has been sent, the light-emitting period is displayed at a timed synchronization with the light-emitting unit of the non-transmissive head-mounted display to indicate the light-emitting period.

12. The examination system according to claim 1 or 2, characterized in that, The examination management server also has: The facial image acquisition unit performs the following processing: at the start of the exam, and during the exam period when the wear-off status data becomes data indicating non-wearing, or at the end of the exam in addition to the start of the exam and the exam period, it acquires facial image data from person image data containing the examinee's face captured by a person camera device set on the examinee's terminal and transmitted via the network. The facial feature extraction unit performs the following processing: extracting facial features from multiple facial image data acquired by the facial image acquisition unit; as well as The certification production unit performs the following processing: producing electronic or paper certification certificates for the examinees; The pre-registration acceptance unit performs the following processing: at the start of the exam, it receives voice data for voiceprint extraction acquired by the microphone set on the candidate's terminal or the microphone of the non-transmissive head-mounted display and sent via the network; it uses the received voice data to perform voiceprint analysis; and it stores the obtained voiceprint data as the reference data for calculating the candidate's identity in the candidate information storage unit in association with the candidate's ID and the exam ID. as well as The data acquisition unit performs the following processing: during the examination period, or at the end of the examination period (excluding the examination period itself), it receives voice data for voiceprint extraction acquired by the microphone of the examinee's terminal or the microphone of the non-transmissive head-mounted display and transmitted via the network; it uses the received voice data to perform voiceprint analysis; and it stores the obtained voiceprint data as reference data for personal identity calculation, associating it with the examinee's ID and examination ID, in the examinee information storage unit. The facial feature extraction unit is configured to perform the following processing: At the start of the exam, facial feature data extracted from the facial image data acquired by the facial image acquisition unit is used as the baseline data for calculating the individual's identity and is stored in the examinee information storage unit in association with the examinee ID and the exam ID. During the examination period, or at the end of the examination (excluding the examination period), facial feature values ​​extracted from the facial image data acquired by the facial image acquisition unit are used as reference data for calculating the individuality score. These data are then stored in the examinee information storage unit in association with the examinee ID and the examination ID. A facial feature value score is calculated, representing the similarity between the facial feature values ​​used as the reference data for calculating the individuality score and the facial feature values ​​stored in the examinee information storage unit as the baseline data for calculating the individuality score. The facial image acquisition unit is configured to perform the following processing: At the start of the exam, facial image data obtained from the person image data is stored in the examinee information storage unit in association with the examinee ID and exam ID, as facial image data to be used for the facial photograph to be published on the certification certificate produced by the certification certificate production unit. During the examination period, or at the end of the examination (excluding the examination period), facial image data obtained from the person image data will be stored in the examinee information storage unit in association with the examinee ID and examination ID, only if the facial feature score calculated by the facial feature extraction unit is less than or below a predetermined threshold. If the facial feature score is above or exceeds the predetermined threshold, facial image data obtained from the person image data will not be stored in the examinee information storage unit. The improper conduct determination unit is configured to perform the following processing: Calculate multiple facial feature quantity scores representing the similarity between each facial feature quantity of the control data stored in the examinee information storage unit (used for calculating the personality score) and the facial feature quantity of the benchmark data (used for calculating the personality score). Alternatively, obtain multiple facial feature quantity scores calculated by the facial feature quantity extraction unit and stored in the examinee information storage unit along with the facial feature quantity and associated with the examinee ID and exam ID. Then, calculate the average facial feature quantity score obtained by averaging the calculated or obtained multiple facial feature quantity scores. Further, multiple voiceprint scores, representing the similarity between each voiceprint data stored in the test taker information storage unit as control data for calculating the personality score and the voiceprint data used as baseline data for calculating the personality score, are calculated. Then, an average voiceprint score is obtained by averaging the calculated multiple voiceprint scores. The calculated average scores of the facial features and the average score of the voiceprint are used to calculate the individuality score obtained by integrating these average scores. The certification certificate production unit is configured such that if the degree of the individual calculated by the misconduct determination unit is below or less than a predetermined threshold, the certification certificate will not be produced.

13. The examination system according to claim 12, characterized in that, The examination management server also has: The facial image determination unit performs the following processing: if the test questions requiring the wearing of the non-transmissive head-mounted display have been continuously for a predetermined number of questions or for a predetermined time, and the data on the wearing / unwearing status during the continuous period is determined to be data indicating wearing, an instruction to remove the non-transmissive head-mounted display is sent to the test taker's terminal via the network at any time interval, so as to obtain facial image data during the test period. as well as Whether or not voiceprint determination is needed, the following processing is performed: if, excluding questions requiring verbal answers, a predetermined number of questions or a predetermined time period of questions are asked consecutively, during the intervals between questions, a voice instruction is sent to the examinee's terminal via the network at any given time to obtain voiceprint extraction data for the time period of the examination. The facial image acquisition unit is configured to perform the following process: when the face image acquisition determination unit sends a removal instruction to the test subject's terminal to remove the non-transmissive head-mounted display, and after the removal instruction is received, it is determined that the removal status data indicates non-wearing data, facial image data is acquired from the person image data sent from the test subject's terminal via the network. The comparison data acquisition unit is configured to perform the following process: when the voiceprint acquisition determination unit sends the voice instruction to the test subject's terminal, it uses the voiceprint extraction sound data sent from the test subject's terminal via the network to perform voiceprint analysis, thereby obtaining voiceprint data.

14. A computer-readable storage medium storing a program that enables a computer to function as an examination management server, the examination management server being used to construct an examination system according to any one of claims 1 to 13.

15. An examination method that administers an examination to remote examinees via an examination system connected to a network, said examination system being composed of computers, characterized in that... The examination system includes an examination management server that connects via a network to a test-taker's terminal operated by the test-taker. The exam management server performs the following processing: The test question data is sent to the test taker's terminal via the network, and the test question data is displayed on the display of the non-transmissive head-mounted display worn by the test taker. Receives the test taker's answer data sent from the test taker's terminal via the network; Receive data on the wear / removal status of the non-transmissive head-mounted display, detected by a wear / removal detection device located on the non-transmissive head-mounted display and transmitted from the testee's terminal via a network. as well as The received data on the wearing status during the question-setting period and the wearing status during the answering period are used to determine whether the wearing status is appropriate relative to the question category of the given questions.

Images