Information processing device, processing method, and program

The integration of facial recognition and time management in e-learning systems addresses the issue of authenticating test takers, ensuring reliable pass/fail determinations by validating the identity and presence of individuals during tests.

JP2024161595AActive Publication Date: 2024-11-19CANON MARKETING JAPAN INC +1
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2024145356
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-27
Publication Date
2024-11-19
Estimated Expiration
2038-07-31

AI Technical Summary

Technical Problem

Existing e-learning systems lack a mechanism to authenticate the legitimacy of test takers, leading to potential issues where a test can be passed without the genuine person taking the test, as existing technologies do not consider the authenticity of the test taker during evaluations.

Method used

An information processing device that integrates facial recognition, identity verification, and time management to determine pass/fail judgments based on the authenticity and duration of the test taker, incorporating an attendance management server, face authentication management server, and PC terminals for administrators and students, with data tables and flowcharts for processing test results.

Benefits of technology

Provides a mechanism to evaluate tests considering the test taker's authentication result, ensuring legitimate individuals are recognized, thereby enhancing the reliability of e-learning assessments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024161595000001_ABST
    Figure 2024161595000001_ABST
Patent Text Reader

Abstract

To provide an information processing device capable of evaluating a test in consideration of the authentication results of an examinee in an e-learning test, as well as a processing method and a program.SOLUTION: In an attendance management system, an information processing device (attendance management server) which manages the pass / fail results of a test using the face authentication results of face authentication means (face authentication management server) for authenticating the face of an examinee taking the test manages the time at which the examinee was determined to be the examinee themselves by the face authentication means as a personal authentication time, manages a time at which the examinee took the test as a test taking time, and determines whether the test is "passed" or "failed" on the basis of the personal authentication time and the test time.SELECTED DRAWING: Figure 11
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, a processing method, and a program for performing face authentication. [Background technology]

[0002] In recent years, e-learning systems have become widespread in university lectures, corporate training, various qualification examinations, and so on, which enable people to attend lectures or take exams at places other than the classroom or training site, such as their own homes, using network communications such as the Internet.

[0003] In e-learning, the participants (test takers) and the administrator (monitor) are separate, so an authentication mechanism to verify that genuine participants (test takers) are taking the course (test) is important.

[0004] Patent Document 1 discloses a technique for confirming attendance based on the results of facial recognition of examinees in order to identify examinees for a lecture and support the implementation of the lecture.

[0005] Patent Document 2 discloses a technique for calculating the time a user is present at his / her desk and the time he / she is absent from his / her desk based on a captured image, and tallying up the time the user is present at his / her desk and the time he / she is absent from his / her desk during working hours.

[0006] Patent Document 3 discloses a technology in which authentication timing is randomly activated during e-learning, and the acquired authentication information is checked against authentication information previously registered in an authentication server. If the authentication information differs, the e-learning is forcibly terminated when the number of mismatches accumulated in the counter exceeds a certain value. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] JP2007-133649A [Patent Document 2] JP2017-182293A [Patent Document 3] JP2009-276950A DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]

[0008] In e-learning tests, even if the test score reaches the pass mark, the test cannot be judged as having passed if the person answering the test is not recognized as a legitimate test-taker.

[0009] However, none of the techniques disclosed in Patent Documents 1 to 3 takes into consideration whether or not a legitimate examinee has answered a question in the evaluation of an e-learning test.

[0010] An object of the present invention is to provide a mechanism for evaluating an e-learning test by taking into account the authentication results of the examinee. [Means for solving the problem]

[0011] The present invention is an information processing device that manages the pass / fail judgment of an exam using the face authentication results of a face authentication means that performs face authentication on an examinee taking a test, and is characterized by comprising an identity authentication time management means that manages the time at which the examinee was determined to be the examinee by the face authentication means, an exam time management means that manages the time at which the examinee took the test, and a decision means that determines the pass / fail judgment based on the time managed by the identity authentication time management means and the time managed by the exam time management means. Effect of the Invention

[0012] According to the present invention, it is possible to provide a mechanism for evaluating an e-learning test by taking into account the authentication result of the examinee. [Brief description of the drawings]

[0013] [Figure 1]A system configuration diagram showing an example of the configuration of a course management system [Diagram 2] A block diagram showing the hardware configuration of an information processing device applicable to the course management server 111, the face authentication management server 121, the course manager PC 131, and the student PC 141. [Diagram 3] A data configuration diagram showing an example of a data table managed by the course management server 111. [Figure 4] FIG. 1 is a data configuration diagram showing an example of a data table managed by the face authentication management server 121. [Diagram 5] Flowchart showing an example of an overall processing flow [Figure 6] A flowchart showing an example of a student registration process [Figure 7] Flowchart showing an example of face authentication processing [Figure 8] Flowchart showing an example of authentication state detection processing [Figure 9] A flowchart showing an example of a test execution process. [Figure 10] Flowchart showing an example of a current authentication status determination process [Figure 11] Flowchart showing an example of an automatic pass / fail determination process [Figure 12] 13 is a flowchart showing a process in which an administrator manually corrects the automatic determination of face authentication during a test period while viewing a test result display screen (for administrator). [Figure 13] FIG. 13 is a diagram showing a test result display screen (for administrator) displayed on the display terminal (for administrator). [Figure 14] FIG. 13 is a diagram showing a test result display screen (for examinees) displayed on a display terminal (for examinees). [Figure 15] FIG. 13 is a diagram showing a test result list display screen (for administrator) displayed on a display terminal (for administrator). [Figure 16] FIG. 13 is a diagram showing a login screen displayed on a display terminal (for examinees). [Figure 17] FIG. 13 is a diagram showing a test list screen displayed on a display terminal (for examinees). [Figure 18]FIG. 13 is a diagram showing a test start screen displayed on a display terminal (for examinees). [Figure 19] FIG. 13 is a diagram showing a test end screen displayed on a display terminal (for examinees). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a system configuration diagram showing an example of the configuration of a course attendance management system according to the present invention.

[0015] The course management system 100 is configured such that a course management server 111, a face authentication management server 121, one or more course manager PCs 131, and one or more student PCs 141 are connected via the Internet 150.

[0016] The course management server 111 is a server that centrally manages information regarding students (or examinees; the same applies below), courses (lectures), and tests, and provides services related to courses and tests. It is built on the course service environment network 110 and is connected to the Internet 150 via a router 112.

[0017] The course management server 111 controls logins from the course manager PC 131 and the student PC 141, and provides services by performing the necessary processing upon receiving requests from the course manager PC 131 and the student PC 141. The course management server 111 also obtains authentication information from the face authentication management server 121, and implements course and test attendance restrictions and automatic / manual pass / fail judgments for tests.

[0018] The test is a content that can be used as e-learning and includes at least one of questions related to the course and the content related to the course. For example, the test may be conducted by answering questions related to the course, or by viewing and taking the course content.

[0019] The face authentication management server 121 is a server that manages the face image information required for face authentication of students and manages the authentication information obtained during face authentication of students. It is constructed on the face authentication service environment network 120 and is connected to the Internet 150 via a router 122.

[0020] The face authentication management server 121 receives a request from the student PC 141 and provides face image information necessary for face authentication, and acquires and stores authentication information each time from the student PC 141. The face authentication management server 121 receives a request from the course management server 111 and provides the stored authentication information.

[0021] In this embodiment, the course management server 111 and the face authentication management server 121 are constructed as separate servers, but they may be constructed on the same server.

[0022] The manager's PC 131 is a PC terminal that accepts operations from the manager and presents necessary information to the manager. It is constructed on the manager's network 130 and is connected to the Internet 150 via a router 132 .

[0023] The course manager PC 131 accepts information for student registration from the course manager, and transmits the necessary information to the course management server 111 and the face authentication management server 121 for registration. In addition, the course manager PC 131 accepts an operation to change the face authentication result from the course manager on the test result screen displayed by the course management server 111, and causes the course management server 111 to perform a manual pass / fail judgment.

[0024] The student PC 141 is a PC terminal that accepts operations from the student, performs facial authentication of the student, and presents the student with necessary information. It is constructed on the student network 140 and is connected to the Internet 150 via a router 142.

[0025] The student PC 141 accepts a login operation from a student to the course management server 111, and performs face authentication to authenticate the student when sending a login request to the course management server 111. The student PC 141 displays the course and test contents received from the course management server 111 to the student, and sends the operation and input contents from the student to the course management server 111, but performs face authentication asynchronously between login and logout, and sends authentication information to the face authentication management server 121.

[0026] In this embodiment, the servers and PCs are constructed on separate networks and connected via the Internet, but they may be constructed on the same network (for example, the same local area network).

[0027] 2 is a block diagram showing the hardware configuration of an information processing device applicable to the course management server 111, the face authentication management server 121, the course manager's PC 131, and the student's PC 141 in the embodiment of the present invention. Since each device has a similar configuration, the same reference numerals will be used for the explanation.

[0028] As shown in FIG. 2, the course management server 111, face authentication management server 121, course manager PC 131, and course student PC 141 are configured in such a manner that a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an input controller 205, a video controller 206, a memory controller 207, a communication I / F controller 208, etc. are connected via a system bus 204. The CPU 201 comprehensively controls each device and controller connected to a system bus 204 .

[0029] The ROM 202 or the external memory 211 also stores a BIOS (Basic Input / Output System) and an OS (Operating System), which are control programs for the CPU 201, and various programs (described later) required to realize the functions executed by each server or each PC. Information required to implement the present invention is also stored. The external memory may be a database.

[0030] The RAM 203 functions as a main memory, a work area, etc., for the CPU 201. The CPU 201 loads programs and the like required for executing processes from the ROM 202 or the external memory 211 into the RAM 203, and executes the loaded programs to realize various operations.

[0031] The input controller 205 controls input from a keyboard (KB) 209 and a pointing device such as a mouse (not shown). The input controller 205 also controls camera image input from a camera device 213. The student PC 141 is equipped with a camera device such as a Web camera to capture camera images to be used for face authentication, but a separate camera device may be provided for face authentication.

[0032] A video controller 206 controls the display on a display device such as a display 210. The display device may be a liquid crystal display or the like. These are used by the administrator as necessary.

[0033] The memory controller 207 controls access to an external memory 211 such as an external storage device (hard disk (HD)) that stores boot programs, various applications, font data, user files, edited files, various data, etc., a flexible disk (FD), or a compact flash (registered trademark) memory connected to a PCMCIA (Personal Computer Memory Card International Association) card slot via an adapter.

[0034] A communication I / F controller 208 connects to and communicates with external devices via a network, and executes communication control processing on the network. For example, communication using TCP / IP (Transmission Control Protocol / Internet Protocol) is possible.

[0035] The CPU 201 can display on the display 210 by, for example, executing a process of expanding (rasterizing) an outline font in a display information area in the RAM 203. The CPU 201 also enables a user to give instructions using a mouse cursor (not shown) on the display 210.

[0036] Various programs for implementing the present invention, which will be described later, are recorded in the external memory 211, and are executed by the CPU 201 by being loaded into the RAM 203 as required.

[0037] Next, an example of a data table used by the course management system in this embodiment will be described with reference to the data structure diagrams of FIG. 3 and FIG. FIG. 3 shows an example of the data configuration of a table (database) managed by the course management server 111.

[0038] The course table 300 is a table for managing courses, and has a course ID and a course name. The course ID is an alphanumeric code for identifying a course, and the course name indicates the name of the course.

[0039] The course module table 310 is a table for managing modules (tests and lectures) related to courses, and has a course ID, a module ID, and a module type. The course ID corresponds to the course ID in the course table 300, the module ID is an alphanumeric code that identifies the module, and the module type classifies the type of module, with "lesson" being set for a lecture and "test" for a test. Each module ID is also associated with content (test data and lecture content).

[0040] Test table 320 is a table for managing tests, and has a test ID, test name, and passing score. The test ID is an alphanumeric code that identifies a test, and corresponds to the module ID in course module table 310. The test name indicates the name of the test, and the passing score indicates the minimum score required to judge the test as passed.

[0041] The lecture table 330 is a table for managing lectures, and has a lecture ID and a lecture name. The lecture ID is an alphanumeric code for identifying a lecture, and corresponds to the module ID in the course module table 310. The lecture name indicates the name of the lecture.

[0042] The attendance status table 340 is a table for managing the attendance status of each student of a module (test and lecture), and has a module ID, a student ID, a start time, an end time, a score, attendance status, an authenticated ratio, and an unauthenticated ratio. The module ID corresponds to the module ID in the course module table 310, and in the case of a test, it corresponds to the test ID in the test table 320, and in the case of a lecture, it corresponds to the lecture ID in the lecture table 330. The student ID is an alphanumeric code for identifying the student, and corresponds to the student ID in the user table 360. The start time and the end time indicate the start time and the end time of the module, respectively. The score is the score that is the evaluation result of the test (blank for a lecture), and the attendance status indicates the status of the student, and is set to "not attended", "(automatic) pass", "(automatic) fail", "(manual) pass", "(manual) fail", "pending", etc. depending on whether the student attended or not, and the automatic or manual judgment result after attending the course.

[0043] The course status details table 350 is a table for managing the facial recognition results for each student of a module, and has a module ID, student ID, start time, end time, authentication status, and authenticated / unauthenticated ratio. The module ID and student ID correspond to the module ID and student ID in the course status table 340, respectively. The start time and end time indicate the start time and end time of the authentication status by facial recognition, respectively. The authentication status is the authentication status of facial recognition, and is set to "(automatic) authenticated", "(automatic) unauthenticated", "(manual) authenticated", "(manual) unauthenticated", etc. depending on the results of automatic authentication and manual correction. The authenticated / unauthenticated ratio indicates the proportion of time in the current authentication status out of the entire course time of the module.

[0044] The user table 360 ​​is a table for managing students, and has student IDs and names. The student ID is an alphanumeric code (student code, student number, etc.) that identifies the student, and the name indicates the name of the student.

[0045] The authentication criteria table 370 is a table for managing the authentication ratio that serves as the standard for attendance determination, and has module types and thresholds. The module types are the same as the module types in the course module table 310. The threshold indicates the authentication ratio that serves as the determination standard for each module type. If the ratio is equal to or exceeds this threshold, it is determined that the module (test and lecture) has been attended legitimately. FIG. 4 shows an example of the data configuration of a table (database) managed by the face authentication management server 121.

[0046] The user face image table 400 is a table for managing face images used for face authentication of students, and has a student ID, a face image to be authenticated, and an acquisition date and time. The student ID is an alphanumeric code for identifying the student, the face image to be authenticated is a link destination of the face image file to be used for face authentication of the student, and the acquisition date and time indicates the date and time when the face image file was acquired.

[0047] The authentication result table 410 is a table for managing the facial authentication results of students, and has a student ID, start time, end time, authentication status, and end status. The student ID is an alphanumeric code for identifying the student, and the start time and end time indicate the start time and end time of the authentication status by facial authentication, respectively. The authentication status indicates the authentication status by facial authentication. Unlike the authentication status in the course status details table 350, only the automatic facial authentication status is set here. The end status indicates whether the current authentication status has ended, and if it has ended, "True" is set, and if it has not ended, "False" is set. Specifically, if the authentication status has changed to another authentication status or the application (program) has been ended, "True" is set, and if the same authentication status is continuing, "False" is set.

[0048] The evidence image table 420 is a table for managing evidence images accumulated as a result of face recognition, and has a student ID, image type, acquisition date and time, and image. The student ID is an alphanumeric code that identifies the student, the image type indicates the type of evidence image, and is set to "camera image" for an image acquired by a camera device, and "screen shot" for a snapshot of the contents displayed on a display. The acquisition date and time indicates the date and time the image was acquired, and the image indicates a link to the image file.

[0049] Next, the processes executed by the course management system in this embodiment will be described with reference to the flowcharts of FIGS.

[0050] 5 is a flow chart showing an example of the overall process flow executed by the course management system. Each process step is executed by the CPU 201 of each device.

[0051] First, to register a student, the student manager PC 131 accepts a student registration operation from the manager (step S531), the student management server 111 issues a student ID and updates the user table 360 ​​(step S511), and the face authentication management server 121 registers a face image file and updates the user face image table 400 (step S521). This process will be described later in Fig. 6. As a result of this process, data on the new student is registered in the user table 360 ​​of the student management server and in the user face image table 400 of the face authentication management server 121.

[0052] Prior to this series of processing, in step S541, the student PC 141 requests an authentication source face image from the face authentication management server 121, and in step S522 receives the authentication source face image transmitted from the face authentication management server 121. This processing is executed whenever necessary, such as when the user face image table 400 is updated.

[0053] In step S542, the student PC 141 accepts a login request from the student from the login screen of FIG.

[0054] In step S512, the course management server 111 receives the login request, authenticates the student based on the student ID and password, and executes the login process.

[0055] After the login is completed, the student PC 141 executes the face authentication process asynchronously (step S543), and the face authentication management server 121 receives and registers the trace information transmitted from the student PC 141 (step S523). This process will be described later with reference to Figs. 7 and 8.

[0056] Next, the student PC 141 accepts a test start operation from the student and executes the test (step S544). At the start of the test, the student management server 111 inquires of the face authentication management server 121 to confirm the authentication status of the student, provides the student PC 141 with content for executing the test, and accepts the answer (step S513). At the start of the test, the face authentication management server 121 provides the student authentication status to the student management server 111 (step S524). This process will be described later with reference to FIG. 9.

[0057] When the test is completed, the course management server 111 performs an automatic pass / fail judgment based on the pass / fail criteria and the authentication criteria (step S514). The face authentication management server 121 provides the course management server 111 with authentication information required for the automatic pass / fail judgment (step S525). This process will be described later with reference to FIG.

[0058] In step S545, the student PC 141 receives the automatic pass / fail judgment result from the course management server 111, and displays the judgment result on a test result display screen (for examinees) as shown in FIG.

[0059] After the automatic pass / fail judgment, the course manager PC 131 accepts an operation for manual pass / fail judgment from the manager and transmits the updated contents to the course management server 111 (step S532). The course management server 111 receives the updated contents from the course manager PC 131 and performs the pass / fail judgment again (step S515). The face authentication management server 121 provides the course management server 111 with authentication information required for manual pass / fail judgment (step S526). This process will be described later with reference to FIG. 12.

[0060] In step S546, the student PC 141 receives the manual pass / fail judgment result from the student management server 111 and displays the result. The re-judgment result after the manual correction process shown in FIG. 12 is displayed on the test result display screen (for the examinee) as shown in FIG. 14.

[0061] In step S547, the student PC 141 accepts a logout request from the student, issues an instruction to end the face recognition process, and ends the face recognition process in step S548.

[0062] In step S516, the attendance management server 111 executes a logout process, notifies the student PC 141, and ends the processing flow.

[0063] 6 is a flow chart showing details of the student registration process (steps S531, S511, S521). Each process step is executed by the CPU 201 of each device.

[0064] In step S631, the PC 131 for the course manager accepts a student registration operation from the manager, sends a student registration request along with the student's name, etc. to the course management server 111, and receives the student ID issued by the course management server 111.

[0065] In step S 611 , the course management server 111 receives the student registration request from the course manager PC 131 , issues a new student ID and sends it to the course manager PC 131 , and registers the student ID and name in the user table 360 ​​.

[0066] In step S632, the manager PC 131 transmits a face image registration request to the face authentication management server 121 together with the student ID and the authentication source face image provided by the student.

[0067] In step S621, the face authentication management server 121 receives a face image registration request from the course manager PC 131, saves the transmitted authentication source face image in a specified folder or the like, and registers the student ID, a link to the image, and the acquisition date and time in the user face image table 400.

[0068] 7 is a flowchart showing the details of the face recognition process (steps S543 and S523). Each processing step is executed by the CPU 201 of each device.

[0069] In step S741, the student PC 141 requests the face authentication management server 121 to transmit an authentication source face image, and receives the authentication source face image transmitted from the face authentication management server 121.

[0070] In step S721, the face authentication management server 121 transmits an authentication source face image to the student PC 141 in response to a request from the student PC 141. The authentication source face images transmitted here may be all managed images, may be differences that have been changed since the last transmission, or may be only images for the student who uses the student PC 141.

[0071] In step S742, the student PC 141 determines whether the application (program) for executing the face recognition process has been terminated. The application termination process may be linked to the student's logout as in step S547, or may be performed by an individual termination command. If the application has been terminated, this process flow is terminated, and if not, the process proceeds to step S743. In step S743, the student PC 141 detects the current authentication state. This process will be described later with reference to FIG.

[0072] In step S744, the student PC 141 transmits information regarding the authenticated and unauthenticated times to the face authentication management server 121.

[0073] In step S722, the face authentication management server 121 updates the start time and end time for the latest authentication state in the authentication result table 410 based on the received information on the authentication / non-authentication time.

[0074] In step S745, the student PC 141 acquires a screen shot as evidence information, and transmits it to the face authentication management server 121 together with necessary information.

[0075] In step S723, the face authentication management server 121 saves the transmitted screen shot in a specified folder or the like, and registers the student ID, image type="screen shot", and a link to the save destination in the evidence image table 420.

[0076] In step S746, the student PC 141 acquires the camera image, which is evidence information, and transmits it to the face authentication management server 121 together with necessary information.

[0077] In step S724, the face authentication management server 121 saves the transmitted camera image in a specified folder or the like, and registers the student ID, image type="camera image", and a link to the save destination in the evidence image table 420.

[0078] In the student PC 141, the processes from step S743 to step S746 are repeated at a preset time interval until it is determined in step S742 that the application has been terminated. In addition, in this embodiment, the trail information is always transmitted at a preset time interval in steps S745 and S746, but it may be transmitted only when the authentication status has changed or by setting a transmission time interval.

[0079] 8 is a flow chart showing details of the authentication status detection process (step S743). Each process step is executed by the CPU 201 of the student PC 141.

[0080] In step S801, the student PC 141 detects the student's face from an image captured by a connected camera device and performs authentication.

[0081] Authentication is performed by comparing the photographed face with a face image registered in advance to be used as an authentication source, and checking whether the degree of similarity satisfies a predetermined standard.

[0082] In step S802, the student PC 141 detects the current authentication status of the student from the captured image. In this embodiment, the current authentication status of the student is either "authenticated" or "unauthenticated."

[0083] The "authenticated" state refers to a state in which the participant's own face is correctly detected in the captured image. The "unauthenticated" state refers to a state in which the participant's own face is not correctly detected in the captured image.

[0084] In step S803, the student PC 141 judges whether the authentication status of the current student detected in step S802 is "authenticated" or "unauthenticated." If it is "authenticated," the process proceeds to step S804. If it is "unauthenticated," the process proceeds to step S807.

[0085] In step S804, the student PC 141 judges whether the state has changed since the previous authentication state was detected. That is, since the current authentication state is "authenticated", if the previous authentication state was "authenticated", there is no change in the state, and if it was "unauthenticated", there is a change in the state. If there has been a change in the state, step S806 is executed, and if there has been no change in the state, step S805 is executed and this process flow is terminated.

[0086] In step S805, since there was no change in the state, the student PC 141 continues to record the "authenticated" state. In other words, in response to this result, in step S722, the face authentication management server 121 updates the end time of the latest authentication state (registered as "authenticated") registered in the authentication result table 410 with the current authentication time.

[0087] In step S806, since the state has changed from "unauthenticated" to "authenticated," the student PC 141 stops recording the "unauthenticated" state and starts recording a new "authenticated" state. In other words, in response to this result, in step S722, the face authentication management server 121 updates the end time of the latest authentication state registered in the authentication result table 410 (registered as "unauthenticated") with the current authentication time, and sets the end state to "True." It then newly registers the latest authentication state as "authenticated," sets the start time and end time to the current authentication time, and sets the end state to "False." This indicates that the "unauthenticated" state has ended and the "authenticated" state has begun.

[0088] In step S807, the student PC 141 judges whether the state has changed since the previous authentication state was detected. In other words, since the current authentication state is "unauthenticated", if the previous authentication state was "unauthenticated", there is no change in the state, and if it was "authenticated", there is a change in the state. If there has been a change in the state, step S809 is executed, and if there has been no change in the state, step S808 is executed and this process flow ends.

[0089] In step S808, since there was no change in the state, the student PC 141 continues to record the "unauthenticated" state. In other words, in response to this result, in step S722, the face authentication management server 121 updates the end time of the latest authentication state (registered as "unauthenticated") registered in the authentication result table 410 with the current authentication time.

[0090] In step S809, since the state has changed from "authenticated" to "unauthenticated", the student PC 141 stops recording the "authenticated" state and starts recording a new "unauthenticated" state. In other words, in response to this result, in step S722, the face authentication management server 121 updates the end time of the latest authentication state (registered as "authenticated") registered in the authentication result table 410 with the current authentication time, and sets the end state to "True". Furthermore, it newly registers the latest authentication state as "unauthenticated", sets the start time and end time to the current authentication time, and sets the end state to "False". This indicates that the "authenticated" state has ended and the "unauthenticated" state has begun.

[0091] 9 is a flowchart showing the details of the test execution process (steps S544, S513, and S524). Each process step is executed by the CPU 201 of each device.

[0092] In step S941, the student PC 141 displays the test list screen of FIG. 17 to accept the selection of a test, and then displays the test start screen of FIG. 18 to accept the pressing of the start test button, thereby sending a test start request to the student management server 111 along with the test ID (module ID) and student ID.

[0093] In step S911, the course management server 111 receives a test start request from the student PC 141 and transmits a request to obtain current authentication information to the face authentication management server 121. At this time, the current time and the user ID are transmitted. In step S921, the face authentication management server 121 receives a request to obtain current authentication information.

[0094] In step S922, the face authentication management server 121 determines the current authentication state, that is, whether it is “authenticated” or “unauthenticated.” This process will be described later with reference to FIG.

[0095] In step S923, the face authentication management server 121 transmits the determination result in step S922 to the course management server 111 as current authentication information.

[0096] In step S912, the course management server 111 judges whether the current authentication status is "authenticated" or "unauthenticated" based on the transmitted authentication information. If it is "unauthenticated", the test cannot start, so the course management server 111 notifies the course PC 141 of the result and causes it to execute again from step S941. If it is "authenticated", the process proceeds to step S913.

[0097] In step S913, the course management server 111 transmits to the student PC 141 test contents (such as a test question display screen, an answer selection screen, etc.) corresponding to the transmitted test ID.

[0098] In step S942, the student PC 141 presents test content, accepts test answers from the student, and transmits the test answers to the student management server 111 by accepting pressing of the end button on the test end screen of FIG.

[0099] In step S914, the course management server 111 receives the test answers and registers them in a test answer table (not shown) and also records the start time and end time of the corresponding module ID and student ID in the course status table 340.

[0100] 10 is a flowchart showing details of the current authentication status determination process (step S922). Each process step is executed by the CPU 201 of the face authentication management server 121.

[0101] In step S1001, the face authentication management server 121 obtains the latest authentication result corresponding to the student ID from the authentication result table 410, and judges the latest authentication state. If the latest authentication state is "authenticated", the process proceeds to step S1002, and if it is "unauthenticated", the process proceeds to step S1004.

[0102] In step S1002, the face authentication management server 121 judges whether the state of the latest authentication result obtained is ended. If the state of the latest authentication result is "False", the process proceeds to step S1003, and if the state of the latest authentication result is "True", the process proceeds to step S1004. Note that the state of the latest authentication result becomes "True" mainly when the face authentication application (program) is terminated.

[0103] In step S1003, the face authentication management server 121 judges the time that has elapsed from the end time of the latest authentication result to the present time. In other words, the validity of the authentication state is judged based on the time that has elapsed since the time that was last judged to be "authenticated." If it is within a preset time range, it is judged that the "authenticated" state is continuing and the process proceeds to step S1005, whereas if it has exceeded the preset time range, it is judged that a system malfunction or the like has occurred and the process proceeds to step S1004.

[0104] In step S1004, the face authentication management server 121 sets the current authentication status to "unauthenticated" and ends the processing flow.

[0105] In step S1005, the face authentication management server 121 sets the current authentication state to "authenticated" and ends the processing flow.

[0106] 11 is a flow chart showing details of the automatic pass / fail determination process (step S514). Each process step is executed by the CPU 201 of each device.

[0107] In step S1111, the course management server 111 grades the test answers received from the student PC 141 based on the correct answer data (not shown). The graded scores are used to update the scores for the corresponding module ID and student ID in the course status table 340.

[0108] In step S1112, the course management server 111 judges whether the graded score is equal to or greater than the pass mark for the corresponding module ID in the test table 320. If it is equal to or greater than the pass mark, the process proceeds to step S1113, and if it is less than the pass mark, the process proceeds to step S1117.

[0109] In step S1113, the course management server 111 transmits to the face authentication management server 121 a request to acquire authentication time information between the start time and the end time of the corresponding module ID and student ID in the course status table 340.

[0110] In step S1121, the face authentication management server 121 receives a request to acquire authentication time information together with the student ID, start time, and end time from the course management server 111.

[0111] In step S1122, the face authentication management server 121 extracts the authentication results between the received start time and end time for the corresponding student ID from the authentication result table 410, and aggregates the authentication time information (start time, end time, time ratio) for each authentication state.

[0112] In step S1123, the face authentication management server 121 transmits the authentication time information collected for each authentication time to the course management server 111.

[0113] Next, based on the authentication time information received from the face authentication management server 121, the course management server 111 registers the start time, end time, authentication state, and authenticated / unauthenticated ratio for each authentication state for the corresponding module ID and student ID in the course status details table 350. Furthermore, the course management server 111 calculates the sum of the authenticated ratio and unauthenticated ratio for the corresponding module ID and student ID in the course status details table 350, and registers the authenticated ratio and unauthenticated ratio for the corresponding module ID and student ID in the course status table 340.

[0114] In step S1114, the course management server 111 judges whether the authentication ratio of the corresponding module ID and student ID in the course status table 340 is equal to or greater than the threshold of the corresponding module type (here, "test") in the authentication criteria table 370. If it is equal to or greater than the threshold, proceed to step S1115, and if it is less than the threshold, proceed to step S1116.

[0115] In step S1115, the course management server 111 determines that the test result is a pass because both the score and the authentication ratio meet the pass criteria, sets the course status for the corresponding module ID and student ID in the course status table 340 to "(automatic) pass," and ends the processing flow.

[0116] In step S1116, the course management server 111 reserves the right to determine whether the test pass / fail is due since the score meets the pass criteria but the authentication ratio does not meet the pass criteria, sets the course status to "pending" for the corresponding module ID and student ID in the course status table 340, and ends the processing flow.

[0117] In step S1117, the course management server 111 determines the test result as a fail because the score does not meet the pass criteria, sets the course status for the corresponding module ID and student ID in the course status table 340 to "(automatic) fail," and ends the processing flow. Referring to FIG.

[0118] In S1201, on the display terminal (for administrator), the administrator presses the pass / fail judgment correction button on the test result list display screen (for administrator), and an instruction to display the pending test results linked to the examinee ID and test name ID is sent to the course management server.

[0119] In S1202, in response to receiving an instruction to display the test results from the display terminal (for administrator), the course management server controls the display so that the various display items to be displayed on the test result display screen (for administrator) are retrieved from each database (course status table 340) and placed on the test result display screen (for administrator) so that the contents of the test result display screen (for administrator) are displayed on the display terminal (for administrator).

[0120] The pass / fail result (attendance status) 1301 at the time of suspension linked to the examinee ID and test name ID is obtained from the attendance management server database (attendance status table 340) and displayed on the exam result display screen (for administrator).

[0121] The test score (score) 1302 linked to the examinee ID and test name ID is obtained from the database (attendance status table 340) of the attendance management server and displayed on the exam result display screen (for administrator).

[0122] The authentication rate (total) 1303 at the time of suspension linked to the examinee ID and test name ID is obtained from the database (attendance status table 340) of the attendance management server and displayed on the test result display screen (for administrator).

[0123] The authenticated / unauthenticated ratio (authenticated / unauthenticated ratio) 1307 at the time of suspension linked to the examinee ID and test name ID is obtained from the course management server database (course status details table 350) and displayed on the test result display screen (for administrator).

[0124] In S1203, the attendance management server transmits a request to the face recognition management server to obtain an authentication original image linked to the examinee ID and test name ID, and obtains the corresponding authentication original image from the face recognition management server.

[0125] In S1204, the face recognition management server searches the database (user face image table 400) for an authentication source image (authentication source face image) linked to the examinee ID and test name ID, and transmits the searched authentication source image to the attendance management server.

[0126] In S1205, the course management server places the authentication source face image 1310 acquired from the face recognition management server on the test result display screen (for administrator).

[0127] In S1206, the attendance management server transmits a request to the face recognition management server to obtain the time period and face recognition associated with the examinee ID and test name ID, and obtains the corresponding time period from the face recognition management server.

[0128] In S1207, the face recognition management server searches the database (authentication result table 410) for the time period (start time and end time) and face recognition (authentication status) linked to the examinee ID and test name ID, and transmits the searched time period and face recognition to the attendance management server.

[0129] In S1208, the course management server places the time period 1305 and face authentication 1306 obtained from the face recognition management server on the test result display screen (for administrator).

[0130] In S1209, the attendance management server transmits a request to the face recognition management server to acquire a snapshot image linked to the examinee ID and test name ID, and acquires the corresponding snapshot image from the face recognition management server.

[0131] In S1210, the face recognition management server searches the database (trail image table 420) for a snapshot image (screen shot) linked to the examinee ID and test name ID, and transmits the found snapshot image to the attendance management server.

[0132] In S1211, the course management server places the snapshot image 1308 acquired from the face recognition management server on the test result display screen (for administrator).

[0133] In S1212, the attendance management server sends a request to the face recognition management server to obtain a face recognition image linked to the examinee ID and test name ID, and obtains the corresponding face recognition image from the face recognition management server.

[0134] In S1213, the face recognition management server searches the database (evidence image table 420) for a face recognition image (camera image) linked to the examinee ID and test name ID, and transmits the searched face recognition image to the attendance management server.

[0135] In S1214, the course management server places the face recognition image 1309 acquired from the face recognition management server on the test result display screen (for administrator).

[0136] In S1215, the display terminal (for administrator) manually corrects the face authentication 1306 pull-down on the test result list display screen (for administrator) by the administrator, and sends an instruction to change the face authentication for the manually corrected time period to the course management server.

[0137] In S1216, the course management server receives the pull-down candidates and their time slots manually corrected by the administrator, and controls the display of the face recognition 1306 on the exam result list display screen (for administrator) to change the authentication rate (total) and the display values ​​of authentication and non-authentication related to the change results.

[0138] In S1217, the course management server recalculates the authentication percentage (total) from the manually corrected pull-down candidates and their time periods received in S1216, and re-determines whether the authentication percentage (total) 1303 at the time of suspension satisfies the threshold value, which is the pass condition.

[0139] In S1218, the course management server changes the content of the pass / fail judgment 1301 at the time of suspension to display (manual) fail, since the authentication ratio (total) recalculated in S1217 does not yet satisfy the pass condition.

[0140] In S1219, the course management server changes the content of the pass / fail judgment 1301 at the time of suspension so that (manual) pass is displayed, since the authentication rate (total) recalculated in S1217 satisfies the pass condition.

[0141] In S1220, the display terminal (for administrator) sends an instruction to update (or register) the test results, such as the pass / fail result 1301 after recalculation and manual correction, facial recognition 1306, authenticated / unauthenticated ratio 1307, authenticated ratio (total) 1303, authenticated ratio 1304, etc., to the database of the course management server when the administrator presses the save button 1311 on the test result list display screen (for administrator).

[0142] In S1221, the course management server updates or registers the test results and values ​​such as the pass / fail judgment 1301 after the update instruction and manual correction after recalculation, the face recognition 1306, the recognition / non-recognition ratio 1307, the recognition ratio (total) 1303, and the recognition ratio 1304 in the database.

[0143] In S1222, on the display terminal (for the administrator), the contents of the test result display screen (for the administrator) as shown in FIG. 13, newly registered in S1221, can be viewed. Referring to FIG.

[0144] Figure 13 shows a test result display screen (for administrators) that enables an administrator to check the automatic facial recognition judgment during the test for each test result and correct the final pass / fail judgment of a test result that was temporarily withheld because the automatic facial recognition judgment did not meet the pass criteria even though the test score met the pass criteria.

[0145] The test result display screen (for administrator) is displayed on the Web browser of the client terminal (for administrator) 131. Each item displayed on the test result display screen (for administrator) will be explained.

[0146] A pass / fail decision 1301 is a final pass / fail decision of the test result after the administrator makes corrections. In the final pass / fail decision, either pass or fail is displayed.

[0147] A pass is displayed when both the test score and the certification percentage (total) finally meet the specified pass criteria.

[0148] A fail is displayed in a test result in which only the test score meets the predetermined pass standard, but the final certification percentage does not meet the predetermined pass standard.

[0149] The test score 1302 is the score in the test. For example, the score out of 100 points or the number of correct answers out of 30 questions is displayed.

[0150] If the pass mark for a test is set at 80 out of a possible 100, then a test score of 87 will meet the pass mark.

[0151] The authentication rate (total) 1303 indicates the total authentication rate of the automatic judgment and manual correction in which it was finally confirmed that the examinee himself / herself took the test within the test time, expressed as a percentage.

[0152] If the pass condition for the authentication percentage (total) is set to 70% out of 100%, an authentication percentage (total) of 71% will meet the pass condition.

[0153] If an administrator subsequently manually corrects the automatic facial recognition judgment, the recognition rate (total) will change according to the correction result.

[0154] The authentication rate 1304 shows the rate at which the examinee was automatically determined to be the examinee through facial recognition and the rate at which the administrator manually corrected the examinee to be the examinee using the facial recognition pull-down menu, and these are displayed as percentages.

[0155] In this example, it can be seen that the rate at which the examinee was automatically identified by face recognition was 65%, and the rate at which the administrator manually corrected the examinee's identity using the face recognition pull-down menu was 6%. As a result of the administrator's correction, the authentication rate (total) became 71%, which ultimately met the pass criteria, and the pass / fail judgment was determined to be a pass.

[0156] Time period 1305 is displayed so that each time period within the test period can be confirmed as being the time period during which the facial recognition unit automatically determined that the examinee was the examinee (first time period), or the time period during which the facial recognition unit automatically determined that the examinee was not the examinee (second time period).

[0157] In this embodiment, the examinee is photographed from 16:02:37 to 16:15:20 during this time period, and therefore the face recognition unit automatically determines that the examinee is the examinee (recognized).

[0158] In this embodiment, the examinee is not photographed at all from 16:15:20 to 16:25:31 during this time period, so the face recognition unit automatically determines that the examinee is not the examinee (unrecognized).

[0159] In this embodiment, the examinee is photographed from 16:25:31 to 16:35:02 during this time period, and therefore the face authentication unit automatically determines that the examinee is the examinee himself / herself (authentication).

[0160] In this embodiment, the examinee is photographed from 16:35:02 to 16:37:16, but because the examinee's face is facing poorly, the facial recognition unit automatically determines that the examinee is not the examinee (unrecognized).

[0161] Face authentication 1306 corresponds to each time period of the first time zone or the second time zone, and is the result of personal authentication during the final test time, which can be manually corrected by the administrator to authentication or non-authentication.

[0162] The administrator can manually select one of the four options from the pull-down menu: (automatic) authentication, (automatic) unauthenticated, (manual) authentication, and (manual) unauthenticated, and switch between them. The (automatic) unauthenticated option in the pull-down menu indicates that the result is an automatic unauthenticated result.

[0163] This indicates that (manual) authentication is the manual authentication acceptance section among the pull-down candidates. The user can correct the pull-down candidate from (automatic) unauthenticated to (manual) authentication by using the manual authentication acceptance section. Among the candidates in the pull-down menu, "(Auto) Authentication" indicates the automatic authentication result.

[0164] This shows that the (manual) unauthenticated option in the pull-down list is the manual unauthenticated option acceptance section. The user can correct the pull-down list from (automatic) authentication to (manual) unauthenticated option by using the manual unauthenticated option acceptance section. (Automatic) authentication is displayed automatically when the facial recognition section automatically determines that the examinee is the real examinee. "(Auto) Not Recognized" is automatically displayed when the facial recognition section automatically determines that the examinee is not the examinee in question.

[0165] (Manual) authentication is displayed when an administrator visually checks the facial recognition image in which the examinee appears and manually corrects it to confirm that it is the examinee.

[0166] "(Manual) Not Authenticated" is displayed when an administrator visually checks the facial recognition image in which the examinee appears and manually corrects it to determine that the examinee is not the examinee. The authenticated / unauthenticated ratio 1307 corresponds to each time period of the first time zone or the second time zone.

[0167] The authenticated / unauthenticated ratios are displayed as the authenticated ratio for the test time in the first time slot and the unauthenticated ratio for the test time in the second time slot. The test time in this embodiment is from 16:02:37 to 16:37:16.

[0168] In addition, if the administrator selects (manual) authentication, this means the authentication percentage for the test time during which the examinee was manually corrected to be the examinee.

[0169] Similarly, if the administrator selects (manual) non-authentication, this will mean the proportion of non-authenticated test time during the period in which the test was not taken by the test taker but was manually corrected. The snapshot images 1308 correspond to each time period of the first time zone or the second time zone.

[0170] In this embodiment, the period from 16:02:37 to 16:15:20 is the time period during which the facial recognition unit automatically determined that the examinee was the examinee himself / herself, and this is evidence data for proving the contents of the screen display, such as a screenshot of the screen obtained when the facial recognition unit automatically determined that the examinee was the examinee himself / herself.

[0171] Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is the time period during which the facial recognition unit automatically determined that the examinee was not the examinee himself / herself, and evidence data for proving the contents of the screen display, such as a screenshot of the screen obtained when the facial recognition unit automatically determined that the examinee was not the examinee himself / herself, is provided.

[0172] In addition, multiple pieces of evidence data may be obtained during a first time period when it is determined that the examinee is the actual examinee, and multiple pieces of evidence data may be obtained during the second time period when it is determined that the examinee is not the actual examinee.

[0173] In this way, by displaying the evidence data in correspondence with a first time period or a second time period, it is possible to show the administrator evidence data that enables him or her to verify whether the test screen was properly displayed on the examinee's client terminal during the first time period or the second time period.

[0174] Furthermore, rather than just displaying the evidence data obtained immediately after the automatic judgment by the face recognition unit, evidence data is periodically obtained after a specified time has elapsed after the automatic judgment by the face recognition unit and multiple copies are displayed, allowing the administrator to see evidence data that enables more detailed confirmation as to whether the test screen was displayed appropriately on the examinee's client terminal during the first time period or the second time period. The face recognition image 1309 corresponds to each of the first time zone or the second time zone.

[0175] In this embodiment, the period from 16:02:37 to 16:15:20 is the time period during which the facial recognition unit automatically determined that the examinee was the examinee himself, and the image contains the examinee who was actually automatically determined by the facial recognition unit to be the examinee himself.

[0176] Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is the time period in which the facial recognition unit automatically determined that the test-taker was not the actual test-taker, and the images do not include the test-taker who was actually automatically determined by the facial recognition unit to not be the actual test-taker.

[0177] Similarly, in this embodiment, the period from 16:35:02 to 16:37:16 is the time period in which the facial recognition unit automatically determined that the examinee was not the actual examinee, and the images include the examinee who was actually automatically determined by the facial recognition unit to not be the actual examinee, but their faces are not facing forward.

[0178] In this way, by displaying the actual automatically determined image in correspondence with the first time zone or the second time zone, it is possible to show the administrator image data that allows the administrator to confirm whether the image was correctly automatically determined in the first time zone or the second time zone. The administrator can view this confirmable image data and correct the final result of authentication or non-authentication.

[0179] Furthermore, by keeping image data that can be used to verify whether an automatic judgment was made without error, this can also be used as evidence in case an examinee inquires during the exam period about whether the automatic judgment was made appropriately by the face recognition unit.

[0180] In addition, multiple pieces of image data that can be used to confirm whether the automatic judgment has been made without a doubt may be obtained in the first time period, and multiple pieces of image data that can be used to confirm whether the automatic judgment has been made without a doubt may be obtained in the second time period. In this way, if multiple pieces of image data that can be used to confirm whether the automatic judgment has been made are available, it is possible to check in detail the changes in the orientation of the examinee's face during each of the first and second time periods.

[0181] In other words, the period from 16:35:02 to 16:37:16 is the time period when the facial recognition unit automatically determined that the test-taker was not the actual test-taker, but by displaying images including the test-taker who was recognized by the facial recognition unit side by side, the administrator can easily verify from the image data that can be used to verify whether or not this was an automatic determination that the test-taker was not the actual test-taker during this period, that he or she was looking in another direction and thinking about their answers, and that this was not some kind of violation such as being absent.

[0182] In addition, the period from 16:15:20 to 16:25:31 is the time period during which the facial recognition unit automatically determined that the test-taker was not the actual test-taker, but because the test-taker was not present, the administrator can easily confirm that the facial recognition unit correctly and automatically determined that the test-taker was not the actual test-taker from 16:15:20 to 16:25:31.

[0183] Furthermore, in addition to displaying the image data that has been automatically determined by the facial recognition unit, image data that periodically confirms the presence of the examinee after a specified time has elapsed after the automatic determination by the facial recognition unit is obtained and multiple images are displayed, allowing the administrator to see image data that allows them to confirm in detail that the facial recognition unit correctly automatically determined that the examinee was not the examinee in question during the first or second time period.

[0184] The authentication source face image 1310 is a master image registered in advance for each examinee so that the face authentication unit can automatically identify the examinee. This master image is an image prepared by the examinee when applying to take the test and registered for the test.

[0185] By displaying the master image and the image data automatically determined by the face recognition unit side by side for comparison, it is possible to check whether the face recognition was automatically determined correctly.

[0186] In other words, if the master image is not displayed, even if one looks at only the image data that has been automatically determined by the face recognition unit, it is not easy to determine whether the master image itself is an image from which it is difficult for the face recognition unit to extract features that would allow the face recognition unit to automatically determine the identity of the examinee, and so on, and therefore whether incorrect recognition has resulted in a large number of failures in the automatic determination by the face recognition unit.

[0187] Furthermore, by displaying the master image, the administrator can easily check whether the face recognition was automatically determined to be the same as the examinee's examination photograph by comparing it with the examinee's examination photograph, etc. It is also possible to check whether the master image has been illegally replaced.

[0188] The save button 1311 is an operation button for registering the final pass / fail judgment after the administrator has manually corrected it in the database.

[0189] When the save button is pressed, the latest corrections displayed on the screen are sent to the database and registered therein.

[0190] The "exit without saving" button 1312 is a cancel button for ending the screen operation without registering the final pass / fail judgment after the administrator has manually corrected the error in the database.

[0191] If the "Exit without saving" button is pressed, the latest corrections displayed on the screen will not be sent to the database and the database will not be updated. Referring to FIG.

[0192] Figure 14 shows the test result display screen (for examinees) in which the test score met the pass criteria, but the pass / fail result was temporarily withheld because the automatic facial recognition judgment did not meet the pass criteria.

[0193] This test result display screen (for examinees) is displayed on the web browser of examinee client terminal 141. This section explains each item displayed on the test result display screen (for examinees).

[0194] A pass / fail decision 1301 is a final pass / fail decision of the test result of the examinee. In the final pass / fail decision, one of pass, pending, or fail is displayed.

[0195] A pass is displayed when both the test score and the certification percentage (total) finally meet the specified pass criteria.

[0196] "Pending" is displayed in test results where only the test score meets the specified passing standard, but the final certification percentage does not meet the specified passing standard. A fail is indicated on a test result where the test score does not meet the predetermined pass standard.

[0197] The test score 1402 is the score in the test. For example, the score out of 100 points or the number of correct answers out of 30 questions is displayed.

[0198] If the pass mark for a test is set at 80 out of a possible 100, then a test score of 87 will meet the pass mark.

[0199] The authentication rate 1403 displays, as a percentage, the rate at which it was automatically determined that the examinee was actually taking the test within the test time.

[0200] If the pass condition for the authentication rate is set to 70% out of 100%, an authentication rate of 65% will not meet the pass condition. Therefore, for this examinee, the test result will be withheld and the final pass / fail decision will be made after the administrator checks and corrects the result.

[0201] Time period 1404 displays each time period during the test so that it is possible to check whether the time period during which the facial recognition unit automatically determines that the person is present (first time period) or the time period during which the facial recognition unit automatically determines that the person is absent (second time period).

[0202] In this embodiment, the examinee is photographed from 16:02:37 to 16:15:20 during this time period, and therefore the face recognition unit automatically determines that the examinee is present (recognized).

[0203] In this embodiment, no examinees are photographed between 16:15:20 and 16:25:31, so the facial recognition unit automatically determines that examinees are absent (unrecognized) during this time period.

[0204] In this embodiment, the examinee is photographed from 16:25:31 to 16:35:02 during this time period, and therefore the face recognition unit automatically determines that the examinee is present (recognized).

[0205] In this embodiment, between 16:35:02 and 16:37:16, the examinee is photographed, but because the examinee's face is facing poorly, the facial recognition unit automatically determines that the examinee has left their seat (not been authenticated).

[0206] The face recognition 1405 corresponds to each time period of the first time zone or the second time zone, and is the result of the examinee's presence or absence during the examination. The "present" status is automatically displayed when the face authentication unit automatically determines that the person is present. The "Away from the Desk" message is automatically displayed when the face authentication unit automatically determines that the person is away from the desk. The authenticated / unauthenticated ratio 1406 corresponds to each time period of the first time zone or the second time zone.

[0207] The authenticated / unauthenticated ratio shows the authenticated ratio for the test time in the first time slot and the unauthenticated ratio for the test time in the second time slot. The snapshot images 1407 correspond to each time period of the first time period or the second time period.

[0208] In this embodiment, the period from 16:02:37 to 16:15:20 is the time period during which the facial recognition unit automatically determined that the person was present, and this is evidence data for proving the contents of the screen display, such as a screenshot of the screen obtained when the facial recognition unit automatically determined that the person was present.

[0209] Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is the time period during which the facial recognition unit automatically determined that the person was away from their desk, and evidence data for proving the contents of the screen display, such as a screenshot of the screen obtained when the facial recognition unit automatically determined that the person was away from their desk, is provided.

[0210] In addition, multiple pieces of evidence data may be obtained during a first time period when it is determined that the person is present, and multiple pieces of evidence data may be obtained during a second time period when it is determined that the person is absent.

[0211] In this way, by displaying the evidence data in correspondence with a first time period or a second time period, it is possible to show the examinee evidence data that enables the examinee to verify whether the test screen was displayed appropriately on the examinee's client terminal during the first time period or the second time period.

[0212] Furthermore, rather than just displaying the evidence data obtained immediately after the automatic judgment by the face recognition unit, evidence data is obtained periodically after a specified time has elapsed after the automatic judgment by the face recognition unit and multiple copies are displayed, allowing the test taker to see evidence data that enables more detailed confirmation of whether the test screen was displayed appropriately on the test taker's client terminal during the first time period or the second time period. The face recognition image 1408 corresponds to each time period of the first time zone or the second time zone.

[0213] In this embodiment, the period from 16:02:37 to 16:15:20 is the time period during which the facial recognition unit automatically determined that the examinee was present, and the image includes the examinee who was actually automatically determined by the facial recognition unit to be present.

[0214] Similarly, in this embodiment, the period from 16:15:20 to 16:25:31 is the time period in which the facial recognition unit automatically determined that the test-taker was absent, and the image does not include the test-taker who was actually automatically determined by the facial recognition unit to have been absent.

[0215] Similarly, in this embodiment, the period from 16:35:02 to 16:37:16 is the time period during which the facial recognition unit automatically determined that the examinee was absent from their seat, and the image includes the examinee who was actually automatically determined by the facial recognition unit to have been absent from their seat, but their face is not facing forward.

[0216] In this way, by displaying the images that have actually been automatically judged in correspondence with the first time period or the second time period, it is possible to show the examinee image data that enables the examinee to confirm that the image was definitely automatically judged in the first time period or the second time period.

[0217] Furthermore, by leaving image data that can be used to verify whether an automatic judgment was made without error, it can also be used as evidence when inquiring of an administrator during the test period as to whether an automatic judgment was made appropriately by the face recognition unit.

[0218] In addition, multiple pieces of image data that can be used to confirm whether the automatic judgment has been made without a doubt may be obtained in the first time period, and multiple pieces of image data that can be used to confirm whether the automatic judgment has been made without a doubt may be obtained in the second time period. In this way, if multiple pieces of image data that can be used to confirm whether the automatic judgment has been made are available, it is possible to check in detail the changes in the orientation of the examinee's face during each of the first and second time periods.

[0219] In other words, the period from 16:35:02 to 16:37:16 is the time period when the facial recognition unit automatically determined that the examinee was absent from their seat; however, by displaying images including the examinee who was recognized by the facial recognition unit side by side, the examinee can easily verify from the image data that can be used to verify whether or not the examinee was automatically determined to be absent that during this period, the examinee was looking in another direction and thinking about their answers, and that this was not some kind of violation such as being absent.

[0220] In addition, the facial recognition unit automatically determined that the test-taker was away from his / her seat between 16:15:20 and 16:25:31, but the test-taker can easily confirm that the facial recognition unit correctly and automatically determined that the test-taker was away from his / her seat between 16:15:20 and 16:25:31 because the test-taker was not present.

[0221] Furthermore, in addition to displaying the image data that has been automatically determined by the facial recognition unit, image data that periodically confirms the presence of the examinee after a specified time has elapsed after the automatic determination by the facial recognition unit is obtained and multiple images are displayed, making it possible to show the examinee image data that allows them to confirm in detail that the facial recognition unit correctly automatically determined that the examinee was not the examinee in question during the first or second time period.

[0222] The authentication source face image 1409 is a master image registered in advance for each examinee so that the face authentication unit can automatically identify the examinee.

[0223] By displaying the master image and the image data automatically determined by the face recognition unit side by side, it is possible to check whether the face recognition was automatically determined correctly.

[0224] In other words, if the master image is not displayed, even if one looks at only the image data that has been automatically determined by the face recognition unit, it is not easy to determine whether the master image itself is an image from which it is difficult for the face recognition unit to extract features that would allow the face recognition unit to automatically determine the identity of the examinee, and so on, and therefore whether incorrect recognition has resulted in a large number of failures in the automatic determination by the face recognition unit.

[0225] Furthermore, by displaying the master image, the examinee can easily check whether the facial recognition was automatically performed using the same exam photograph by comparing it with the examinee's exam photograph, etc. It is also possible to check whether the master image has been illegally replaced. Referring to FIG.

[0226] Figure 15 shows the test result list display screen (for administrators) on which an administrator can select from a list the test results of candidates whose pass / fail results are pending, from among all the test results of those who took the Japanese midterm test.

[0227] The test result list display screen (for administrator) is displayed on the Web browser of the client terminal (for administrator) 131.

[0228] Furthermore, in the case of the Japanese midterm test results, it is acceptable to display only the pending test results on the test takers and test result list display screen (for administrators) without displaying the pass / fail test results. The course name 1501 identifies the name of the course taken, and displays the course name, course ID, etc.

[0229] The test name 1502 identifies the content of the test taken, and displays the test name, test ID, etc. The test examinee 1503 identifies the examinee, and displays the examinee's name, examinee ID, etc. The test score 1504 indicates the test score of the test taker. The authentication rate 1505 indicates the rate at which the face authentication unit automatically determined that a person was present during the test.

[0230] A pass / fail result 1506 is the pass / fail result of the test taker. Based on both the test score and the authentication rate, one of pass, pending, or fail is automatically displayed.

[0231] The "correct pass / fail decision" 1507 is a forward button for transitioning to a test result display screen (for administrator) where the administrator can correct the final pass / fail decision of the temporarily held test results. The forward button is automatically displayed only for the temporarily held test results. Referring to FIG. FIG. 16 shows a login screen that allows an examinee to log in to the training system. This login screen is displayed on the web browser of examinee's client terminal 141.

[0232] The student ID 1601 is an input field in which the examinee manually inputs the examinee ID and the like in order to manage the examinees who log in to the training system.

[0233] A password 1602 is an input field in which the examinee manually inputs a password for each examinee in order to manage passwords for logging in to the training system.

[0234] The login button 1603 is a button for sending login information to the training system after the examinee manually inputs the examinee ID and password. After pressing this button, login authentication is performed and each examinee can start the test (Japanese midterm test, etc.) via e-learning. Referring to FIG.

[0235] FIG. 17 shows the test list screen on which an examinee selects the tests he or she should take after logging in to the training system. This test list screen is displayed on the web browser of examinee's client terminal 141.

[0236] The midterm test button 1701 is a button for selecting the name of the test that the student should take from the test list. By pressing this midterm test button, for example, the Japanese midterm test is selected, and the screen transitions to a screen showing the test name of the Japanese midterm test. Referring to FIG.

[0237] FIG. 18 shows a test start screen on which an examinee can begin, for example, a midterm Japanese test, after selecting the name of the test to be taken on the test list screen.

[0238] Pressing the test start button 1801 starts, for example, a midterm test in Japanese, and the screen transitions to a midterm test screen for Japanese (not shown), where the student takes a number of exam questions. Furthermore, when the test start button is pressed, the test start time is registered in the database. Referring to FIG.

[0239] FIG. 19 shows a test end screen on which the examinee answers all the questions in the Japanese midterm test after starting the Japanese midterm test on the test start screen and ends the test.

[0240] By the user selecting the answer radio button 1901, the answer to question 10 of the midterm Japanese test, for example, is completed.

[0241] Pressing the previous page button 1902 returns the user to a screen showing the answer to question number 9 in the midterm Japanese test, for example.

[0242] Pressing the answer send button 1903 completes the answer to a midterm test in Japanese, for example, and sends the results of the midterm test to the database. Based on the results of the midterm test in Japanese sent here, the test score is automatically calculated, and the test score is also registered in the database. Furthermore, when the answer submission button is pressed, the test completion time is registered in the database.

[0243] While one embodiment has been described above, the present invention can be embodied, for example, as a system, an apparatus, a method, a program, or a recording medium, and specifically, the present invention may be applied to a system made up of multiple devices, or may be applied to an apparatus made up of a single device.

[0244] The program of the present invention is a program that enables a computer to execute the processing method of the flowcharts shown in the drawings, and the storage medium of the present invention stores a program that enables a computer to execute the processing method of the drawings. Note that the program of the present invention may be a program for each processing method of each device in the drawings.

[0245] As described above, it goes without saying that the object of the present invention can be achieved by supplying a recording medium on which a program that realizes the functions of the above-mentioned embodiments is recorded to a system or device, and having the computer (or CPU or MPU) of that system or device read and execute the program stored on the recording medium.

[0246] In this case, the program itself read out from the recording medium will realize the novel functions of the present invention, and the recording medium storing the program will constitute the present invention.

[0247] Examples of recording media for supplying the program include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, silicon disks, solid state drives, etc.

[0248] Furthermore, it goes without saying that the functions of the above-mentioned embodiments are not only realized by the computer executing a program it has read, but also includes cases where an OS (operating system) running on the computer performs some or all of the actual processing based on the instructions of the program, and the functions of the above-mentioned embodiments are realized through that processing.

[0249] Furthermore, it goes without saying that this also includes cases where a program read from a recording medium is written into a memory provided on a function expansion board inserted into a computer or a function expansion unit connected to a computer, and then a CPU or the like provided on the function expansion board or function expansion unit performs some or all of the actual processing based on the instructions of the program code, thereby realizing the functions of the above-mentioned embodiments.

[0250] The present invention may be applied to a system consisting of multiple devices, or to an apparatus consisting of a single device. Needless to say, the present invention can also be applied to a case where the object is achieved by supplying a program to a system or apparatus. In this case, the effect of the present invention can be enjoyed by the system or apparatus by reading a recording medium storing a program for achieving the present invention into the system or apparatus.

[0251] Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or device can enjoy the effects of the present invention. It should be noted that the present invention also includes configurations that combine the above-described embodiments and their modified examples. [Explanation of symbols]

[0252] 100 Course Management System 111 Course management server 121 Face recognition management server 131 PC for course administrators 141 PC for students

Claims

1. An information processing device that manages pass / fail judgments for a test using a face authentication result of a face authentication means that performs face authentication on a test taker, an identity authentication time management means for managing the time during which the examinee is determined to be the examinee by the face authentication means; an examination time management means for managing the time during which the examinee takes the test; a determination means for determining whether the test is passed or failed based on the time managed by the personal authentication time management means and the time managed by the examination time management means; An information processing device comprising:

2. 2. The information processing device according to claim 1, wherein the decision means reserves the pass / fail judgment when the ratio of the time managed by the personal authentication time management means to the time managed by the examination time management means does not meet a pass criterion.

3. The test result management means further comprises a test result management means for managing the results of the test taken by the examinee, 3. The information processing apparatus according to claim 2, wherein when the test results managed by said test result management means meet a pass standard and said ratio also meets a pass standard, said pass / fail judgment is managed as a pass.

4. 4. The information processing apparatus according to claim 1, wherein the time managed by said personal authentication time management means and the time managed by said examination time management means are registered asynchronously.

5. determining whether the test has been completed based on the time managed by the test time management means; 5. The information processing apparatus according to claim 1, wherein, when it is determined that the examination has been completed, the decision means decides whether or not to reserve the pass / fail decision.

6. A processing method of an information processing device that manages pass / fail judgment of a test using a face authentication result of a face authentication means that performs face authentication of an examinee who takes a test, comprising: The information processing device, an identity authentication time management step for managing the time during which the examinee is determined to be the examinee by the face authentication means; an examination time management step for managing the time that the examinee took the test; a determination step of determining whether or not the test is passed based on the time managed in the personal authentication time management step and the time managed in the examination time management step; A processing method comprising the steps of:

7. A program for an information processing device that manages pass / fail judgments for a test using a face authentication result of a face authentication means that performs face authentication on a test taker, The information processing device, an identity authentication time management means for managing the time during which the examinee is determined to be the examinee by the face authentication means; an examination time management means for managing the time during which the examinee takes the test; A decision means for deciding the pass / fail judgment based on the time managed by the personal authentication time management means and the time managed by the examination time management means. A program to function as a

Citation Information

Patent Citations

  • Biological information collating device, image formation apparatus and program

    JP2007172022A

  • Attendance management system

    JP2013077086A

  • Authentication device, authentication method, and program

    JP2017102758A

  • Position information management device, attendance management system, information provision method, and program

    JP2017107492A

  • Test system

    JP2017156410A