Method and system for preventing face authentication spoofing

Abstract

To prevent stand-in participation by an attendee in an on-line class of an educational institution and spoofing participation of a conference participant in an online conference of a corporation or the like because design of an online conference assumes communication by video and voice but online conference software enables setting without showing a face that turns the video off with an on-line participation terminal device, making spoofing possible.SOLUTION: The present invention includes: a face authentication information storage unit in which a terminal device satisfies an authentication permission condition even when an online participant sets no-face showing that turns a video off in an on-line conference software by a face image virtual unit and which stores registered face authentication information registering a plurality of online participants in advance; and an authentication processing unit which authenticates one of the plurality of on-line participants on the basis of the acquired acquisition face authentication information and permits the authentication when the authentication is satisfied.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a method and system capable of preventing fraud such as impersonation of participants when using the Web in online classes at educational institutions or online conferences at companies. [Background technology]

[0002] In recent years, in the implementation of online classes and online meetings, in addition to the traditional face-to-face method in which online participants attend classes or meetings by going to a designated location, online meetings are now being conducted that allow participants to join classes or meetings in their own environment over the Internet.

[0003] On the other hand, in the above-mentioned online conferences, online participants can choose not to show their faces, making it difficult to verify the identity of the participants, which makes it easy for them to commit fraudulent acts such as impersonation, making it difficult to strictly manage attendance or hold meetings with only those involved. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2021-157649 A [Patent Document 2] Patent Publication No. 2022-23406 [Patent Document 3] JP 2022-31184 A [Patent Document 4] JP 2023-52914 A [Patent Document 5] Patent Publication No. 2023-7008 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem that the invention aims to solve is that while online conferences are designed on the assumption that communication will be via video and audio, online conference software allows online participants at their terminals to set the video to be turned off and their faces not to be shown, making it possible to commit fraud such as impersonation.

[0006] For example, the objective of the present invention is to provide an online class system that can easily and reliably manage attendance at online classes at educational institutions by preventing students from impersonating others, and that can also prevent students from attending in their place.

[0007] Another object of the present invention is to provide an online conference system that can easily and reliably monitor conference participants in online conferences held by companies, etc., and that can prevent participants from impersonating others. [Means for solving the problem]

[0008] The present invention has been made to solve the above-mentioned problems, and provides a method and system for preventing facial recognition spoofing, comprising a facial recognition information storage unit that stores registered facial recognition information in which a plurality of online participants are pre-registered on a facial recognition server, a facial image processing device that allows authentication corresponding to each of the plurality of online participants, and a facial image acquisition unit that acquires the facial recognition information of the online participants on a terminal device.

[0009] Further, in the above invention, the terminal device satisfies the authentication permission condition even if an online participant sets the video image to off in the online conference software so that the face is not shown, by using the face image virtualization unit.

[0010] The present invention is also characterized in that it comprises a registered face authentication information storage unit that stores registered face authentication information in which a plurality of online participants are registered in advance, and a face authentication processing device that authenticates one of the plurality of online participants based on the acquired acquired face authentication information, and allows the authentication if the authentication is satisfied. Effect of the Invention

[0011] According to the method and system for preventing spoofing through face authentication of the present invention, it is possible to prevent fraud such as spoofing of a person in face authentication with a simple configuration. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is an explanatory diagram for explaining an overview of a face authentication system according to this embodiment. [Diagram 2] FIG. 2 is an explanatory diagram for explaining the authentication management server. [Diagram 3] FIG. 3 is an explanatory diagram for explaining the face authentication server. [Figure 4] FIG. 4 is an explanatory diagram for explaining the terminal device. [Diagram 5] FIG. 5 is an explanatory diagram for explaining an overview of the face image virtual portion. [Figure 6] FIG. 6 is an explanatory diagram for explaining an authentication procedure for an online class. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a face recognition system, a face recognition device, and a face recognition method according to the present invention will be described in detail with reference to the accompanying drawings.

[0014] FIG. 1 is an explanatory diagram for explaining an overview of the face recognition system according to this embodiment, and shows a face recognition system in which an online participant registers face recognition information such as facial information in an authentication device from a notebook PC 101 with a web camera and a PC 102 with a USB camera, and then the face recognition device compares the registered face recognition information of the registered online participant with the currently acquired acquired face recognition information to perform face recognition processing of the individual.

[0015] Also, at the start of the class or conference and at a random time, an inquiry is made to the authentication management server 106 about authentication.

[0016] In addition, the authentication management server 106 notifies the face authentication server 107 of face authentication information, and returns a face authentication result attendance notification to the authentication management server 106.

[0017] In addition, the authentication management server 106 provides the teacher, office staff, and manager terminals 103 with information on attendance confirmation via browser, allowing the teacher, office staff, and manager to check the authenticated attendance of online participants in conjunction with the attendance status on the attendance confirmation terminals 104 in the teaching room and conference room.

[0018] In addition, the authentication management server 106 can update attendance information in the core system, ie, the teaching system and the attendance management system server 105 .

[0019] FIG. 2 is an explanatory diagram for explaining an overview of the authentication management server 201 according to this embodiment, which is a dedicated server for determining whether an online participant attempting to access an online conference is a legitimate online participant and whether the access should be permitted.

[0020] FIG. 3 is an explanatory diagram for explaining the outline of the face recognition server 301 according to this embodiment, which is a dedicated server including a face recognition information storage unit 302 that stores registered face recognition information in which a plurality of online participants are registered in advance, and a face recognition device 304 that authenticates one of the plurality of online participants based on a face image processing device 303 of the acquired face recognition information, and allows the authentication if the authentication is satisfied.

[0021] FIG. 4 is an explanatory diagram for explaining an overview of the terminal device according to this embodiment. The terminal device is a device composed of a WEB camera device 401, a WEB camera control unit 402, a face image acquisition unit 403, a face image virtualization unit 404, a server information acquisition unit 405, and an impersonation determination unit 406. The face authentication information acquired by the face image virtualization unit 404 is sent to the authentication management server 106 and authenticated via the face authentication server 107. If the face is authenticated by the impersonation determination unit 406, the processing of the terminal device is continued. If the face is not authenticated, an interruption message is sent to the online participants.

[0022] FIG. 5 is an explanatory diagram for explaining an overview of the face image virtual unit 404 according to this embodiment. The online conference software 501 can treat the image of the virtual image 502 in the same way as a USB camera image. The online conference software 501 can arbitrarily set whether or not to acquire the image. The acquired virtual image 502 can be authenticated against a registered image 503 in the face recognition server.

[0023] FIG. 6 is an explanatory diagram for explaining the authentication procedure for online classes at an educational institution in this embodiment, which proceeds in the following order: a login step on the teacher's side, an authentication confirmation step, a login step on the student's side, an authentication confirmation step, and a student attendance confirmation step on the teacher's side. [Industrial Applicability]

[0024] The authentication system, authentication device, and authentication method according to the present invention are suitable for preventing fraud such as impersonation of a person in face authentication information authentication with a simple configuration. [Explanation of symbols]

[0025] 101 Laptop with web camera 102 PC with USB camera 103 Teachers, administrators, and managers' terminals 104 Attendance confirmation terminals in the doctrine room and meeting rooms 105 Educational system server and attendance management system server 106 Authentication Management Server 107 Face Recognition Server 201 Authentication Management Server 301 Face Recognition Server 302 Face Recognition Information Recording Unit 303 Face image processing device 304 Face Recognition Device 401 WEB camera equipment 402 WEB camera control unit 403 Face image acquisition unit 404 Facial Image Virtual Section 405 Server Information Acquisition 406 Spoofing Detection Unit 501 Online Meeting Software 502 Virtual Images 503 Registration Image

Claims

1. A facial authentication spoofing prevention system comprising: an online participant terminal device comprising a registered facial authentication information storage unit that stores registered facial authentication information in which a plurality of online participants are registered in advance; a facial authentication storage unit that allows authentication processing corresponding to each of the plurality of online participants; a facial authentication information acquisition unit that acquires acquired facial authentication information from the online participants; a facial authentication server comprising an authentication processing unit that authenticates one of the plurality of online participants based on the stored registered facial authentication information and the acquired acquired facial authentication information and allows the authentication if there is a match; and an authentication management server that relays between the online participant terminal and the facial authentication server.

2. The method is characterized in that the face recognition server includes a face recognition information storage unit that stores registered face recognition information in which a plurality of online participants are pre-registered on a server connected to a communication network, a face image processing device that allows authentication corresponding to each of the plurality of online participants, and a face recognition acquisition unit on a terminal device that acquires acquired face recognition information from the online participants.

3. The method is characterized in that the online participant terminal device is equipped with at least a monitor, an input device, a speaker, and a WEB camera, and is equipped with a face image virtualization unit that can obtain a facial image of the online participant by the image virtualization unit when the online participant uses online conference software to attend a class or start a conference, regardless of whether the online participant sets the online conference software to turn off the image so as not to show his / her face.

4. The method is characterized in that the online participant terminal device can process face recognition at random times during a lecture or meeting in addition to starting a lecture or meeting using online meeting software.

Images