Information processing system, information processing method and program

Abstract

To provide an information processing system, an information processing method and a program that execute appropriate face authentication processing.SOLUTION: Processing by an information processing device includes: face detection means for detecting the face of a person from an image; and authentication means for executing authentication processing using a face other than a face displayed on a terminal capable of displaying a face image among the faces detected by the face detection means.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] As disclosed in Patent Document 1, there is a face recognition technology that detects a person's face from a captured image and performs authentication to determine whether the detected face is the face of a person registered in advance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-61800 DISCLOSURE OF THE INVENTION [Problem to be solved by the invention]

[0004] Fraudulent authentication processing can occur when a person who is not a pre-registered person displays the face of a registered person on the screen of a smartphone or other device and attempts to authenticate the displayed facial image.

[0005] Therefore, an object of the present invention is to perform appropriate face authentication processing. [Means for solving the problem]

[0006] The information processing system of the present invention comprises: a face detection means for detecting a human face from an image; an authentication means for performing authentication processing using faces other than the face displayed on a terminal capable of displaying face images, among the faces detected by the face detection means; Equipped with. [Effects of the Invention]

[0007] According to the present invention, it is possible to perform appropriate face authentication processing. [Brief explanation of the drawings]

[0008] [Figure 1] A diagram showing an example of a system configuration [Figure 2] A diagram showing an example of a hardware configuration [Figure 3] 1 is a flowchart showing an example of processing content; [Figure 4] FIG. 10 is a diagram showing an example of a display screen. [Figure 5] FIG. 10 is a diagram showing an example of a display screen. [Figure 6] FIG. 10 is a diagram showing an example of a display screen. [Figure 7] FIG. 10 is a diagram showing an example of a display screen. DETAILED DESCRIPTION OF THE INVENTION

[0009] 1 is a diagram showing an example of the configuration of an information processing system according to the present invention. As shown in FIG. 1, the system is configured such that an information processing device 101 and an imaging device 102 are connected to each other.

[0010] The information processing device 101 analyzes the video (image) captured by the imaging device 102, and detects the faces of people and display terminals included in the image. Then, it performs authentication processing on the detected faces and notifies the user of the results (one example of a notification method is to display information indicating the authentication result on the display terminal, or to output different sounds depending on whether the authentication is successful or unsuccessful).

[0011] A trained model (so-called AI) trained by deep learning may be used for face and display terminal detection and authentication processing. In addition, as a configuration using AI installed in an external device (not shown), the information processing device may be configured to have a function of issuing instructions to the external AI and acquiring information output from the external AI.

[0012] FIG. 2 is a block diagram showing an example of the hardware configuration of the information processing device 101 of the present invention.

[0013] As shown in FIG. 2, the information processing device 101 is connected to a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a storage device 204, an input controller 205, an audio controller 206, a video controller 207, a memory controller 208, and a communication I / F controller 209 via a system bus 200.

[0014] The CPU 201 controls all devices and controllers connected to the system bus 200 .

[0015] ROM202 or external memory 213 stores the BIOS (Basic Input / Output System) and OS (Operating System), which are control programs executed by CPU201, computer-readable and executable programs for realizing this information processing method, and various necessary data (including data tables).

[0016] The RAM 203 functions as a main memory, a work area, etc. for the CPU 201. The CPU 201 loads programs and the like required for executing processing from the ROM 202 or the external memory 213 into the RAM 203, and executes the loaded programs to realize various operations.

[0017] The input controller 205 controls input from input devices such as a keyboard 210 and a pointing device such as a mouse (not shown). If the input device is a touch panel, the user can issue various instructions by pressing (touching with a finger or the like) icons, cursors, or buttons displayed on the touch panel.

[0018] The touch panel may also be a touch panel capable of detecting positions touched by multiple fingers, such as a multi-touch screen.

[0019] The video controller 207 controls the display on an external output device such as a display 212. The display also includes the display of a notebook computer integrated with the main body. Note that the external output device is not limited to a display, and may be, for example, a projector. In addition, for devices capable of receiving the above-mentioned touch operation, an input device is also provided.

[0020] The video controller 207 can control a video memory (VRAM) for display control, and can use part of the RAM 203 as a video memory area, or can provide a separate dedicated video memory.

[0021] The memory controller 208 controls access to the external memory 213. The external memory may be an external storage device (hard disk) that stores a boot program, various applications, font data, user files, edited files, and various data, a flexible disk (FD), or a CompactFlash (registered trademark) memory connected to a PCMCIA card slot via an adapter.

[0022] The communication I / F controller 209 connects and communicates with external devices via a network, and executes communication control processing on the network. For example, communication using TCP / IP, telephone lines such as ISDN, and 4G and 5G mobile phone lines are possible.

[0023] The CPU 201 enables display on the display 212 by, for example, executing a process of expanding (rasterizing) an outline font into a display information area in the RAM 203. The CPU 201 also enables user instructions using a mouse cursor (not shown) on the display 212.

[0024] Next, a process executed by the CPU 201 of the information processing device 101 will be described with reference to the flowchart of Fig. 3. Note that the process shown in this flowchart is a process in which the CPU 201 reads and executes a predetermined control program.

[0025] The processing of this flowchart begins with the face authentication processing in step S111, and is repeated until an authentication result is obtained (S101).

[0026] In step S102, an image captured by an imaging device is acquired.

[0027] In step S103, a process is performed to detect a human face from the image acquired in step S102. The detection process uses a known technique, and for example, a trained model (AI) that has learned the characteristics of a human face through deep learning may be used, or other methods may be used.

[0028] In step S104, it is determined whether a face has been detected by the detection process in step S103. If a face has been detected (S104: YES), the process proceeds to step S105, and if a face has not been detected (S104: NO), the process proceeds to step S113. In step S113, the detection result is set to "no authentication target."

[0029] In step S105, a device capable of displaying a facial image (hereinafter referred to as a display device), such as a smartphone or tablet device, is detected from the image acquired in step S102. This detection process also uses known technology, and may use, for example, a trained model (AI) that has learned the characteristics of the display device through deep learning, or other methods.

[0030] Next, the processes of S107 to S112 are repeated the same number of times as the number of faces detected in step S103 (S106).

[0031] In step S107, a face for which the processes of S107 to S112 have not been executed is selected.

[0032] In step S108, it is determined whether a display terminal has been detected by the processing in step S105. If a display terminal has been detected (S108: YES), the processing proceeds to step S109. If a display terminal has not been detected (S108: NO), the processing proceeds to step S111.

[0033] In step S109, it is determined whether the face to be processed is within the area of ​​the display terminal detected in S105. Specifically, during the detection processes of S103 and S105, position information (coordinate information) of a rectangle indicating the face area (such as a circumscribed rectangle of the face) and a rectangle indicating the area of ​​the display terminal is acquired, and it is possible to determine whether the rectangle indicating the face area is completely contained within the area of ​​the display terminal.

[0034] If multiple display terminals are detected, a determination is made for all detected display terminals, and if the face is present within the area of ​​any of the display terminals, a determination of YES is made.

[0035] If the face is within the area of ​​the display terminal (step S109: YES), the process proceeds to step S110. If the face is not within the area (step S109: NO), the process proceeds to step S111.

[0036] In step S110, authentication failure is set as the authentication result.

[0037] In step S111, face authentication processing is performed using known technology, but for example, a trained model (AI) that has learned the features of face images of pre-registered people through deep learning may be used, or the similarity between the face image to be processed and a pre-registered face image may be calculated, and authentication processing may be performed based on whether the similarity satisfies a predetermined condition.

[0038] In step S112, the authentication result (authentication success or failure) in S111 is set.

[0039] 3, control is performed so that faces within the area of ​​the display terminal are not subject to the authentication process (S111), but it is also possible to perform the display terminal detection process of S105 before the face detection process of S103, identify the area related to the detected display terminal, and control so that the area is excluded from the target range of the face detection process of S103. As a result, faces within the area of ​​the display terminal are not detected, and therefore the faces are not subject to the authentication process.

[0040] Next, screens that are displayed when the processing of the present invention is carried out will be described using the screen examples shown in FIGS.

[0041] Fig. 4 shows an example of the screen displayed when no human face is detected. As shown in Fig. 4, there are no faces or display devices in the captured image display area 401, and the authentication result shows that there are no targets for face authentication (402).

[0042] Fig. 5 shows an example of a screen that is displayed when a photograph of the face of a person who has been registered in advance is taken. As shown in Fig. 5, a rectangle 501 indicating the area of ​​the detected face is displayed. In addition, a message indicating that the face authentication was successful is displayed (502) as a result of the face authentication process.

[0043] Fig. 6 is a diagram showing an example of a screen displayed when a photograph of the face of a pre-registered person and a display terminal is taken. As shown in Fig. 6, a rectangle 601 indicating the area of ​​the detected face and a rectangle 602 indicating the area of ​​the detected display terminal are displayed. In addition, a message indicating that authentication was successful as a result of the face authentication process is displayed (602).

[0044] 7 is a diagram showing an example of a screen displayed when an image of a face of an unregistered person and a display terminal displaying the face of a pre-registered person are captured. As shown in FIG. 7, rectangles 701 and 703 indicating the area of ​​the detected face and a rectangle 702 indicating the area of ​​the detected display terminal are displayed. As a result of the face authentication process, a message is displayed (704) indicating that person A (the person associated with area 701) is an unregistered person and therefore authentication has failed. Although person B (the person associated with area 703) is a registered person, the face of this person is present within the area of ​​the display terminal, and therefore a message is displayed (705) indicating that authentication has failed as a result of the authentication process.

[0045] As shown in Figures 5 to 7, it is also possible to control the display so that faces that have been successfully authenticated, faces that have failed authentication, and faces that are present within the display terminal's area are each displayed in a distinguishable manner. In this embodiment, as shown in 501 in Figure 5 and 601 in Figure 6, rectangles indicating faces that have been successfully authenticated are displayed with black dotted lines. As shown in 701 in Figure 7, faces that have failed authentication are displayed with a dash-dot-dash line. As shown in 703 in Figure 7, faces that are present within the display terminal's area (faces of people who have been registered in advance) are displayed with a white dotted line. Although not shown, faces that are present within the display terminal's area (faces of people who are not registered in advance) may also be displayed with a white dash-dot-dash line.

[0046] In this way, by controlling the display so that it is possible to understand whether or not each face has been successfully authenticated simply by looking at the captured image, it is possible to recognize the results of the authentication process more efficiently.

[0047] Although the embodiments have been described above, the present invention can be embodied as, for example, a system, an apparatus, a method, a program, a recording medium, etc. Specifically, the present invention may be applied to a system made up of multiple devices, or may be applied to an apparatus made up of a single device.

[0048] Furthermore, the program of the present invention is a program that enables a computer to execute the processing method of the flowchart shown in Fig. 3, and the storage medium of the present invention stores a program that enables a computer to execute the processing method of Fig. 3. Note that the program of the present invention may be a program for each processing method of each device in Fig. 3.

[0049] As described above, it goes without saying that the object of the present invention can also be achieved by supplying a recording medium on which a program that realizes the functions of the above-mentioned embodiments is recorded to a system or device, and having the computer (or CPU or MPU) of that system or device read and execute the program stored on the recording medium.

[0050] In this case, the program itself read from the recording medium will realize the novel functions of the present invention, and the recording medium on which the program is recorded will constitute the present invention.

[0051] Examples of recording media for supplying the program include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon disks.

[0052] Furthermore, it goes without saying that not only are the functions of the above-mentioned embodiments realized by the computer executing a program it has read, but also cases are included in which an OS (operating system) running on the computer performs some or all of the actual processing based on the instructions of the program, and the functions of the above-mentioned embodiments are realized through that processing.

[0053] Furthermore, it goes without saying that this also includes cases where a program read from a recording medium is written into a memory provided on a function expansion board inserted into a computer or a function expansion unit connected to the computer, and then a CPU or the like provided on the function expansion board or function expansion unit performs some or all of the actual processing based on the instructions of the program code, thereby realizing the functions of the above-mentioned embodiments.

[0054] Furthermore, the present invention may be applied to a system consisting of multiple devices, or to a device consisting of a single device. It goes without saying that the present invention can also be applied to a case where the present invention is achieved by supplying a program to a system or device. In this case, the system or device can enjoy the effects of the present invention by reading a recording medium containing a program for achieving the present invention into the system or device.

[0055] Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or device can enjoy the effects of the present invention. Note that the present invention also includes configurations that combine the above-mentioned embodiments and their modified examples. [Explanation of symbols]

[0056] 101 Information processing equipment 102 Imaging device

Claims

1. a face detection means for detecting a human face from an image; an authentication means for performing authentication processing using faces other than the face displayed on a terminal capable of displaying face images, among the faces detected by the face detection means; An information processing system comprising:

2. 2. The information processing system according to claim 1, further comprising a terminal detection unit that detects a terminal capable of displaying a face image from the image.

3. a face detection means for detecting a human face from an image; an authentication means for performing authentication processing using faces detected by the face detection means other than the faces included in an area related to a terminal capable of displaying face images; An information processing system comprising:

4. 4. The information processing system according to claim 3, further comprising area specifying means for specifying an area of ​​the terminal.

5. 5. The information processing system according to claim 1, further comprising a display control unit that controls the display of a result of the authentication process performed by the authentication unit.

6. 6. The information processing system according to claim 5, wherein the display control means controls the display of faces detected by the face detection means so that faces to be used in the authentication process and faces not to be used in the authentication process can be distinguished from each other.

7. A specifying means for specifying an area of ​​the terminal on which a facial image can be displayed; a face detection means for detecting a human face from an area of ​​the image excluding the area specified by the specifying means; an authentication means for performing authentication processing using the face detected by the face detection means; An information processing system comprising:

8. a face detection step in which face detection means of the information processing device detects a person's face from an image; an authentication step in which an authentication means of the information processing device performs authentication processing using faces detected by the face detection step other than the face displayed on a terminal capable of displaying face images; An information processing method comprising:

9. a face detection step in which face detection means of the information processing device detects a person's face from an image; an authentication step in which an authentication means of the information processing device performs authentication processing using faces detected by the face detection step other than faces included in an area related to a terminal capable of displaying face images; An information processing method comprising:

10. a specifying step in which a specifying means of the information processing device specifies an area related to the terminal capable of displaying a face image; a face detection step in which face detection means of the information processing device detects a human face from an area of ​​the image excluding the area specified by the specification step; an authentication step in which an authentication means of the information processing device performs an authentication process using the face detected by the face detection step; An information processing method comprising:

11. A program for causing a computer to function as each of the means according to any one of claims 1, 2, 3, 4 and 7.

Images