Authentication Device

Abstract

To provide a user interface that enables access to information corresponding to the authentication state of face authentication by a simple operation, and a device therefor.SOLUTION: In an authentication device, input reception screen generation means generates an input reception screen that includes a first area for displaying a message and receives a tap operation by an object person who is an object of face authentication, in the first area or a second area provided separately from the first area. Menu screen generation means generates a menu screen including one or more menu items, as a screen after transition from the input reception screen in accordance with the tap operation performed on the first area or the second area.SELECTED DRAWING: Figure 2A

Description

[Technical Field]

[0001] The present disclosure relates to face recognition technology. [Background technology]

[0002] Facial recognition is one of the authentication technologies used for identity verification.

[0003] Specifically, for example, Patent Document 1 discloses a technology for performing face authentication using a facial image of a user of an image forming device, the facial image being captured by a camera provided in a user interface of the image forming device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-212624 Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, in face recognition for determining whether or not to permit entry to an area where entry by anyone other than pre-registered individuals is restricted (hereinafter also referred to as an entry-restricted area), various individuals, such as children and elderly people, may be subject to the face recognition. Therefore, in face recognition for determining whether or not to permit entry to an entry-restricted area, it is desirable to employ a user interface that allows access to information corresponding to the authentication status of the face recognition by a simple operation. This point is not limited to face recognition for determining whether or not to permit entry to a predetermined area, but also applies to face recognition used for various other purposes.

[0006] However, Patent Document 1 does not particularly mention the above-mentioned viewpoint. Therefore, the technology disclosed in Patent Document 1 has a problem in that the operation to access information according to the authentication status of face authentication becomes complicated.

[0007] One object of the present disclosure is to provide a user interface that allows access to information according to the authentication status of face authentication through a simple operation, and a device therefor. [Means for solving the problem]

[0008] According to one aspect of the present disclosure, an authentication device for performing face authentication of a subject includes: a processor that performs processing related to face authentication to determine whether or not a target person is permitted to enter an entry-restricted area; a touch panel that displays information related to the authentication status of the face authentication to the subject; a thermosensor for detecting a body surface temperature of the subject; a camera that captures an image of the subject to be used for the face authentication; For the above subjects For guidance regarding the procedure for entering the restricted entry area a speaker for outputting audio; a human presence sensor that detects the presence or absence of the target person; a plurality of holes that are used for detecting the presence or absence of the target person by the human presence sensor and for outputting sound from the speaker; With death, After the facial authentication is successful, if the subject's body surface temperature detected by the thermal sensor is above a predetermined value, the processor displays a message on the touch panel informing the subject that they are not allowed to enter the restricted entry area, and then displays a screen on the touch panel providing information on medical institutions near the restricted entry area where they can be treated. [Effects of the Invention]

[0009] According to the present disclosure, it is possible to provide a user interface that allows access to information corresponding to the authentication status of face authentication through simple operations, and a device therefor. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an authentication system according to a first embodiment. [Figure 2A] FIG. 2 is a diagram illustrating the appearance of the front side of the terminal device according to the first embodiment. [Figure 2B] FIG. 2 is a diagram showing an example in which a rear unit is attached to the rear side of the terminal device according to the first embodiment. [Figure 2C]FIG. 2C is a diagram showing an example in which an extension unit is attached to the rear unit of FIG. 2B. [Figure 3] FIG. 2 is a diagram for explaining an example of installation of a terminal device according to the first embodiment. [Figure 4] FIG. 2 is a diagram for explaining an example of installation of a terminal device according to the first embodiment. [Figure 5] FIG. 2 is a diagram showing an example of the functional configuration of a terminal device according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing an example of the functional configuration of a server device according to the first embodiment. [Figure 7] 4 is a flowchart for explaining processing performed in the authentication system according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a standby screen displayed on the terminal device in response to the processing of FIG. 7; [Figure 9] 9 is a diagram showing an example of a menu screen to which a transition can be made from the standby screen of FIG. 8. [Figure 10] FIG. 8 is a diagram showing an example of an authentication failure screen displayed on the terminal device in response to the processing of FIG. 7. [Figure 11] 10 is a flowchart for explaining processing performed in an authentication system according to a second embodiment. [Figure 12] FIG. 12 is a diagram showing an example of an entry denial screen displayed on the terminal device in response to the processing of FIG. 11. [Figure 13] FIG. 13 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of FIG. 12. [Figure 14] FIG. 12 is a diagram showing an example of an admission permission screen displayed on the terminal device in response to the processing of FIG. 11. [Figure 15] FIG. 15 is a diagram showing an example of a menu screen to which a transition can be made from the admission permission screen in FIG. 14. [Figure 16] 10 is a flowchart for explaining processing performed in an authentication system according to a third embodiment. [Figure 17] FIG. 17 is a diagram showing an example of an alert screen displayed on the terminal device in response to the processing of FIG. 16. [Figure 18] FIG. 18 is a diagram showing an example of a menu screen to which a transition can be made from the alert screen of FIG. 17. [Figure 19]FIG. 10 is a diagram showing a modified example of a standby screen displayed on the terminal device. [Figure 20] FIG. 10 is a diagram showing a modified example of an entry denial screen displayed on the terminal device. [Figure 21] FIG. 21 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of FIG. 20. [Figure 22] FIG. 10 is a diagram showing a modified example of an entry denial screen displayed on the terminal device. [Figure 23] FIG. 23 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of FIG. 22. [Figure 24] FIG. 10 is a diagram showing an example of an entry denial screen displayed on the terminal device. [Figure 25] FIG. 25 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of FIG. 24. [Figure 26] FIG. 13 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of FIG. 12. [Figure 27] FIG. 10 is a diagram showing an example of an entry denial screen displayed on the terminal device. [Figure 28] FIG. 28 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of FIG. 27. [Figure 29] FIG. 10 is a block diagram showing the functional configuration of an authentication device according to a fourth embodiment. [Figure 30] 10 is a flowchart for explaining processing performed in an authentication device according to a fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, preferred embodiments of the present disclosure will be described with reference to the drawings.

[0012] First Embodiment [System Configuration] FIG. 1 is a diagram illustrating an example of the configuration of an authentication system according to the first embodiment.

[0013] As shown in FIG. 1, the authentication system 1 includes a terminal device 100 and a server device 200.

[0014] The terminal device 100 is installed near an entrance to an area (entry restricted area) where entry is restricted to persons other than those registered in advance, such as an office building or a conference room. The terminal device 100 also acquires matching information used for face matching processing in the server device 200 and transmits the acquired matching information to the server device 200. When the terminal device 100 detects that entry to the entry restricted area is permitted based on determination result information (described later) received after transmitting the matching information, the terminal device 100 performs control to open the entrance door or gate leading to the entry restricted area.

[0015] The server device 200 performs a face matching process to match the matching information transmitted from the terminal device 100 with the registration information including the registered face image, and obtains, as a processing result of the face matching process, determination result information indicating whether or not to permit entry into the entry-restricted area. The server device 200 also transmits the determination result information obtained as described above to the terminal device 100.

[0016] (Terminal Device) FIG. 2A is a diagram for explaining the appearance of the front side of the terminal device according to the first embodiment.

[0017] As shown in Fig. 2A, the terminal device 100 is configured as a plate-shaped terminal. A thermosensor 115, a camera 116, and a touch panel 118 are provided on a portion of the front surface of the terminal device 100 that is covered with a transparent cover 120. A human presence sensor 117 and a speaker 119 are provided on the lower part of the terminal device 100. A plurality of holes 121 are provided on the lower part of the front surface of the terminal device 100, and are used for both detecting the presence or absence of a person with the human presence sensor 117 and outputting sound from the speaker 119. In other words, the plurality of holes 121 contribute to saving space on the front surface of the terminal device 100.

[0018] The thermosensor 115 detects the body surface temperature of a person standing in front of or near the terminal device 100. In other words, the thermosensor 115 detects the body surface temperature of a person entering the entrance-restricted area.

[0019] The camera 116 captures an image by photographing a person standing in front of or near the terminal device 100. In other words, the camera 116 captures an image by photographing a visitor entering an entry-restricted area.

[0020] The human presence sensor 117 detects the presence or absence of a person in front of or near the terminal device 100. In other words, the human presence sensor 117 detects the presence or absence of an entrant entering an entry-restricted area. The human presence sensor 117 also detects infrared rays emitted from a person standing in front of or near the terminal device 100 through at least one hole 121.

[0021] The touch panel 118 functions as a display unit that displays information related to the procedure for entering an entry-restricted area to a person standing in front of or near the terminal device 100. The touch panel 118 also functions as an input unit that allows a person standing in front of or near the terminal device 100 to input instructions and information using an input interface such as a GUI (Graphical User Interface) button.

[0022] The speaker 119 outputs audio guidance relating to the procedure for entering the restricted entry area to a person standing in front of or near the terminal device 100. The speaker 119 also outputs the audio guidance through a plurality of holes 121.

[0023] Fig. 2B is a diagram showing an example in which a rear unit is attached to the rear side of the terminal device according to the first embodiment. Fig. 2C is a diagram showing an example in which an extension unit is attached to the rear unit of Fig. 2B.

[0024] On the other hand, the rear side of the terminal device 100 has a configuration that allows a rear unit 130 as shown in Fig. 2B to be detachably attached. Also, the rear unit 130 has a configuration that allows an extension unit 131 as shown in Fig. 2C to be detachably attached.

[0025] 3 and 4 are diagrams for explaining installation examples of the terminal device according to the first embodiment.

[0026] As an example, as shown in FIG. 3, the terminal device 100 is installed on a wall near a door leading to an entry-restricted area such as a conference room, in a position where it can capture an image of the face of a visitor NP entering the entry-restricted area.

[0027] In another example, the terminal device 100 is installed in a state supported by a support member SM at a security gate leading to an entry-restricted area of ​​an office building or the like, as shown in Fig. 4. The support member SM is configured to be able to adjust the orientation and height of the terminal device 100 so that the face of a visitor NP can be photographed.

[0028] FIG. 5 is a diagram illustrating an example of a functional configuration of a terminal device according to the first embodiment.

[0029] As shown in FIG. 5, the terminal device 100 has a communication unit 111, a processor 112, a memory 113, a recording medium 114, a thermosensor 115, a camera 116, a human presence sensor 117, a touch panel 118, and a speaker 119.

[0030] The communication unit 111 is configured to be able to communicate with the server device 200. In other words, the communication unit 111 is configured to be able to exchange information and data with the server device 200.

[0031] The processor 112 is configured with a CPU (Central Processing Unit) and the like, and executes a prepared program to control the entire terminal device 100. The processor 112 may be a GPU (Graphics Processing Unit) or an FPGA (Field-Programmable Gate Array).

[0032] The processor 112 performs face detection processing to detect a face from an image captured by the camera 116. The processor 112 also performs feature extraction processing to extract feature amounts representing features such as the eyes and nose included in the face detected by the face detection processing. That is, the processor 112 acquires the feature amounts extracted by the feature extraction processing as matching information. The matching information acquired by the processor 112 is transmitted to the server device 200 via the communication unit 111.

[0033] According to this embodiment, the processor 112 can perform different feature extraction processes depending on whether a mask is worn on a face detected by face detection processing.

[0034] Specifically, for example, when a face detected by face detection processing is not wearing a mask, processor 112 performs a normal feature extraction process that extracts features from the entire face. Also, for example, when a face detected by face detection processing is wearing a mask, processor 112 performs a special feature extraction process that extracts features with emphasis on the area around the eyes included in the face.

[0035] When processor 112 detects that entry to the entry restricted area has been permitted based on the determination result information received by communication unit 111 after the transmission of the matching information, it opens the entrance door or gate leading to the entry restricted area. Furthermore, when processor 112 detects that entry to the entry restricted area has not been permitted based on the determination result information received by communication unit 111 after the transmission of the matching information, it keeps the entrance door or gate leading to the entry restricted area closed. Furthermore, processor 112 keeps the entrance door or gate leading to the entry restricted area open if the face of the entrant permitted to enter the entry restricted area is within the field of view of camera 116 during the period from when it detected that entry to the entry restricted area has been permitted until a predetermined time has elapsed.

[0036] The processor 112 has functions as an input reception screen generating means, a menu screen generating means, and a control means.

[0037] The memory 113 is configured by a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The memory 113 is also used as a working memory while the processor 112 is executing various processes.

[0038] The recording medium 114 is a non-volatile, non-transitory recording medium such as a disk-shaped recording medium or a semiconductor memory, and is configured to be detachable from the terminal device 100. The recording medium 114 also stores various programs to be executed by the processor 112. When the terminal device 100 executes various processes, the programs stored in the recording medium 114 are loaded into the memory 113 and executed by the processor 112.

[0039] (Server device) FIG. 6 is a diagram illustrating an example of a functional configuration of the server device according to the first embodiment.

[0040] As shown in FIG. 6, the server device 200 includes a communication unit 211, a processor 212, a memory 213, a recording medium 214, and a database 215.

[0041] The communication unit 211 is configured to be able to communicate with the terminal device 100. In other words, the communication unit 211 is configured to be able to exchange information and data with the terminal device 100.

[0042] The processor 212 is configured with a CPU or the like, and controls the entire server device 200 by executing a program prepared in advance. The processor 212 may be a GPU or an FPGA. The processor 212 also performs face matching processing to match the matching information received by the communication unit 211 with registration information including registered face images stored in the database 215. The processor 212 also acquires, as a processing result of the face matching processing, determination result information indicating whether or not entry to the entry-restricted area is permitted. The determination result information acquired by the processor 212 is transmitted to the terminal device 100 via the communication unit 211.

[0043] In this embodiment, the face matching process may, for example, be a process for determining whether a feature included in the matching information is similar to a feature extracted from a registered face image. Furthermore, in this embodiment, for example, if the two feature values ​​are similar to each other, determination result information indicating that entry to the restricted entry area is permitted may be acquired. Furthermore, in this embodiment, for example, if the two feature values ​​are far from each other, determination result information indicating that entry to the restricted entry area is not permitted may be acquired.

[0044] The memory 213 is configured by a ROM, a RAM, etc. The memory 213 is also used as a working memory while the processor 212 is executing various processes.

[0045] The recording medium 214 is a non-volatile, non-transitory recording medium such as a disk-shaped recording medium or a semiconductor memory, and is configured to be detachable from the server device 200. The recording medium 214 also stores various programs to be executed by the processor 212. When the server device 200 executes various processes, the programs stored in the recording medium 214 are loaded into the memory 213 and executed by the processor 212.

[0046] The database 215 stores registration information including registered face images. The database 215 also stores information about people who have permission to enter the restricted entry area, linked to the registration information.

[0047] The registered facial image corresponds to an image obtained by photographing the face of a person who has permission to enter the restricted entry area in a state in which the person can be identified. In this embodiment, the registration information may include identification information that can be used to identify a person who has permission to enter the restricted entry area, such as an ID number. In this embodiment, the registration information may also include information related to a certificate certifying that the person has been vaccinated against a specific disease (hereinafter referred to as a vaccination certificate). In this embodiment, the registration information may also include information related to the attributes of a person who has permission to enter the restricted entry area, such as age. In addition, the registration information may include feature information extracted from a facial image instead of a facial image.

[0048] (Processing flow) Next, we will explain the processing performed in the authentication system 1. Fig. 7 is a flowchart for explaining the processing performed in the authentication system according to the first embodiment.

[0049] First, the processor 112 determines whether or not a person has been detected by the human sensor 117 (step S11).

[0050] When the motion sensor 117 does not detect a person (step S11: NO), the processor 112 maintains the terminal device 100 in a standby state (sleep state). When the motion sensor 117 detects a person (step S11: YES), the processor 112 transitions the terminal device 100 from the standby state to the active state, and generates a standby screen D11 as shown in Fig. 8 and displays it on the touch panel 118 (step S12). Fig. 8 is a diagram showing an example of a standby screen displayed on the terminal device in response to the processing of Fig. 7.

[0051] The standby screen D11 is a screen generated when the facial authentication process (step S16 described below) has not yet been performed on the visitor NP. In other words, the standby screen D11 is a screen that is displayed before facial authentication of the visitor NP is performed. The standby screen D11 is also configured as an input reception screen having a message area MA11 described below. The standby screen D11 also has a camera image area CA and a GUI area GA.

[0052] The camera image area CA is configured as an area for displaying a live view of a subject such as a visitor NP present within the angle of view of the camera 116.

[0053] The GUI area GA is configured as an area for displaying text indicating the status of the terminal device 100, and an input interface for inputting instructions and information to the terminal device 100. The GUI area GA also has a message area MA11.

[0054] The message area MA11 is an area for displaying a message regarding entry into the restricted entry area. The message area MA11 is also configured as an area that functions as a button that can be tapped by the visitor NP. In other words, the message area MA11 is configured as an area that accepts tapping by the visitor NP who is the subject of face authentication to determine whether or not to allow entry into the restricted entry area. The message area MA11 also displays a message ME11 that reads, "Please stand at the front."

[0055] Processor 112 determines whether a tap operation on message area MA11 is performed within a certain period of time (step S13).

[0056] If a tap operation on message area MA11 is performed within a certain period of time (step S13: YES), processor 112 generates menu screen D12 as shown in Fig. 9 and displays it on touch panel 118 (step S14). Fig. 9 is a diagram showing an example of a menu screen to which a transition can be made from the standby screen of Fig. 8.

[0057] The menu screen D12 is a screen that appears after transition from the standby screen D11 in response to a tap operation on the message area MA11. The menu screen D12 also has a button area MB12.

[0058] The button area MB12 is an area for displaying menu items related to either the standby screen D11 or the message ME11, i.e., menu items according to the situation before the face authentication process is performed. The button area MB12 is also configured as an area having the function of a button that can be tapped by the visitor NP. The button area MB12 also displays a menu item MK12 that corresponds to the phrase "How to Use."

[0059] For example, when a tap operation is performed on the button area MB12, the processor 112 generates a screen for explaining how to use the terminal device 100 and displays it on the touch panel 118.

[0060] Processor 112 determines whether an instruction to end the display of menu screen D12 has been given by, for example, a tap operation on an area other than button area MB12 on menu screen D12 (step S15).

[0061] If an instruction to end the display of menu screen D12 is given (step S15: YES), processor 112 displays standby screen D11 again (step S12). If an instruction to end the display of menu screen D12 is not given (step S15: NO), processor 112 maintains the display of menu screen D12 (step S14). Note that, according to the present embodiment, processor 112 may display standby screen D11 again if a tap operation is not performed on button area MB12 within a certain time period after the start of display of menu screen D12.

[0062] On the other hand, if a tap operation on the message area MA11 is not performed within a certain period of time (step S13: NO), face recognition processing is performed (step S16), which corresponds to a series of processes including face detection processing by processor 112, feature extraction processing by processor 112, and face matching processing by processor 212.

[0063] Processor 112 determines whether or not the face authentication process has been successful based on the determination result information obtained as a result of the process in step S16 (step S17).

[0064] Specifically, the processor 112 determines that the facial authentication process has failed when determination result information indicating an authentication error is obtained, for example, due to the inability to detect the face of the visitor NP from the image captured by the camera 116. Furthermore, the processor 112 determines that the facial authentication process has been successful when determination result information indicating whether or not the visitor NP is permitted to enter the restricted entry area is obtained.

[0065] If the processor 112 determines that the facial authentication process has failed (step S17: NO), it generates an authentication failure screen D13 as shown in FIG. 10 and displays it on the touch panel 118 (step S18). The authentication failure screen D13 is a screen that is displayed when facial authentication of the visitor NP has failed. Furthermore, when a certain time has elapsed since the display of the authentication failure screen D13 began, the processor 112 displays the standby screen D11 again (step S12). FIG. 10 is a diagram showing an example of an authentication failure screen that is displayed on the terminal device in response to the processing of FIG. 7.

[0066] The authentication failure screen D13 corresponds to the standby screen D11 with a message area MA13 provided instead of the message area MA11.

[0067] The message area MA13 is an area for displaying a message regarding entry into the restricted entry area. The message area MA13 also displays a message ME13 that reads "Authentication failed."

[0068] If the processor 112 determines that the face authentication process is successful (step S17: YES), it performs control related to lifting the entry restriction at a predetermined entrance to the entry-restricted area (the entrance where the terminal device 100 is installed) (step S19).

[0069] Specifically, the processor 112 performs control related to lifting entry restrictions at a specified entrance to an entry-restricted area, for example, by controlling the unlocking of the door at the specified entrance or the opening of the gate at the specified entrance.

[0070] After performing the process (control) of step S19, the processor 112 ends the series of processes shown in Fig. 7. After ending the series of processes shown in Fig. 7, when the human sensor 117 no longer detects a person, or when a certain period of time has elapsed, the processor 112 shifts the terminal device 100 from the active state to the standby state.

[0071] According to the present embodiment, the processor 112 may, for example, display another screen D1X obtained by changing at least a part of the standby screen D11 during the period in which the facial authentication process of step S16 is being performed. Furthermore, according to the present embodiment, the processor 112 may, for example, display a menu screen D1Y to which the aforementioned screen D1X can be transitioned. That is, according to the present embodiment, the processor 112 may generate a different screen depending on the authentication status of the facial authentication of the visitor NP, and display the screen on the touch panel 118.

[0072] As described above, according to this embodiment, when a tap operation is performed on a message area or a button area provided on the input reception screen, a menu screen including one or more menu items can be generated and displayed on the touch panel 118. Therefore, according to this embodiment, it is possible to provide a user interface that allows access to information corresponding to the authentication status of face authentication through a simple operation.

[0073] Second Embodiment FIG. 11 is a flowchart illustrating the processing performed in the authentication system according to the second embodiment.

[0074] In this embodiment, the processing will be described as being performed in an authentication system having the same functional configuration and hardware configuration as the respective parts of the authentication system 1 of the first embodiment. In addition, in this embodiment, the processing performed after it is determined in step S17 that the face authentication processing has been successful is different from that in the first embodiment, while the other parts are the same as those in the first embodiment. Therefore, in this embodiment, of the processing shown in Fig. 11, the description of the processing of steps S11 to S18 will be omitted, and a specific description of the processing of steps S31 to S40 will be given.

[0075] If the processor 112 determines that the facial authentication process is successful (step S17: YES), it determines whether the visitor NP is permitted to enter the restricted entry area based on the determination result information obtained as a result of the processing of step S16 (step S31).

[0076] When visitor NP is not permitted to enter the admission-restricted area (step S31: NO), processor 112 generates an admission denial screen D14 as shown in Fig. 12 and displays it on touch panel 118 (step S32). Fig. 12 is a diagram showing an example of the admission denial screen displayed on the terminal device in response to the processing of Fig. 11.

[0077] The entry denial screen D14 corresponds to the standby screen D11 with a message area MA14 instead of the message area MA11. In other words, the entry denial screen D14 is configured as an input acceptance screen having the message area MA14.

[0078] The message area MA14 is an area for displaying a message regarding entry into the entry-restricted area. The message area MA14 is also configured as an area that functions as a button that can be tapped by the visitor NP. That is, the message area MA14 is configured as an area that accepts tapping by the visitor NP who is the subject of face authentication to determine whether or not to allow entry into the entry-restricted area. The message area MA14 also displays a message ME14 that reads "Permission Denied," informing the visitor NP that permission to enter the entry-restricted area has not been granted.

[0079] Processor 112 determines whether a tap operation has been performed on message area MA14 (step S33).

[0080] If a tap operation on message area MA14 is performed within a certain period of time (step S33: YES), processor 112 generates menu screen D15 as shown in Fig. 13 and displays it on touch panel 118 (step S34). If a tap operation on message area MA14 is not performed within a certain period of time (step S33: NO), processor 112 displays standby screen D11 again (step S12). Fig. 13 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of Fig. 12.

[0081] The menu screen D15 is a screen that appears after transition from the entry denial screen D14 in response to a tap operation on the message area MA14. The menu screen D15 corresponds to the menu screen D12 with button areas MB151, MB152, and MB153 instead of the button area MB12.

[0082] Button areas MB151, MB152, and MB153 are areas for displaying menu items related to either the entry denial screen D14 or the message ME14, i.e., menu items corresponding to situations in which entry into the entry-restricted area by facial recognition is not possible. Furthermore, button areas MB151, MB152, and MB153 are configured as areas that function as buttons that can be tapped by the visitor NP. Furthermore, button area MB151 displays menu item MK151, which corresponds to the phrase "Enter PIN." Furthermore, button area MB152 displays menu item MK152, which corresponds to the phrase "Notify Administrator." Furthermore, button area MB153 displays menu item MK153, which corresponds to the phrase "How to Use." In other words, the menu screen D15 corresponds to a screen including menu items for enabling authentication methods other than facial recognition.

[0083] For example, when a tap operation is performed on button area MB151, processor 112 generates a screen that prompts the visitor NP to enter a PIN number and displays it on touch panel 118. Also, when a tap operation is performed on button area MB152, processor 112 generates a screen that can inform the facility manager that entry to the admission-restricted area is not permitted and displays it on touch panel 118. Also, when a tap operation is performed on button area MB153, processor 112 generates a screen that explains how to use terminal device 100 and displays it on touch panel 118.

[0084] According to this embodiment, the menu screen D15 may be provided with a button area for performing authentication by a method other than inputting a personal identification number.

[0085] Processor 112 determines whether an instruction to end the display of menu screen D15 has been given, for example, by a tap operation on an area other than button areas MB151, MB152, and MB153 on menu screen D15 (step S35).

[0086] When an instruction to end the display of menu screen D15 is given (step S35: YES), processor 112 causes standby screen D11 to be displayed again (step S12). When an instruction to end the display of menu screen D15 is not given (step S35: NO), processor 112 maintains the display of menu screen D15 (step S34). Note that, according to the present embodiment, processor 112 may cause standby screen D11 to be displayed again if a tap operation is not performed on any of button areas MB151, MB152, and MB153 within a certain time period after the start of display of menu screen D15.

[0087] On the other hand, if the visitor NP is permitted to enter the restricted entry area (step S31: YES), the processor 112 controls the lifting of the entry restriction at a specified entrance to the restricted entry area (the entrance where the terminal device 100 is installed) (step S36).

[0088] Specifically, the processor 112 performs control related to lifting entry restrictions at a specified entrance to an entry-restricted area, for example, by controlling the unlocking of the door at the specified entrance or the opening of the gate at the specified entrance.

[0089] After performing the control of step S36, processor 112 generates an admission permission screen D16 as shown in Fig. 14 and displays it on touch panel 118 (step S37). Admission permission screen D16 is a screen that is displayed when face authentication of visitor NP is successful. Fig. 14 is a diagram showing an example of the admission permission screen that is displayed on the terminal device in response to the processing of Fig. 11.

[0090] The admission permission screen D16 corresponds to the standby screen D11 with a message area MA16 instead of the message area MA11. In other words, the admission permission screen D16 is configured as an input acceptance screen having the message area MA16.

[0091] The message area MA16 is an area for displaying a message regarding entry into the restricted entry area. The message area MA16 is also configured as an area that functions as a button that can be tapped by the visitor NP. In other words, the message area MA16 is configured as an area that accepts tapping by the visitor NP who is the subject of face authentication to determine whether or not to allow entry into the restricted entry area. The message area MA16 also displays a message ME16 that reads "Authentication completed."

[0092] Processor 112 determines whether a tap operation has been performed on message area MA16 (step S38).

[0093] If a tap operation on message area MA16 is performed within a certain period of time (step S38: YES), processor 112 generates menu screen D17 as shown in Fig. 15 and displays it on touch panel 118 (step S39). Fig. 15 is a diagram showing an example of a menu screen to which a transition can be made from the admission permission screen in Fig. 14.

[0094] The menu screen D17 is a screen that appears after transition from the admission permission screen D16 in response to a tap operation on the message area MA16. The menu screen D17 corresponds to the menu screen D12 with button areas MB171 and MB172 instead of the button area MB12.

[0095] Button areas MB171 and MB172 are areas for displaying menu items related to either the admission permission screen D16 or the message ME16, i.e., menu items according to the situation in which admission to the admission-restricted area by facial recognition is permitted. Furthermore, button areas MB171 and MB172 are configured as areas that function as buttons that can be tapped by an attendee NP. Furthermore, button area MB171 displays menu item MK171, which corresponds to the word "ON." Furthermore, button area MB172 displays menu item MK172, which corresponds to the word "OFF."

[0096] For example, when a tap operation is performed on button area MB171, processor 112 performs control to turn on the lights and the like in the room set as the entry-restricted area. Also, for example, when a tap operation is performed on button area MB172, processor 112 performs control to turn off the lights and the like in the room set as the entry-restricted area.

[0097] Processor 112 determines whether an instruction to end the display of menu screen D17 has been given by, for example, a tap operation on an area other than button areas MB171 and MB172 on menu screen D17 (step S40).

[0098] If an instruction to end the display of the menu screen D17 is given (step S40: YES), processor 112 displays admission permission screen D16 again (step S37). If an instruction to end the display of the menu screen D17 is not given (step S40: NO), processor 112 maintains the display of menu screen D17 (step S39). Note that, according to the present embodiment, processor 112 may display admission permission screen D16 again if a tap operation is not performed on either button area MB171 or MB172 within a certain time period after the start of display of menu screen D17.

[0099] On the other hand, if a tap operation on message area MA14 is not performed within a certain time period (step S38: NO), processor 112 ends the series of processes shown in Fig. 11. After the series of processes shown in Fig. 11 is completed, processor 112 causes terminal device 100 to transition from the active state to the standby state when human sensor 117 no longer detects a person, or when a certain time period has elapsed.

[0100] That is, according to the processing described above, the processor 112 can generate different screens as input reception screens depending on the authentication status of the face authentication of the visitor NP, and display them on the touch panel 118. Furthermore, according to the present embodiment (and the first embodiment), the authentication status of the face authentication described above includes, for example, four states: a pre-authentication (not yet performed) state, a state in which authentication is in progress, a state in which authentication has failed, and a state in which authentication has succeeded.

[0101] According to this embodiment, if the face of visitor NP is within the field of view of camera 116 between the time when the processing of step S31 is performed and the time when a predetermined time has elapsed, processor 112 may repeatedly perform the processing of steps S37 and S38, and may also perform the processing of steps S39 and S40 as necessary.

[0102] As described above, according to this embodiment, when a tap operation is performed on a message area or a button area provided on the input reception screen, a menu screen including one or more menu items can be generated and displayed on the touch panel 118. Therefore, according to this embodiment, it is possible to provide a user interface that allows access to information corresponding to the authentication status of face authentication through a simple operation.

[0103] <Third embodiment> FIG. 16 is a flowchart illustrating the processing performed in the authentication system according to the third embodiment.

[0104] In this embodiment, the processing will be described as being performed in an authentication system having the same functional configuration and hardware configuration as the respective parts of the authentication system 1 of the first embodiment. In addition, in this embodiment, the processing performed after it is determined in step S17 that the face authentication processing has been successful is different from that in the first embodiment, while the other parts are the same as those in the first embodiment. Therefore, in this embodiment, of the processing shown in Fig. 16, the description of the processing of steps S11 to S18 will be omitted, and a specific description of the processing of steps S51 to S55 will be given.

[0105] If the processor 112 determines that the facial authentication process is successful (step S17: YES), it determines whether the body temperature of the visitor NP is normal based on the body surface temperature of the visitor NP detected by the thermosensor 115 (step S51).

[0106] If the body surface temperature of the visitor NP is below a predetermined value, the processor 112 determines that the body temperature of the visitor NP is normal (step S51: YES), and ends the series of processes shown in Fig. 16. After the series of processes shown in Fig. 16 is completed, the processor 112 transitions the terminal device 100 from the active state to the standby state when the human sensor 117 no longer detects a person, or when a certain period of time has passed.

[0107] If the body surface temperature of the visitor NP is equal to or higher than a predetermined value, the processor 112 determines that the body temperature of the visitor NP is abnormal (step S51: NO), and generates an alert screen D91 as shown in Fig. 17 and displays it on the touch panel 118 (step S52). Fig. 17 is a diagram showing an example of the alert screen displayed on the terminal device in response to the processing of Fig. 16.

[0108] The alert screen D91 corresponds to the standby screen D11 with a message area MA91 instead of the message area MA11. In other words, the alert screen D91 is configured as an input acceptance screen having the message area MA91.

[0109] The message area MA91 is an area for displaying a message relating to the status of the visitor NP. The message area MA91 is also configured as an area that functions as a button that can be tapped by the visitor NP. In other words, the message area MA91 is configured as an area that accepts tapping by the visitor NP who is the subject of facial recognition. The message area MA91 also displays a message ME91 that reads "Abnormal body temperature" as a message to inform the visitor NP that their body temperature is abnormal.

[0110] Processor 112 determines whether or not a tap operation has been performed on message area MA91 (step S53).

[0111] If a tap operation on message area MA91 is performed within a certain period of time (step S53: YES), processor 112 generates a menu screen D92 as shown in FIG. 18 and displays it on touch panel 118 (step S54). If a tap operation on message area MA91 is not performed within a certain period of time (step S53: NO), processor 112 ends the series of processes in FIG. 16. After the series of processes shown in FIG. 16 is completed, processor 112 transitions terminal device 100 from the active state to the standby state when human presence sensor 117 no longer detects a person, or when a certain period of time has elapsed. FIG. 18 is a diagram showing an example of a menu screen to which a transition can be made from the alert screen of FIG. 17.

[0112] The menu screen D92 is a screen that appears after transition from the alert screen D91 in response to a tap operation on the message area MA91. The menu screen D92 corresponds to the menu screen D12 with a button area MB92 provided instead of the button area MB12 of the menu screen D12.

[0113] Button area MB92 is an area for displaying menu items related to either the alert screen D91 or the message ME91, i.e., menu items according to the situation in which an abnormal body temperature is confirmed after facial authentication. Button area MB92 is also configured as an area that functions as a button that can be tapped by the visitor NP. Button area MB92 also displays menu item MK92, which corresponds to the phrase "Visit a medical institution."

[0114] Then, for example, when a tap operation is performed on button area MB92, processor 112 generates a screen for providing information on medical institutions that are available for consultation near the location where terminal device 100 is installed, and displays the screen on touch panel 118.

[0115] Processor 112 determines whether or not an instruction to end the display of menu screen D92 has been given by, for example, a tap operation on an area other than button area MB92 on menu screen D92 (step S55).

[0116] If an instruction to end the display of the menu screen D92 is given (step S55: YES), processor 112 ends the series of processes in Fig. 16. After the series of processes shown in Fig. 16 is finished, processor 112 causes terminal device 100 to transition from the active state to the standby state when the human presence sensor 117 no longer detects a person, or when a certain period of time has elapsed. If an instruction to end the display of the menu screen D92 is not given (step S55: NO), processor 112 maintains the display of menu screen D92 (step S54).

[0117] According to the present embodiment, for example, when it is determined that the body temperature of the visitor NP is normal, the processor 112 may display another screen D9X that is at least a part of the alert screen D91. Furthermore, according to the present embodiment, the processor 112 may display, for example, a menu screen D9Y to which the above-mentioned screen D9X can be transitioned. That is, according to the present embodiment, the processor 112 may generate a different screen depending on whether the body temperature of the visitor NP is normal or not, as an input acceptance screen in a state where face authentication of the visitor NP has been successful, and display the different screen on the touch panel 118.

[0118] As described above, according to this embodiment, when a tap operation is performed on a message area or a button area provided on the input reception screen, a menu screen including one or more menu items can be generated and displayed on the touch panel 118. Therefore, according to this embodiment, it is possible to provide a user interface that allows access to information corresponding to the authentication status of face authentication through a simple operation.

[0119] [Variations] Modifications of the above embodiment will be described below. For simplicity, specific descriptions of parts to which the above-described processes can be applied will be omitted as appropriate.

[0120] (Variation 1) FIG. 19 is a diagram showing a modified example of the standby screen displayed on the terminal device.

[0121] In step S12, processor 112 may generate a standby screen D21 as shown in FIG. 19 and display it on touch panel 118, instead of standby screen D11 shown in FIG.

[0122] The standby screen D21 corresponds to a standby screen D11 in which a message area MA21 is provided in place of the message area MA11, and a button area MB21 is added to the GUI area GA of the standby screen D11. In other words, the standby screen D21 is configured as an input acceptance screen having the button area MB21.

[0123] The message area MA21 is an area for displaying a message regarding entry into an entry-restricted area. Also, the message area MA21 displays a message ME11 similar to that displayed on the standby screen D11.

[0124] The button area MB21 is configured as an area having the function of a button that can be tapped by the visitor NP. That is, the button area MB21 is an area provided separately from the message area MA21, and is configured as an area that accepts tapping by the visitor NP who is the subject of face authentication to determine whether or not to allow entry into the restricted entry area.

[0125] According to the screen configuration of standby screen D21 as described above, for example, if a tap operation on button area MB21 is performed within a certain period of time, processor 112 can generate menu screen D12 and display it on touch panel 118. Furthermore, according to the screen configuration of standby screen D21 as described above, for example, if a tap operation on button area MB21 is not performed within a certain period of time, face authentication processing corresponding to the processing of step S16 is performed.

[0126] The display mode of the standby screen D21 illustrated in FIG. 19 can be similarly applied to the entry denial screen D14 and the entry permission screen D16.

[0127] Furthermore, according to the standby screen D21 exemplified in FIG. 19, a plurality of button areas may be provided in the GUI area GA.

[0128] Furthermore, according to the standby screen D21 exemplified in FIG. 19, the button area MB12 of the menu screen D12 may be provided instead of the button area MB21.

[0129] (Variation 2) FIG. 20 shows a modified example of the entry denial screen displayed on the terminal device.

[0130] For example, immediately after step S31, processor 112 may determine whether the body surface temperature of visitor NP detected by thermosensor 115 is equal to or higher than a predetermined value. Furthermore, if processor 112 determines that the body surface temperature of visitor NP detected by thermosensor 115 is equal to or higher than a predetermined value, processor 112 may infer that the visitor NP is in poor health, and may generate an entry denial screen D31 as shown in Fig. 20 and display it on touch panel 118. Furthermore, processor 112 may perform the processing (control) of step S36 if the body surface temperature of visitor NP detected by thermosensor 115 is lower than a predetermined value.

[0131] The entry denial screen D31 corresponds to the entry denial screen D14 with a message area MA31 instead of the message area MA14. In other words, the entry denial screen D31 is configured as an input reception screen having the message area MA31.

[0132] The message area MA31 is an area for displaying a message regarding entry into the restricted entry area. The message area MA31 is also configured as an area that functions as a button that can be tapped by the visitor NP. The message area MA31 also displays a message ME31 that reads "No Entry" to inform the visitor NP that they are not allowed to enter the restricted entry area.

[0133] According to the screen configuration of the entry denial screen D31 described above, for example, when a tap operation is performed on the message area MA31 within a certain period of time, the processor 112 can generate a menu screen D32 as shown in Fig. 21 and display it on the touch panel 118. Fig. 21 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of Fig. 20.

[0134] The menu screen D32 is a screen that appears after transition from the entry denial screen D31 in response to a tap operation on the message area MA31. The menu screen D32 corresponds to the menu screen D12 with a button area MB32 instead of the button area MB12.

[0135] The button area MB32 is an area for displaying menu items related to either the entry denial screen D31 or the message ME31, i.e., menu items corresponding to a situation in which entry is not permitted due to fever despite having passed facial authentication. The button area MB32 is also configured as an area having the function of a button that can be tapped by the visitor NP. The button area MB32 also displays a menu item MK32 that corresponds to the phrase "Visit a medical institution."

[0136] Then, for example, when a tap operation is performed on button area MB32, processor 112 generates a screen for providing information on medical institutions that are available for consultation near the location where terminal device 100 is installed, and displays the screen on touch panel 118.

[0137] According to this modified example, when the processor 112 recognizes that the image obtained by the camera 116 contains a vaccination certificate, the processor 112 may perform the processing (control) of step S36 without performing the processing of determining whether or not to allow entry into the restricted entry area based on the body surface temperature detected by the thermosensor 115.

[0138] (Variation 3) FIG. 22 is a diagram showing a modified example of the entry denial screen displayed on the terminal device.

[0139] For example, immediately after step S31, processor 112 may determine whether or not visitor NP is wearing a mask. Furthermore, if processor 112 determines that visitor NP is not wearing a mask, processor 112 may generate an entry denial screen D41 as shown in FIG. 22 and display it on touch panel 118.

[0140] The entry denial screen D41 corresponds to the entry denial screen D 14 with a message area MA41 instead of the message area MA14. In other words, the entry denial screen D41 is configured as an input reception screen having the message area MA41.

[0141] The message area MA41 is an area for displaying messages regarding entry into the restricted entry area. The message area MA41 is also configured as an area that functions as a button that can be tapped by the visitor NP. The message area MA41 also displays a message ME41 that reads "Please wear a mask" as a message to encourage the visitor NP entering the restricted entry area to wear a mask.

[0142] According to the screen configuration of the entry denial screen D41 described above, for example, when a tap operation is performed on the message area MA41 within a certain period of time, the processor 112 can generate a menu screen D42 as shown in Fig. 23 and display it on the touch panel 118. Fig. 23 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of Fig. 22.

[0143] The menu screen D42 is a screen that appears after transition from the entry denial screen D41 in response to a tap operation on the message area MA41. The menu screen D42 corresponds to the menu screen D12 with button areas MB421 and MB422 instead of button area MB12.

[0144] Button areas MB421 and MB422 are areas for displaying menu items related to either the entry denial screen D41 or the message ME41, i.e., menu items corresponding to a situation in which entry is not permitted due to not wearing a mask despite having passed facial authentication. Button areas MB421 and MB422 are also configured as areas that function as buttons that can be tapped by an entry person NP. Button area MB421 displays menu item MK421, which corresponds to the words "Mask worn." Button area MB422 displays menu item MK422, which corresponds to the words "Mask not possessed."

[0145] Then, for example, when a tap operation is performed on button area MB421, processor 112 re-determines whether or not visitor NP is wearing a mask. Thereafter, when processor 112 determines that visitor NP is wearing a mask, it performs the process (control) of step S36. Also, for example, when a tap operation is performed on button area MB422, processor 112 generates a screen for guiding visitor NP to places where masks can be obtained near the installation location of terminal device 100, and displays the screen on touch panel 118.

[0146] According to this modified example, for example, when the processor 112 detects that the entrant NP is wearing a mask while the entry denial screen D41 is being displayed, the processor 112 may perform the processing (control) of step S36 even if no tap operation is performed on the button area MB421.

[0147] Furthermore, according to this modification, for example, if the processor 112 determines that the visitor NP is wearing a mask, the processor 112 may display another admission permission screen D4X, which is at least a part of the admission permission screen D16, which has been modified. Furthermore, according to this modification, the processor 112 may display, for example, a menu screen D4Y, which can be transitioned from the aforementioned admission permission screen D4X. Furthermore, according to this modification, for example, if the processor 112 detects that the visitor NP is wearing a mask in an inappropriate manner, the processor 112 may display another admission denial screen D4P, which is at least a part of the admission denial screen D41, which has been modified. Furthermore, according to this modification, the processor 112 may display, for example, a menu screen D4Q, which can be transitioned from the aforementioned admission denial screen D4P. That is, according to the present embodiment, the processor 112 may generate a different screen depending on the state of the mask worn by the visitor NP, and display the screen on the touch panel 118 as an input acceptance screen when face authentication of the visitor NP has been successful. Furthermore, according to this modification, the above-mentioned mask wearing state includes, for example, three states: a state where the mask is not worn, a state where the mask is worn improperly, and a state where the mask is worn properly.

[0148] (Variation 4) FIG. 24 is a diagram showing an example of an entry denial screen displayed on the terminal device.

[0149] For example, in step S32, the processor 112 may generate an entry denial screen D51 as shown in FIG. 24 and display it on the touch panel 118 instead of the entry denial screen D14 to request the entry NP to fill out an entry consent form, which is a document that lists the matters that the entry NP must agree to before entering the entry-restricted area.

[0150] The entry denial screen D51 corresponds to the entry denial screen D14 with a message area MA51 instead of the message area MA14. In other words, the entry denial screen D51 is configured as an input reception screen having the message area MA51.

[0151] The message area MA51 is an area for displaying messages regarding entry into the restricted entry area. The message area MA51 is also configured as an area that functions as a button that can be tapped by the visitor NP. The message area MA51 also displays a message ME51 that reads "Please fill out the admission agreement form" to inform the visitor NP that they must fill out an admission agreement form to enter the restricted entry area.

[0152] According to the screen configuration of the entry denial screen D51 described above, for example, when a tap operation is performed on the message area MA51 within a certain period of time, the processor 112 can generate a menu screen D52 as shown in Fig. 25 and display it on the touch panel 118. Fig. 25 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of Fig. 24.

[0153] The menu screen D52 is a screen that appears after transition from the entry denial screen D51 in response to a tap operation on message area MA51. The menu screen D52 corresponds to the menu screen D12 with button areas MB521 and MB522 instead of button area MB12.

[0154] Button areas MB521 and MB522 are areas for displaying menu items related to either the entry denial screen D51 or the message ME51, i.e., menu items corresponding to a situation in which entry to the entry-restricted area by facial recognition is not permitted and consent by filling out an entry consent form cannot be confirmed. Button areas MB521 and MB522 are configured as areas that function as buttons that can be tapped by the visitor NP. Button area MB521 displays menu item MK521, which corresponds to the phrase "Display QR code (registered trademark) for the consent explanation site." Button area MB522 displays menu item MK522, which corresponds to the phrase "I agree to keep a record."

[0155] Then, for example, when a tap operation is performed on button area MB521, processor 112 generates a screen including text explaining the contents to be filled in the admission agreement and a QR code (registered trademark) corresponding to the URL of a website including an input form for the admission agreement, and displays the screen on touch panel 118. Also, for example, when a tap operation is performed on button area MB522, processor 112 performs processing to transmit the contents to be filled in the admission agreement on the website to server device 200, and then performs processing (control) of step S36. The contents to be filled in the admission agreement transmitted from terminal device 100 to server device 200 are stored in database 215 in a state linked to the registration information.

[0156] According to this modification, the processor 112 may be configured to transmit the body surface temperature of the visitor NP, detected by the thermosensor 115, when a tap operation is performed on button area MB522, together with the contents of the entry in the admission consent form to the server device 200. Also, according to this modification, the processor 112 may be configured to generate an authentication history relating to the results of face authentication of the visitor NP when a tap operation is performed on button area MB522, and transmit the generated authentication history to the server device 200 together with the contents of the entry in the admission consent form.

[0157] Furthermore, according to this modified example, if a tap operation is not performed on message area MA51 within a certain period of time, processor 112 may generate an entry denial screen including message ME31 and display it on touch panel 118.

[0158] (Variation 5) Fig. 26 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen in Fig. 12. In this modification, a case will be described in which the terminal device 100 is installed at the entrance of an apartment building, that is, a case in which the inside of the apartment building is an entry-restricted area.

[0159] For example, immediately after step S38, the processor 112 may determine, based on the registration information of the visitor NP acquired from the server device 200, whether or not the visitor NP is a resident of the apartment complex.

[0160] Furthermore, in step S39, for example, instead of the menu screen D17, the processor 112 may generate a different menu screen depending on the determination result as to whether or not the visitor NP is a resident of the apartment building, and display the generated menu screen on the touch panel 118. In other words, the processor 112 may generate a different screen depending on the attributes of the visitor NP as a menu screen in a state where face authentication of the visitor NP has been successful, and display the generated menu screen on the touch panel 118.

[0161] Furthermore, in step S33, for example, processor 112 may generate menu screen D62 as shown in FIG. 26 and display it on touch panel 118 instead of menu screen D15.

[0162] The menu screen D62 is a screen that appears after transition from the entry denial screen D14 in response to a tap operation on the message area MA14. The menu screen D62 corresponds to the menu screen D12 with button areas MB621 and MB622 instead of button area MB12.

[0163] Button areas MB621 and MB622 are areas for displaying menu items related to either the entry denial screen D14 or the message ME14, i.e., menu items corresponding to situations in which entry into the entry-restricted area by facial recognition is not possible. Button areas MB621 and MB622 are also configured as areas that function as buttons that can be tapped by the visitor NP. Button area MB621 displays menu item MK621, which corresponds to the phrase "Enter by other means." Button area MB622 displays menu item MK622, which corresponds to the phrase "Enter visitor information."

[0164] Then, for example, when a tap operation is performed on button area MB621, processor 112 generates a screen including contact information for the manager of the apartment complex and displays it on touch panel 118.

[0165] Furthermore, for example, when a tap operation is performed on button area MB622, processor 112 generates a screen for inputting visitor information, including the name and destination of visitor NP, and displays the screen on touch panel 118. Furthermore, when processor 112 detects that input of visitor information by visitor NP is complete, processor 112 performs processing for transmitting the visitor information and an image of the visitor NP's face obtained by camera 116 to server device 200. Then, according to this processing, the visitor information and image of visitor NP are transmitted from server device 200 to a resident of the apartment complex, and further, the resident, having confirmed the visitor information and the image, determines whether or not to permit entry of the visitor NP.

[0166] (Variation 6) FIG. 27 is a diagram showing an example of an entry denial screen displayed on the terminal device.

[0167] For example, immediately after step S31, the processor 112 may perform processing to detect the registration status of the vaccination certificate of the visitor NP based on the registration information of the visitor NP acquired from the server device 200.

[0168] Furthermore, processor 112 may perform the processes from step S36 onwards, for example, when it detects that the validity period (the period from the current date to the expiration date) of the registered vaccination certificate is longer than a predetermined period. In such a case, processor 112 performs the process of step S37, thereby generating admission permission screen D16 and displaying it on touch panel 118.

[0169] In addition, for example, if the processor 112 detects that a vaccination certificate has not been registered, or if it detects that the validity period of a registered vaccination certificate is less than a predetermined period, the processor 112 may generate an entry denial screen D71 as shown in Figure 27 and display it on the touch panel 118 instead of the entry denial screen D14.

[0170] That is, the processor 112 may generate a different screen depending on the attributes of the visitor NP as an input acceptance screen when face authentication of the visitor NP is successful, and display the screen on the touch panel 118.

[0171] The entry denial screen D71 corresponds to the entry denial screen D14 with a message area MA71 instead of the message area MA14. In other words, the entry denial screen D71 is configured as an input reception screen having the message area MA71.

[0172] The message area MA71 is an area for displaying messages regarding entry into the restricted entry area. The message area MA71 is also configured as an area that functions as a button that can be tapped by the visitor NP. The message area MA71 also displays a message ME71 that reads "Registration or re-registration of vaccination certificate is required," as a message to prompt the visitor NP to register or re-register their vaccination certificate.

[0173] According to the screen configuration of the entry denial screen D71 described above, for example, when a tap operation is performed on message area MA71 within a certain period of time, processor 112 can generate menu screen D72 as shown in Fig. 28 and display it on touch panel 118. Fig. 28 is a diagram showing an example of a menu screen to which a transition can be made from the entry denial screen of Fig. 27.

[0174] The menu screen D72 is a screen that appears after transition from the entry denial screen D71 in response to a tap operation on the message area MA71. The menu screen D72 corresponds to the menu screen D12 with a button area MB721 provided instead of the button area MB12 of the menu screen D12.

[0175] Button area MB721 is an area for displaying menu items related to either the entry denial screen D71 or the message ME71, i.e., menu items corresponding to a situation where entry is not permitted due to an incomplete registration of the vaccination certificate despite having passed facial authentication. Button area MB721 is also configured as an area that functions as a button that can be tapped by the visitor NP. Button area MB721 also displays menu item MK721, which corresponds to the phrase "Register Certificate."

[0176] For example, when a tap operation is performed on button area MB721, processor 112 generates a screen including a QR code (registered trademark) corresponding to the URL of a website that includes a registration form for registering a vaccination certificate, and displays the screen on touch panel 118.

[0177] According to this modification, for example, if processor 112 detects that the age of visitor NP is below a predetermined age, it may skip the process of detecting the registration status of the vaccination certificate of visitor NP and perform the processes from step S36 onwards. The age of visitor NP may be, for example, included in the registration information of visitor NP obtained from server device 200, or may be estimated based on an image of visitor NP taken by camera 116.

[0178] [Application example] The following will provide an overview of the case where the above embodiment is applied to applications other than opening an entrance door or gate leading to an entry-restricted area.

[0179] (Application example 1) The above embodiment can be applied to, for example, payment at the time of purchasing a product.

[0180] Specifically, when identity verification through facial authentication is completed, processor 112 can generate an authentication completion screen having a screen configuration substantially similar to that of admission permission screen D16 of FIG. 14 and display it on touch panel 118. Furthermore, when a tap operation is performed on the message area on the authentication completion screen described above, processor 112 can generate a menu screen including a plurality of button areas from which one of a plurality of pre-registered payment methods can be selected and display it on touch panel 118. Furthermore, when a tap operation is performed on the message area on the authentication completion screen described above, processor 112 can generate a menu screen including a plurality of button areas from which one of a plurality of types of points can be selected as payment points and display it on touch panel 118. Furthermore, when a tap operation is performed on the message area on the authentication completion screen described above, processor 112 can generate a menu screen including a button area from which one of a plurality of types of points can be selected as payment points and display it on touch panel 118. Furthermore, when a tap operation is performed on the message area on the authentication completion screen described above, processor 112 can generate a menu screen including a button area from which one of a plurality of types of points can be selected as payment points and display it on touch panel 118.

[0181] On the other hand, when identity verification by facial authentication is not possible, processor 112 can generate an authentication incomplete screen having a screen configuration substantially similar to entry denial screen D14 of Fig. 12 and display it on touch panel 118. Furthermore, when a tap operation is performed on the message area on the authentication incomplete screen described above, processor 112 can generate a menu screen including one or more button areas that allow a payment method other than the pre-registered payment methods to be selected and display it on touch panel 118.

[0182] (Application example 2) The above embodiment can be applied to, for example, an application in which passengers of public transportation such as buses decide their destinations.

[0183] Specifically, when identity verification by facial authentication is completed, the processor 112 can generate an authentication completion screen having a screen configuration substantially similar to the entry permission screen D16 of Fig. 14 and display it on the touch panel 118. Furthermore, when a tap operation is performed on the message area on the authentication completion screen, the processor 112 can generate a menu screen including a plurality of button areas that allow the passenger who has undergone identity verification to select one of a plurality of candidate destinations as an actual destination, based on the passenger's public transportation usage history, and display this menu screen on the touch panel 118. Note that the plurality of candidate destinations may include places that have been recorded as past destinations of the passenger who has undergone identity verification, or may include places that are recommended as destinations for the passenger.

[0184] <Fourth embodiment> FIG. 29 is a block diagram showing the functional configuration of an authentication device according to the fourth embodiment.

[0185] The terminal device 300 according to this embodiment has the same hardware configuration as the terminal device 100. The terminal device 300 also has an input acceptance screen generating means 311 and a menu screen generating means 312.

[0186] FIG. 30 is a flowchart for explaining the processing performed in the authentication device according to the fourth embodiment.

[0187] The input acceptance screen generating means 311 generates an input acceptance screen that includes a first area for displaying a message and accepts tap operations by a subject who is the subject of facial recognition in the first area or in a second area provided separately from the first area (step S71).

[0188] The menu screen generating means 312 generates a menu screen including one or more menu items as a screen to be displayed after transition from the input receiving screen in response to a tap operation being performed on the first area or the second area (step S72).

[0189] According to this embodiment, it is possible to provide a user interface that allows access to information according to the authentication status of face authentication through simple operations.

[0190] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0191] (Appendix 1) an input acceptance screen generating means for generating an input acceptance screen including a first area for displaying a message and for receiving a tap operation by a subject who is a target of face authentication in the first area or a second area provided separately from the first area; a menu screen generating means for generating a menu screen including one or more menu items as a screen to be displayed after transition from the input accepting screen in response to a tap operation being performed on the first area or the second area; An authentication device comprising:

[0192] (Appendix 2) the message is a message regarding entry into an entry-restricted area, The authentication device of Appendix 1, wherein the facial authentication is an authentication for determining whether or not entry into the input-restricted area is permitted.

[0193] (Appendix 3) The authentication device of Appendix 2, wherein the input acceptance screen generation means generates the input acceptance screen in at least one of the following cases: when the facial authentication has not been performed on the subject; when the facial authentication has not permitted the subject to enter the restricted entry area; and when the facial authentication has permitted the subject to enter the restricted entry area.

[0194] (Appendix 4) the input acceptance screen generation means generates, as the input acceptance screen when the target person is not permitted to enter the entry-restricted area as a result of the face authentication, a screen including the message for informing the target person that entry permission to the entry-restricted area has not been obtained; The authentication device of Appendix 3, wherein the menu screen generation means generates, as the menu screen after transition from the input receiving screen, a screen including the menu items for enabling implementation of an authentication method other than the face authentication.

[0195] (Appendix 5) The authentication device of Appendix 3, wherein the input acceptance screen generation means generates a screen including the message to urge the subject entering the restricted entry area to wear a mask as the input acceptance screen when the subject is permitted to enter the restricted entry area through the facial authentication and the subject is not wearing a mask.

[0196] (Appendix 6) The authentication device of Appendix 3, wherein the input acceptance screen generation means generates, as the input acceptance screen when the subject is permitted to enter the restricted-entry area through the facial authentication and when the subject is estimated to be in poor health, a screen including the message informing the subject that he or she is not allowed to enter the restricted-entry area.

[0197] (Appendix 7) The authentication device of Appendix 3, wherein the input acceptance screen generation means generates a screen including the message to inform the subject that an entry consent form must be filled out when entering the restricted entry area, as the input acceptance screen when the subject is not permitted to enter the restricted entry area through the facial authentication.

[0198] (Appendix 8) 2. The authentication device according to claim 1, wherein the input acceptance screen generation means generates different screens as the input acceptance screen depending on an authentication status of the face authentication of the subject.

[0199] (Appendix 9) The authentication device of claim 8, wherein the input acceptance screen generation means generates a different screen as the input acceptance screen when the face authentication of the subject is successful, depending on whether the subject's body temperature is normal or not.

[0200] (Appendix 10) The authentication device of claim 8, wherein the input acceptance screen generation means generates a different screen as the input acceptance screen when the face authentication of the subject is successful, depending on whether the subject is wearing a mask.

[0201] (Appendix 11) 9. The authentication device according to claim 8, wherein the input acceptance screen generation means generates a different screen as the input acceptance screen when the face authentication of the subject is successful, depending on the attributes of the subject.

[0202] (Appendix 12) 2. The authentication device according to claim 1, wherein the menu screen generation means generates a different screen according to attributes of the subject as the menu screen when the face authentication of the subject is successful.

[0203] (Appendix 13) The authentication device of Appendix 2; a control means for performing control relating to the lifting of entry restriction at a predetermined entrance of the entry restricted area when the target person is permitted to enter the entry restricted area by the face authentication; An authentication system comprising:

[0204] (Appendix 14) generating an input receiving screen including a first area for displaying a message and receiving a tap operation by a subject who is a target of face authentication in the first area or a second area provided separately from the first area; A screen generation method for generating a menu screen including one or more menu items as a screen to be displayed after transitioning from the input acceptance screen in response to a tap operation being performed on the first area or the second area.

[0205] (Appendix 15) generating an input receiving screen including a first area for displaying a message and receiving a tap operation by a subject who is a target of face authentication in the first area or a second area provided separately from the first area; A recording medium having recorded thereon a program that causes a computer to execute a process of generating a menu screen including one or more menu items as a screen to be displayed after transitioning from the input acceptance screen in response to a tap operation being performed on the first area or the second area.

[0206] (Appendix 16) An authentication device for performing face authentication of a subject, a touch panel that displays information related to the authentication status of the face authentication to the subject; a thermosensor for detecting a body surface temperature of the subject; a camera that captures an image of the subject to be used for the face authentication; a speaker that outputs a sound to the target person; a human presence sensor that detects the presence or absence of the target person; a plurality of holes that are used for detecting the presence or absence of the target person by the human presence sensor and for outputting sound from the speaker; An authentication device having:

[0207] Although the present disclosure has been described above with reference to the embodiments and examples, the present disclosure is not limited to the above-described embodiments and examples. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. [Explanation of symbols]

[0208] 112,212 processors 115 Thermosensor 116 Camera 117 Human Sensor 118 Touch Panel 215 databases

Claims

1. a processor that performs processing related to face authentication to determine whether or not a target person is permitted to enter an entry-restricted area; a touch panel that displays information related to the authentication status of the face authentication to the subject; a thermosensor for detecting a body surface temperature of the subject; a camera that captures an image of the subject to be used for the face authentication; a speaker that outputs audio guidance to the target person regarding the procedure for entering the entry-restricted area; a human presence sensor that detects the presence or absence of the target person; a plurality of holes that are used for detecting the presence or absence of the target person by the human presence sensor and for outputting sound from the speaker; and After the facial authentication is successful, if the subject's body surface temperature detected by the thermal sensor is above a predetermined value, the processor displays a message on the touch panel informing the subject that they cannot enter the restricted entry area, and then displays a screen on the touch panel providing information on medical institutions near the restricted entry area where the subject can be examined.

2. The camera is located above the touch panel. The authentication device according to claim 1 .

3. The camera is located above the touch panel.

3. The authentication device according to claim 1 or 2.

4. the plurality of holes are located at the bottom of the touch panel; The authentication device according to any one of claims 1 to 3.

5. the speaker is located below the touch panel; The human presence sensor is located below the touch panel.

5. The authentication device according to claim 1.

6. In addition, an expansion unit is provided on the back, The expansion unit is provided detachably.

6. An authentication device according to any one of claims 1 to 5.

Images