Authentication control device, authentication system, authentication control method, and program

Abstract

The purpose of the present invention is to improve the technology disclosed in the patent document. An authentication control device according to the present disclosure comprises: a display control unit that displays, on a display unit, an operation button corresponding to a prescribed process; a reception unit that receives selection of an operation button from a user; a biological information acquisition unit that acquires at least one piece of biological information pertaining to a user, on the basis of the timing when a specific operation button corresponding to a specific process requiring biological authentication is selected; and a selection unit that selects, from among the acquired at least one piece of biological information, authentication information to be used for biometric authentication of the user.

Description

Authentication control device, authentication system, authentication control method, and program

[0001] The present disclosure relates to an authentication control device, an authentication system, an authentication control method, and a program.

[0002] In recent years, technologies for verifying identity using biometric authentication have become widespread. For example, a technology is known in which biometric authentication is performed to verify the identity of a user when the user performs a financial transaction at an automatic teller machine (ATM) installed in a convenience store.

[0003] As a related technology, Patent Document 1 discloses a space-floating image display device that includes a display device that displays an image and a retroreflective member that reflects the image light from the display device. When the space-floating image display device disclosed in Patent Document 1 detects a user attempting to operate an ATM using a camera, it displays text information such as "Welcome" as a space-floating image. The space-floating image display device also captures the user's face with two cameras and authenticates the user based on the resulting stereo image (captured image). As a result, the space-floating image display device determines whether the user is a pre-registered user who is authorized to use the ATM.

[0004] Japanese Patent Application Laid-Open No. 2022-089271

[0005] The purpose of this disclosure is to improve upon the techniques disclosed in the above-mentioned patent documents.

[0006] The authentication control device disclosed herein comprises: a display control means for displaying operation buttons corresponding to predetermined processes on a display means; a receiving means for receiving a selection of the operation buttons from a user; a biometric information acquisition means for acquiring one or more pieces of biometric information of the user based on the timing at which a specific operation button, which is the operation button corresponding to a specific process requiring biometric authentication, is selected; and a selection means for selecting authentication information to be used for biometric authentication of the user from the one or more pieces of biometric information acquired.

[0007] The authentication system disclosed herein comprises a camera that photographs a user, an authentication control device, and an authentication device, wherein the authentication control device comprises: a display control means that causes a display means to display operation buttons corresponding to predetermined processes; a reception means that receives a selection of the operation buttons from the user; a biometric information acquisition means that acquires one or more pieces of biometric information of the user from the camera based on the timing at which a specific operation button that corresponds to a specific process requiring biometric authentication is selected; and a selection means that selects authentication information to be used for biometric authentication of the user from the one or more pieces of biometric information acquired, and the authentication device performs biometric authentication of the user using the selected authentication information.

[0008] The authentication control method disclosed herein displays operation buttons corresponding to predetermined processes on a display means, accepts selection of the operation button from a user, acquires one or more pieces of biometric information of the user based on the timing at which a specific operation button corresponding to a specific process requiring biometric authentication is selected, and selects authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information.

[0009] The program disclosed herein causes a computer to execute an authentication control method that displays operation buttons corresponding to predetermined processes on a display means, accepts selection of the operation buttons from a user, acquires one or more pieces of biometric information of the user based on the timing at which a specific operation button corresponding to a specific process requiring biometric authentication is selected, and selects authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information.

[0010] FIG. 1 is a block diagram showing the configuration of an authentication control device according to the present disclosure. FIG. 2 is a flowchart showing processing performed by the authentication control device. FIG. 3 is a diagram showing the overall configuration of an authentication system according to the present disclosure. FIG. 4 is a block diagram showing the functional configuration of the authentication control device. FIG. 5 is a diagram showing the external appearance of the authentication control device. FIG. 6 is a diagram showing an example of a display screen displayed on a display unit of the authentication control device. FIG. 7 is a diagram showing an example in which the direction indicated by the user's line of sight passes through the camera's imaging range. FIG. 8 is a diagram showing an example in which the direction indicated by the user's line of sight does not pass through the camera's imaging range. FIG. 9 is a diagram showing another example of a display screen of the authentication control device. FIG. 10 is a flowchart showing processing performed by the authentication control device. FIG. 11 is a block diagram showing the configuration of an authentication device. FIG. 12 is a flowchart showing the flow of biometric information registration processing. FIG. 13 is a flowchart showing the flow of authentication processing. FIG. 14 is a block diagram showing an example of the hardware configuration of a computer that realizes the authentication control device, etc.

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals. For clarity of explanation, duplicated explanations will be omitted as necessary.

[0012] First Embodiment First, one of the problems in this embodiment will be specifically described. In the related technologies described above, a camera is used to capture an image of a user to acquire the user's biometric information. Simply capturing an image of a user standing in front of an ATM at any time may result in an image of a quality suitable for authentication being unable to be captured, depending on the user's position and posture at the time of capture. For example, if the user is not facing the camera when the time comes to capture the user's iris image, the camera will be unable to capture an appropriate iris image. The authentication control device disclosed herein solves this problem.

[0013] 1 is a block diagram showing the configuration of an authentication control device 100 according to this disclosure. The authentication control device 100 includes a display control unit 101, a reception unit 102, a biometric information acquisition unit 103, and a selection unit 104.

[0014] The display control unit 101 displays operation buttons corresponding to predetermined processes on the display unit. The accepting unit 102 accepts a selection of an operation button from a user. The biometric information acquiring unit 103 acquires one or more pieces of biometric information of the user based on the timing when a specific operation button, which is an operation button corresponding to a specific process requiring biometric authentication, is selected. The selecting unit 104 selects authentication information to be used for biometric authentication of the user from the one or more pieces of biometric information acquired by the biometric information acquiring unit 103.

[0015] The authentication control device 100 includes a processor, a memory, and a storage device (not shown). The storage device stores a computer program that implements the processes described in this disclosure. The processor can load the computer program from the storage device into the memory and execute the computer program. In this way, the processor realizes the functions of a display control unit 101, a reception unit 102, a biometric information acquisition unit 103, and a selection unit 104.

[0016] Alternatively, the display control unit 101, the reception unit 102, the biometric information acquisition unit 103, and the selection unit 104 may each be realized by dedicated hardware. Furthermore, some or all of the components may be realized by a general-purpose or dedicated circuit, processor, etc., or a combination thereof. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components may be realized by a combination of the above-mentioned circuit, etc., and a program.

[0017] (Processing of the authentication control device 100) The processing performed by the authentication control device 100 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the processing performed by the authentication control device 100.

[0018] First, the display control unit 101 displays operation buttons on the display unit (S1). Next, the accepting unit 102 accepts a selection of an operation button from the user (S2). Next, the biometric information acquiring unit 103 acquires one or more pieces of biometric information of the user based on the timing at which the specific operation button is selected (S3). Then, the selecting unit 104 selects authentication information to be used for biometric authentication of the user from the one or more pieces of biometric information acquired by the biometric information acquiring unit 103 (S4).

[0019] As described above, the authentication control device 100 according to this disclosure acquires one or more pieces of biometric information of a user based on the timing at which a specific operation button is selected, and selects authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information. This allows the authentication control device 100 to determine biometric information of a quality suitable for authentication.

[0020] Second Embodiment Next, a description will be given of a second embodiment, which is a specific example of the first embodiment described above.

[0021] (Configuration of authentication system 5) Fig. 3 is a diagram showing the overall configuration of the authentication system 5 according to this disclosure. The authentication system 5 includes an authentication control device 1 and an authentication device 2. The authentication control device 1 and the authentication device 2 each include a communication unit (not shown) and communicate with each other via a network N. The network N is a wired or wireless communication line. For example, a wireless LAN (Local Area Network) or an internet line may be used as the network N. The type of communication is not limited.

[0022] The number of each component included in the authentication system 5 is not limited to that shown in the figure. For example, the authentication system 5 may include a plurality of authentication control devices 1 and a plurality of authentication devices 2.

[0023] (Overview of Authentication System 5) The authentication system 5 is a system that authenticates a user and performs the user's desired processing in accordance with the authentication result. For example, the authentication control device 1 includes a display unit that displays operation buttons corresponding to predetermined processing on the display unit. The display unit may be a touch panel that accepts user input when the user touches it. The touch panel is, for example, a contact-type touch panel that uses a capacitance system. The user can perform the desired processing by selecting the operation button corresponding to the desired processing by touching the display unit. The display unit may also be, for example, a non-contact type touch panel that uses infrared rays.

[0024] When an operation button is selected by the user, the authentication control device 1 performs processing corresponding to the selected operation button. When a specific operation button, which is an operation button corresponding to a specific process that requires biometric authentication, is selected, the authentication control device 1 performs biometric authentication on the user and performs the user's desired process according to the result of the biometric authentication.

[0025] When the specific operation button is selected, the authentication control device 1 acquires biometric information of the user and controls biometric authentication using the acquired biometric information. Specifically, the authentication control device 1 makes a biometric authentication request to the authentication device 2 by transmitting an authentication request including the biometric information to the authentication device 2. The authentication device 2 performs biometric authentication in response to the request from the authentication control device 1 and transmits the result of the biometric authentication to the authentication control device 1.

[0026] In the following, an ATM capable of depositing and withdrawing cash in response to user operations is used as an example of the authentication control device 1. However, the present invention is not limited to this, and any device capable of performing various processes may be used as the authentication control device 1. For example, the authentication control device 1 may be a device that controls entry and exit to a specific space (e.g., an apartment building). The authentication control device 1 may be any device that is capable of performing the processes desired by the user.

[0027] The authentication control device 1 acquires biometric information used for biometric authentication of a user at a predetermined timing. The user's biometric information is, for example, a face image and an iris image. For example, the authentication control device 1 uses a near-infrared camera to capture an image of the user's face area and acquires the face image and iris image as biometric information. The biometric information is not limited to the face image and the iris image, but may also be feature amounts extracted from each of the face image and the iris image. The feature amounts are information indicating biometric features unique to the user. Note that the biometric information may be either the face image or the iris image.

[0028] In the following, an example of the authentication control device 1 is used in which multimodal authentication is possible using a face image and an iris image as biometric information, but the types of biometric information are not limited to these. Various types of information may be used as the user's biometric information. For example, fingerprints, veins, palm prints, or retina may be used as biometric information. Furthermore, the authentication control device 1 is not limited to multimodal authentication, and may be configured to perform single-modal authentication using a single authentication method.

[0029] When a specific operation button that corresponds to a specific process requiring biometric authentication is selected, the authentication control device 1 acquires biometric information of the user based on the timing at which the specific operation button is selected.

[0030] The specific operation buttons are, for example, operation buttons corresponding to processes that require a higher level of security than operation buttons other than the specific operation buttons (hereinafter sometimes referred to as "normal operation buttons"). Examples of specific operation buttons include a "withdraw button" for withdrawing cash from a user's account and a "transfer button" for transferring money to a transfer destination.

[0031] The normal operation buttons are, for example, operation buttons that correspond to processes that are not directly related to ATM transactions. Examples of normal operation buttons include a "transaction start button" for starting a transaction, a "language change button" for switching the display language, and a "help button" for referring to guidance on operation methods.

[0032] The normal operation buttons may also include operation buttons corresponding to transaction-related processes that do not require biometric authentication. For example, the normal operation buttons may include a "balance inquiry button" for making a balance inquiry, a "passbook entry button" for making entries in a passbook, etc.

[0033] When a user presses a displayed operation button, the user usually turns his / her face and gaze toward the operation button. For example, when a user withdraws cash, the user looks toward the "withdrawal button" and touches the button. Therefore, by installing a camera near the operation button corresponding to the user's desired process, the user will turn his / her face and gaze toward the camera when he / she presses the operation button. Taking advantage of this, the authentication control device 1 positions the operation button so that at least one of the user's face and gaze is directed toward the camera.

[0034] The authentication control device 1 also acquires biometric information of the user based on the timing at which a specific operation button is selected. For example, suppose that face authentication and iris authentication are required to perform a cash withdrawal process. In this case, the authentication control device 1 arranges the operation buttons so that when the user presses the "withdrawal button," at least one of the user's face and line of sight is directed toward the camera. For example, the authentication control device 1 arranges the "withdrawal button" in a position closer to the camera than other operation buttons. As a result, when the user presses the "withdrawal button," for example, the user's face and line of sight are directed toward the camera.

[0035] In this state, when the user presses the "withdrawal button," the camera captures an image of the user's face. In this way, the camera can capture an image of the user's face and line of sight facing the camera. This allows the authentication control device 1 to acquire the user's biometric information from the user's face image and iris image captured when the "withdrawal button" is selected. Furthermore, when multiple pieces of biometric information are acquired, the authentication control device 1 can select authentication information to be used for biometric authentication of the user from the acquired multiple pieces of biometric information.

[0036] This allows the authentication control device 1 to acquire high-quality biometric information. Here, the quality of the biometric information indicates whether the biometric information is in a state suitable for authentication. For example, the higher the quality of the biometric information, the more suitable the biometric information is for biometric authentication, and the lower the quality of the biometric information, the less suitable the biometric information is for biometric authentication.

[0037] (Authentication control device 1) The authentication control device 1 will be described with reference to Fig. 4 to Fig. 6. Fig. 4 is a block diagram showing the functional configuration of the authentication control device 1. Fig. 5 is a diagram showing the external appearance of the authentication control device 1. Fig. 6 is a diagram showing an example of a display screen displayed on the display unit of the authentication control device 1.

[0038] The authentication control device 1 is an example of the above-mentioned authentication control device 100. As shown in Fig. 4, the authentication control device 1 includes a person detection unit 10, a display control unit 11, a reception unit 12, a biometric information acquisition unit 13, a selection unit 14, a display unit 15, an authentication control unit 16, a processing control unit 17, an imaging control unit 18, a camera C, and a light L. The reception unit 12 and the display unit 15 are integrally configured as a touch panel TP.

[0039] 5, the touch panel TP has a first screen TP1 and a second screen TP2 arranged on either side of the camera C. While FIG. 5 shows an example in which the first screen TP1 and the second screen TP2 are arranged vertically, the arrangement of the first screen TP1 and the second screen TP2 is arbitrary. For example, the first screen TP1 and the second screen TP2 may be arranged horizontally. The first screen TP1 and the second screen TP2 may be installed so that parts of them are in contact with each other, or may be installed apart from each other.

[0040] The person detection unit 10 detects people around the authentication control device 1. The person detection unit 10 may detect people based on images captured by a camera C, a surveillance camera, or the like. For example, the person detection unit 10 detects a user of the authentication control device 1 standing in front of the authentication control device 1. The person detection unit 10 also detects at least one of the position and posture of the user relative to the position of the camera. The person detection unit 10 outputs the detection result to the display control unit 11.

[0041] The user's position may be the position of the user's entire body or the position of a specific body part of the user. For example, the user's position may include at least one of the position of the user's face and the position of the user's eyes. The user's position may be represented using the distance between the user and camera C. For example, the position of the user's face may be represented using the distance between the center of the user's face and camera C. Furthermore, the position of the user's eyes may be represented using the distance between the center of the user's right eye and camera C, or the distance between the center of the user's left eye and camera C. The position of the user's eyes may be represented using the height of the user's eyes from the ground or a predetermined horizontal plane.

[0042] The user's posture may be the posture of the entire user's body or the posture of a specific body part of the user. For example, the user's posture includes at least one of the user's facial posture and eye posture. The user's facial posture and eye posture are related to the user's facial direction and gaze direction, respectively. The user's facial posture and eye posture may be represented by the user's facial angle and gaze angle relative to the camera C, respectively.

[0043] The position and posture of the user may be identified based on, for example, an image captured by camera C, or may be identified based on an image captured by a camera other than camera C (for example, a surveillance camera not shown). For example, the person detection unit 10 identifies the position and posture of the user based on the image captured by camera C using any image recognition technology.

[0044] The person detection unit 10 identifies at least one of the user's face position, eye position, facial posture, and eye posture, and outputs the identified result to the display control unit 11. The person detection unit 10 may estimate the user's height based on the captured image, and identify at least one of the user's face position, eye position, facial posture, and eye posture based on the estimated height.

[0045] The display control unit 11 is an example of the above-mentioned display control unit 101. The display control unit 11 displays operation buttons corresponding to predetermined processes on the display unit 15. The authentication control device 1 includes the display unit 15 as a touch panel TP having the function of the reception unit 12.

[0046] The operation buttons indicate predetermined areas of the display screen displayed on the display unit 15. The operation buttons are display areas provided for the user to select a desired process. The display control unit 11 can display multiple operation buttons on the display unit 15. As described above, in an ATM, the operation buttons include, for example, normal operation buttons and specific operation buttons.

[0047] Normal operation buttons are, for example, operation buttons corresponding to processes not directly related to ATM transactions. Normal operation buttons include, for example, a "start transaction button," a "language switch button," and a "help button." Normal operation buttons may also include operation buttons corresponding to transaction-related processes that do not require biometric authentication. For example, normal operation buttons may include a "balance inquiry button," a "passbook entry button," and the like.

[0048] The specific operation button is an operation button corresponding to a specific process that requires biometric authentication. The specific operation button is an operation button corresponding to a process that requires a higher level of security than the normal operation button. Examples of the specific operation button include a "withdrawal button" and a "transfer button."

[0049] 6, the display control unit 11 displays a passbook entry button b1, a withdrawal button b2, and a balance inquiry button b3 on the second screen TP2. The display control unit 11 also displays messages such as "Welcome" and "Please select the transaction you wish to make" on the first screen TP1. In this example, the withdrawal button b2 is a specific operation button, and the passbook entry button b1 and the balance inquiry button b3 are normal operation buttons. The display control unit 11 may display operation buttons on both the first screen TP1 and the second screen TP2, or may display operation buttons on either the first screen TP1 or the second screen TP2.

[0050] The display control unit 11 determines the layout of the operation buttons based on at least one of the position and posture of the user relative to the position of the camera C installed near the touch panel TP (display unit 15). The display control unit 11 also displays the operation buttons based on the determined layout.

[0051] The layout of the operation buttons indicates the display position of each operation button on the display screen of the touch panel TP. The display control unit 11 may determine the layout of each operation button, for example, using coordinates corresponding to the position on the display screen, or may determine the layout of each operation button, for example, using the relative position with respect to the camera C. When there are multiple operation buttons, the display control unit 11 may determine the layout of some or all of the multiple operation buttons.

[0052] The display control unit 11 determines the layout of the operation buttons so that at least one of the user's face and line of sight is directed toward the camera C. For example, the display control unit 11 determines the layout so that the position of a specific operation button that requires biometric authentication is close to the camera C. For example, the display control unit 11 determines the layout so that the distance between the camera C and the specific operation button is smaller than the distance between the camera C and the normal operation button.

[0053] 6, of the passbook entry button b1, the withdrawal button b2, and the balance inquiry button b3, only the withdrawal button b2 is a specific operation button. Therefore, the display control unit 11 determines the layout of the three operation buttons so that the withdrawal button b2 is located closer to the camera C than the passbook entry button b1 and the balance inquiry button b3, as shown in FIG.

[0054] The display control unit 11 may determine the layout so that the specific operation button is closest to the camera C, or may determine the layout so that the specific operation button is closer to the camera C than at least one normal operation button. The display control unit 11 may determine the layout of one or more operation buttons displayed on the same screen so that, when a specific operation button is selected, at least one of the user's face and line of sight faces toward the camera C. In this way, when a specific operation button is selected, the user can naturally face toward the camera C.

[0055] If the camera position and the user position are farther apart than a predetermined distance, the camera may not be able to smoothly acquire an image appropriate for biometric authentication. In response to this, in the authentication control device 1 disclosed herein, the display control unit 11 places, for example, a specific operation button near the camera C. This allows the display control unit 11 to display the operation button so that at least one of the user's face and line of sight is directed toward the camera C. In this way, the authentication control device 1 can accurately acquire the user's biometric information in the biometric information acquisition unit 13.

[0056] Furthermore, the display control unit 11 may cause a guidance display that guides at least one of the user's facial posture and eye posture to be displayed on the display unit 15. For example, the display control unit 11 causes a guidance display to be displayed so that at least one of the user's facial orientation and eye gaze direction changes from the first screen TP1 to the second screen TP2, or from the second screen TP2 to the first screen TP1.

[0057] For example, the display control unit 11 may use animation as the guidance display. For example, the display control unit 11 displays, as the guidance display, an object that moves from the first screen TP1 to the second screen TP2 or from the second screen TP2 to the first screen TP1. The object may be a character, or may be a letter, a figure, or a symbol. For example, the display control unit 11 may display a guidance display that moves a character from the second screen TP2 to the first screen TP1 during a waiting time for processing, etc.

[0058] Furthermore, the display control unit 11 may display an object near the camera C so that the user looks in the direction of the camera C. For example, the display control unit 11 changes the display mode of the object by moving, vibrating, rotating, or blinking the object near the camera C. The display control unit 11 may also change the color or size of the object. By changing the display mode of the object, the user will pay attention to the object, and the display control unit 11 can guide at least one of the user's facial posture and eye posture toward the camera C.

[0059] In particular, in iris authentication, it is preferable that the user's gaze is directed toward camera C. However, if the position of the operation button and the position of the camera are separated by a predetermined distance or more, the camera may capture an image that is not suitable for biometric authentication. Since the display control unit 11 causes the display unit 15 to display a guidance display, the authentication control device 1 can reduce the possibility that the user will fail authentication.

[0060] The display control unit 11 may also determine the layout of the operation buttons so that at least one of the direction indicated by the orientation of the user's face and the direction indicated by the direction of the user's line of sight passes through the imaging range of the camera C.

[0061] The relationship between the direction indicated by the user's line of sight and the shooting range of camera C will be described with reference to Fig. 7 and Fig. 8. Fig. 7 is a diagram showing an example in which direction D1 indicated by the user's line of sight passes through the shooting range R of camera C. Fig. 8 is a diagram showing an example in which direction D2 indicated by the user's line of sight does not pass through the shooting range R of camera C. In Fig. 7 and Fig. 8, the operation buttons are displayed on the second screen TP2.

[0062] The imaging range R of the camera C corresponds to the range in the vertical and horizontal directions that can be captured by the camera C. In Figures 7 and 8, the vertical range that can be captured by the camera C is indicated by the triangular imaging range R.

[0063] 7, direction D1 passes through the area of ​​shooting range R, whereas in Fig. 8, direction D2 does not pass through the area of ​​shooting range R. In the example shown in Fig. 8, the user is short, so the position of the user's eyes is not within the area of ​​shooting range R. Therefore, direction D2 does not pass through shooting range R.

[0064] If direction D2 does not pass through the imaging range R, camera C may not be able to acquire a captured image suitable for authentication. Furthermore, even if the position of the user's eyes is near the boundary of imaging range R and just barely falls within the imaging range R, if direction D2 does not pass through imaging range R, camera C may not be able to acquire a captured image suitable for authentication. Therefore, the display control unit 11 determines the layout of the operation buttons so that the direction indicated by the user's line of sight passes through the imaging range R. For example, in the example of FIG. 8 , the display control unit 11 determines the layout so that the operation buttons are displayed on the first screen TP1. In this way, the user can select the operation button at an angle such that direction D2 passes through the imaging range R.

[0065] Similar to the above-described direction of gaze, the display control unit 11 may determine the placement so that the direction indicated by the direction of the user's face passes through the shooting range R of the camera C. Furthermore, the display control unit 11 may display the above-described guidance display so that at least one of the direction indicated by the direction of the user's face and the direction indicated by the direction of the user's gaze passes through the shooting range R of the camera C.

[0066] The display control unit 11 may also change the arrangement of the operation buttons depending on the success rate of the biometric authentication. For example, if the success rate of the biometric authentication corresponding to a specific operation button is less than a predetermined value, the display control unit 11 changes the position of the specific operation button to a position where the success rate is equal to or greater than the predetermined value.

[0067] For example, when a position where the success rate of biometric authentication is improved is identified, the display control unit 11 changes the position of the specific operation button to a position where the success rate of biometric authentication is improved. For example, when the success rate of biometric authentication corresponding to the specific operation button is lower than a predetermined value, the display control unit 11 may swap the position of the specific operation button with the position of the normal operation button.

[0068] 6, for example, suppose the success rate of iris authentication using iris images acquired based on the timing at which the Withdraw button b2 is selected is less than a predetermined value. Also, suppose the success rate of iris authentication using iris images acquired based on the timing at which the Bankbook Entry button b1 is selected is greater than or equal to a predetermined value. In this case, the display control unit 11 swaps the positions of the Bankbook Entry button b1 and the Withdraw button b2.

[0069] If a position that improves the success rate of biometric authentication has not been identified, the display control unit 11 may change the position of the specific operation button to a location where no other operation buttons are located or to a position closer to camera C.

[0070] Depending on the environment in which the authentication control device 1 is installed, the success rate of biometric authentication may be low even with the layout determined by the display control unit 11. In such cases, the display control unit 11 can change the layout of the operation buttons based on the success rate of biometric authentication corresponding to the specific operation button. This allows the authentication control device 1 to reduce the possibility that the user will fail authentication.

[0071] The display control unit 11 may also determine the layout of the operation buttons depending on whether the hand used to select the operation button is the right hand or the left hand. For example, the authentication control device 1 identifies whether the hand used in the operation before selecting a specific operation button is the left or right hand, based on an image captured by the camera C. The authentication control device 1 may identify the hand using any image recognition technology.

[0072] FIG. 9 is a diagram illustrating another example of the display screen of the authentication control device 1. As shown in FIG. 9 , the passbook entry button b1 is located on the left side of the first screen TP1, and the withdrawal button b2 is located on the right side of the first screen TP1, as viewed from the user. As shown in FIG. 9 , when the user selects the withdrawal button b2 with their right hand, the camera C is unlikely to be covered by their right hand or right arm, allowing the camera C to capture an image suitable for authentication. On the other hand, when the user selects the withdrawal button b2 with their left hand, the camera C may be covered by their left hand or left arm, blocking the light entering the camera C. In such a case, the display control unit 11 can change the layout of the operation buttons depending on whether the hand used for operation is the right hand or the left hand. This allows the authentication control device 1 to reduce the possibility of the user failing authentication.

[0073] The display control unit 11 may also determine the layout of display areas other than the operation buttons. For example, the display control unit 11 may determine the layout of messages related to operations.

[0074] Returning to FIG. 4 , the description of the configuration of the authentication control device 1 will continue. The reception unit 12 is an example of the reception unit 102 described above. The reception unit 12 receives a selection of an operation button from the user. The reception unit 12 may function as an input unit that receives input such as characters from the user, in addition to the selection of an operation button. The reception unit 12 and the display unit 15 may be integrally configured as a touch panel TP. Furthermore, the reception unit 12 may be provided separately from the display unit 15 using a physical button or the like.

[0075] The biometric information acquisition unit 13 is an example of the biometric information acquisition unit 103 described above. The biometric information acquisition unit 13 acquires one or more pieces of biometric information of the user based on the timing when a specific operation button is selected. For example, the biometric information acquisition unit 13 acquires an image of the user from a camera C as biometric information. The biometric information is, for example, a face image and an iris image. The biometric information acquisition unit 13 may also acquire, as biometric information, feature quantities of the user extracted from the captured image.

[0076] For example, the biometric information acquisition unit 13 acquires, as biometric information, an image captured by the camera C at the time when the specific operation button is selected. The biometric information acquisition unit 13 may acquire biometric information within a predetermined period including the time when the specific operation button is selected. The predetermined period may be set arbitrarily. This allows the biometric information acquisition unit 13 to acquire images captured before and after the time when the specific operation button is selected. For example, the biometric information acquisition unit 13 may acquire an image captured before the time when the specific operation button is selected (e.g., 0.5 seconds before the touch). Furthermore, the biometric information acquisition unit 13 may acquire an image captured after the time when the specific operation button is selected (e.g., 1 second after the touch).

[0077] To acquire biometric information suitable for authentication, certain conditions must be met, such as the distance between the user and the authentication control device 1 being within a predetermined range and the user looking in the direction of the camera C. For example, when biometric authentication is performed simply by triggering a predetermined user operation, depending on the user interface, authentication may be initiated with the user in a position or posture that is not suitable for biometric authentication. In the authentication control device 1, the display control unit 11 determines the layout of operation buttons that will make it easier to acquire biometric information suitable for authentication when a specific operation button is selected. This allows the biometric information acquisition unit 13 to acquire, as biometric information, an image captured at a time when the user's face or gaze is likely to be facing the camera C. This allows the authentication control device 1 to reduce the possibility of the user failing authentication.

[0078] The biometric information acquisition unit 13 may acquire biometric information corresponding to each of a plurality of authentication methods from a single image acquired by the camera C. For example, the biometric information acquisition unit 13 acquires biometric information corresponding to each of face authentication and iris authentication from a single near-infrared image capturing the user's facial region. The biometric information acquisition unit 13 can acquire both a face image and an iris image from a single near-infrared image based on the positions of the face and eyes detected by the person detection unit 10.

[0079] To realize an authentication control device 1 that supports multimodal authentication, sensors that acquire biometric information according to the authentication method are required, which tends to increase the cost of installing the authentication control device 1. The biometric information acquisition unit 13 can acquire biometric information corresponding to each of multiple authentication methods from a single image acquired by a single camera C. In this way, the authentication control device 1 can perform multimodal authentication using a single camera C.

[0080] The biometric information acquiring unit 13 may store the acquired biometric information in a storage unit (not shown) and accumulate the biometric information.

[0081] The selection unit 14 is an example of the above-mentioned selection unit 104. The selection unit 14 selects authentication information to be used for biometric authentication of a user from one or more pieces of biometric information acquired by the biometric information acquisition unit 13. The one or more pieces of biometric information acquired by the biometric information acquisition unit 13 may be one or more for one authentication method.

[0082] For example, the selection unit 14 selects face authentication information to be used for face authentication from the face image acquired by the biometric information acquisition unit 13. The selection unit 14 also selects iris information to be used for iris authentication from the iris image acquired by the biometric information acquisition unit 13.

[0083] The selector 14 may select authentication information taking into consideration the quality of the biometric information. For example, the selector 14 may evaluate the quality of the captured image and select a highly rated captured image as authentication information.

[0084] Even when biometric information is acquired at multiple times, biometric information suitable for authentication may not be acquired. For example, if the user's gaze is not directed toward camera C, an iris image suitable for iris authentication may not be acquired. In the authentication control device 1, the display control unit 11 determines the layout of operation buttons that will make it easier to acquire biometric information suitable for authentication when a specific operation button is selected, so the selection unit 14 can select authentication information suitable for authentication. This allows the authentication control device 1 to reduce the possibility that the user will fail authentication.

[0085] The display unit 15 displays operation buttons. The display unit 15 displays various information related to the processing for this disclosure under the control of the display control unit 11. The display unit 15 may be configured as a touch panel TP having the functions of the reception unit 12. As shown in FIGS. 5 and 6 , the touch panel TP has a first screen TP1 and a second screen TP2 arranged on either side of the camera C. Note that the authentication control device 1 may include the display unit 15 separately from the reception unit 12.

[0086] The authentication control unit 16 controls biometric authentication of the user using the authentication information selected by the selection unit 14. For example, the authentication control unit 16 controls face authentication and iris authentication of the user using the face image and iris image selected by the selection unit 14. The authentication control unit 16 may control biometric authentication using user feature amounts extracted from each of the face image and iris image. For example, the authentication control unit 16 transmits a biometric authentication request including biometric information to the authentication device 2. The authentication control unit 16 also receives the result of the biometric authentication from the authentication device 2. The authentication control unit 16 outputs the authentication result to the processing control unit 17.

[0087] The authentication control unit 16 may control biometric authentication corresponding to a plurality of authentication methods. For example, the display control unit 11 may display a first operation button corresponding to a first process and a second operation button corresponding to a second process requiring a higher security level than the first process on the display unit 15. The authentication control unit 16 controls at least one of the first biometric authentication corresponding to the first process and the second biometric authentication corresponding to the second process, depending on the specific operation button selected by the user.

[0088] Specifically, when a specific operation button corresponding to a process requiring the first biometric authentication is selected, the authentication control unit 16 controls the first authentication. Furthermore, when a specific operation button corresponding to a process requiring the first biometric authentication and the second biometric authentication is selected, the authentication control unit 16 controls the first authentication and the second authentication.

[0089] The processes corresponding to each specific operation button may require different security levels. For example, a withdrawal process may require successful facial authentication, while a transfer process may require successful facial authentication and iris authentication. Therefore, multimodal authentication is not necessarily required for all processes corresponding to specific operation buttons. If multimodal authentication were performed for all processes corresponding to specific operation buttons, appropriate images may not be captured, lengthening processing times, and reducing user convenience. The authentication control unit 16 can change the number of biometric authentication elements, etc., depending on the security level required for a transaction or other process, thereby improving user convenience.

[0090] The process control unit 17 controls the process corresponding to the selected specific operation button in accordance with the result of the biometric authentication. The process control unit 17 controls the process corresponding to the selected specific operation button in accordance with at least one of the result of the first biometric authentication and the result of the second biometric authentication.

[0091] For example, as in the example described above, if successful face authentication is required for a withdrawal process, and successful face authentication and iris authentication are required for a transfer process, the process control unit 17 controls the process corresponding to the selected specific operation button according to the results of the face authentication and the iris authentication.

[0092] For example, when the "withdrawal button" is selected, the process control unit 17 performs the withdrawal process depending on whether the face authentication is successful. If the face authentication is successful, the process control unit 17 performs the withdrawal process. If the face authentication is unsuccessful, the process control unit 17 does not perform the withdrawal process.

[0093] Furthermore, when the "transfer button" is selected, the process control unit 17 controls the transfer process depending on whether the face authentication and iris authentication are successful. If the face authentication and iris authentication are successful, the process control unit 17 performs the transfer process. If at least one of the face authentication and the iris authentication fails, the process control unit 17 does not perform the transfer process.

[0094] In processes that require a high level of security, it is necessary to strictly authenticate the identity of the user by using biometric authentication. The process control unit 17 controls processes such as transactions based on the results of biometric authentication required for each process, thereby reducing the possibility that a person other than the user performs the process.

[0095] The photographing control unit 18 controls photographing by the camera C. For example, the photographing control unit 18 controls the camera C to photograph the user at least at the timing when a specific operation button is selected. The photographing control unit 18 may also control the camera C to photograph at predetermined time intervals. For example, the photographing control unit 18 may control the camera C to photograph the user constantly.

[0096] Camera C is installed near the display unit 15 and captures an image of the user. Camera C is, for example, a near-infrared camera that captures an image of the user using a near-infrared light source as a light source. Camera C may be configured to be able to capture a facial image and an iris image of the user. In the examples shown in Figures 5 and 6, camera C is installed in front of the user, but this is not limited to this. Camera C may be installed approximately in front of the user. Camera C may also be installed in a position diagonal when viewed from the user.

[0097] The vicinity of the display unit 15 may be an area outside the display unit 15 and within a predetermined distance from the display unit 15. The vicinity of the display unit 15 may also be a partial area of ​​the display unit 15. Here, the display unit 15 includes a touch panel TP, and therefore the camera C is installed near the touch panel TP. In the example shown in FIGS. 5 and 6, the camera C is provided on the bezel B of the first screen TP1.

[0098] The lighting L is a lighting that emits light toward the user, illuminating the user. As shown in Figures 5 and 6, the lighting L is provided on the bezel B together with the camera C. The lighting L illuminates the user under the control of a lighting control unit (not shown). The authentication control device 1 may be provided with multiple lighting units L. For example, the lighting units L may be provided on both sides of the camera C. This allows the lighting units L to illuminate the user from multiple directions, allowing the camera C to photograph the user at an appropriate brightness.

[0099] (Processing of the Authentication Control Device 1) Next, the processing performed by the authentication control device 1 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the processing performed by the authentication control device 1.

[0100] In the following description, it is assumed that camera C constantly captures a facial image of the user. Furthermore, it is assumed that the processing corresponding to the specific operation button requires facial recognition and iris recognition. Therefore, camera C captures an iris image at least at the timing when the specific operation button is pressed.

[0101] First, camera C starts capturing images of the periphery of the authentication control device 1 under the control of the image capturing control unit 18 (S11). The image capturing control unit 18 may start capturing images upon detecting that a person is standing in front of the authentication control device 1. Camera C is configured to be able to capture images using near-infrared rays. Camera C outputs the near-infrared image to the biometric information acquisition unit 13.

[0102] Next, the person detection unit 10 determines whether or not a user has been detected (S12). If it is determined that a user has not been detected (NO in S12), the person detection unit 10 repeats step S12.

[0103] If it is determined that a user has been detected (YES in S12), the camera C captures a facial image of the user (S13). The biometric information acquisition unit 13 acquires the facial image. Although not shown, the selection unit 14 may select a facial image to be used for authentication from multiple facial images as authentication information to be used for facial authentication. The person detection unit 10 detects at least one of the position and posture of the user relative to the position of the camera C and outputs the detection result to the display control unit 11.

[0104] Next, the authentication control unit 16 controls face authentication (S14). The authentication control unit 16 transmits an authentication request including the selected face image to the authentication device 2. The authentication control unit 16 receives the result of face authentication from the authentication device 2.

[0105] The display control unit 11 determines the layout of the operation buttons and displays them on the display unit 15 (S15). The display control unit 11 selects one or more of the above-mentioned methods, for example, and determines the layout of the operation buttons using the selected method.

[0106] For example, the display control unit 11 determines the layout based on at least one of the position and posture of the user relative to the position of the camera C. The display control unit 11 may determine the layout of the operation buttons so that at least one of the user's face and gaze is directed toward the camera. The display control unit 11 may display a guidance display that guides at least one of the user's facial posture and eye posture. For example, the display control unit 11 may use animation or the like to display a guidance display such that at least one of the user's facial orientation and gaze direction changes from the first screen to the second screen, or from the second screen to the first screen.

[0107] The display control unit 11 may determine the layout of the operation buttons so that at least one of the direction indicated by the user's face orientation and the direction indicated by the user's gaze passes through the camera's imaging range. The display control unit 11 may also change the layout of the default operation buttons depending on the success rate of biometric authentication. For example, if the success rate of biometric authentication corresponding to a specific operation button is less than a predetermined value, the display control unit 11 changes the position of the specific operation button to a position where the success rate is equal to or higher than a predetermined value. The display control unit 11 may determine the layout of the operation buttons depending on whether the hand used to select the operation button is the right hand or the left hand. In this way, the user faces the camera C when selecting a specific operation button, and the camera C can capture an iris image suitable for iris authentication.

[0108] Next, the accepting unit 12 determines whether or not a specific operation button has been selected (S16). If it is determined that a specific operation button has not been selected (NO in S16), step S16 is repeated.

[0109] If it is determined that the specific operation button is selected (YES in S16), the camera C captures an iris image at the time the specific operation button is selected (S17). The camera C may capture the iris image multiple times during a predetermined period including before and after the time the specific operation button is selected. The biometric information acquisition unit 13 acquires the captured iris image.

[0110] Next, the selection unit 14 selects an iris image to be used for authentication (S18). The selection unit 14 selects an iris image to be used for authentication, for example, from a plurality of iris images, based on the timing at which the specific operation button is selected. The selected iris image is used as authentication information to be used for iris authentication.

[0111] Next, the authentication control unit 16 controls iris authentication (S19). The authentication control unit 16 transmits an authentication request including the selected iris image to the authentication device 2. The authentication control unit 16 receives the result of iris authentication from the authentication device 2.

[0112] The authentication control unit 16 determines whether authentication has been successful (S20). The authentication control unit 16 determines whether authentication has been successful based on the selected operation button. Here, the specific operation button corresponds to a process that requires face authentication and iris authentication, so the authentication control unit 16 determines whether both face authentication and iris authentication have been successful. If face authentication and iris authentication have been successful, the authentication control unit 16 determines that the user has been successfully authenticated. If at least one of face authentication and iris authentication has failed, the authentication control unit 16 determines that the user has failed authentication.

[0113] If it is determined that the authentication has failed (NO in S20), the process ends. The display control unit 11 may display a message indicating that the authentication has failed. The authentication control unit 16 may retry the authentication up to a predetermined number of times.

[0114] If it is determined that the authentication is successful (YES in S20), the process control unit 17 controls the process corresponding to the specific operation button (S21). For example, if the "withdrawal button" is selected, the process control unit 17 performs a cash withdrawal process.

[0115] (Authentication Device 2) Next, the authentication device 2 will be described. The authentication device 2 may be realized using any cloud computing system. For example, the authentication device 2 may be a cloud server constructed by any cloud service or the like.

[0116] 11 is a block diagram showing the configuration of the authentication device 2. The authentication device 2 performs biometric authentication of a user. The authentication device 2 receives an image related to the user's biometric information from the authentication control device 1, and authenticates the person by extracting a predetermined feature image from the received image.

[0117] The authentication device 2 mainly comprises an authentication storage unit 21 , a detection unit 22 , a feature point extraction unit 23 , a registration unit 24 , and an authentication unit 25 .

[0118] The authentication storage unit 21 stores a person ID of a person registered in advance in association with feature data of the person. The detection unit 22 detects feature areas included in an image related to the user's biometric information and outputs the detected feature areas to the feature point extraction unit 23. The feature point extraction unit 23 extracts feature points from the feature areas detected by the detection unit 22 and outputs data related to the feature points to the registration unit 24. The data related to the feature points is a collection of the extracted feature points.

[0119] The registration unit 24 issues a new person ID when registering the feature data. The registration unit 24 associates the issued person ID with feature data extracted from the registration image and registers them in the authentication storage unit 21. The authentication unit 25 compares the feature data extracted from the image related to the user's biometric information with the feature data in the authentication storage unit 21. The authentication unit 25 determines that authentication is successful if feature data matching the user's biometric information is present. On the other hand, the authentication unit 25 determines that authentication is unsuccessful if feature data matching the user's biometric information is not present. The authentication unit 25 transmits information regarding the success or failure of authentication to the authentication control device 1. Furthermore, if authentication is successful, the authentication unit 25 identifies the person ID associated with the successful feature data and transmits an authentication result including the identified person ID to the authentication control device 1.

[0120] (Processing of Authentication Device 2) Next, biometric information registration processing and authentication processing in the authentication device 2 will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a flowchart showing the flow of biometric information registration processing. Fig. 13 is a flowchart showing the flow of authentication processing. The following description will be given taking registration of a face image as an example.

[0121] First, the flow of the biometric information registration process will be described with reference to Fig. 12. The authentication device 2 acquires a registration image of the user (S31). The registration image is an image related to biometric information used for authentication in the authentication control device 1. For example, the authentication device 2 may receive a biometric information registration request including the registration image from the authentication control device 1 or a website for biometric information registration via the network N. In this case, the registration image is an image of the user's face.

[0122] Next, the detection unit 22 detects the user's facial region included in the registration image (S32). Next, the feature point extraction unit 23 extracts feature points from the facial region detected in step S32 and outputs feature data to the registration unit 24 (S33). Finally, the registration unit 24 issues a personal ID and associates the personal ID with the feature data, and registers the associated personal ID in the authentication storage unit 21 (S34). The authentication device 2 may receive feature data from a terminal owned by the user, and register the feature data in the authentication storage unit 21, associated with the personal ID.

[0123] Next, the flow of the authentication process will be described with reference to Fig. 13. First, the feature point extraction unit 23 acquires a facial image for authentication included in a biometric authentication request (S41). For example, the authentication device 2 receives the biometric authentication request from the authentication control device 1 via the network N and extracts feature data from the biometric image included in the biometric authentication request as in steps S31 to S33. Alternatively, the authentication device 2 may receive feature data from the authentication control device 1.

[0124] Next, the authentication unit 25 compares the acquired feature data with the feature data stored in the authentication storage unit 21 (S42). If the feature data match, that is, if the degree of match between the feature data is equal to or greater than a predetermined value (YES in S43), the authentication unit 25 identifies the person ID of the user whose feature data matches (S44). The authentication unit 25 then returns a message to the authentication control device 1 indicating that face authentication was successful and the identified person ID (S45). If no matching feature data exists (NO in S43), the authentication unit 25 returns a message to the authentication control device 1 indicating that face authentication failed (S46).

[0125] In step S42, the authentication unit 25 does not need to attempt matching with all feature data in the authentication storage unit 21. For example, the authentication unit 25 may preferentially attempt matching with feature data registered during the period from the day the biometric authentication request was received to several days prior. This can improve the matching speed. Furthermore, if the preferential matching fails, it is preferable to perform matching with all remaining feature data.

[0126] The above describes the configuration of the authentication system 5. Note that the above-described configuration of the authentication system 5 is merely an example and may be modified as appropriate. For example, when some or all of the components of the authentication control device 1 and the authentication device 2 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each is connected via a communication network. For example, the functions of the authentication device 2 may be provided in a SaaS (Software as a Service) format.

[0127] For example, some of the functions of the authentication control device 1 may be executed by a device (e.g., the authentication device 2) other than the authentication control device 1. In the above description, the authentication control device 1 and the authentication device 2 are provided separately, but the authentication control device 1 may also have the functions of the authentication device 2.

[0128] As described above, the authentication system 5 according to this disclosure can improve upon the techniques disclosed in the above-mentioned patent documents.

[0129] <Example of Hardware Configuration> Each functional component of the authentication control device 1 and the authentication device 2 (hereinafter referred to as the "authentication control device 1, etc.") may be realized by hardware (e.g., a hardwired electronic circuit, etc.) that realizes each functional component, or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it). Below, a case where each functional component of the authentication control device 1, etc. is realized by a combination of hardware and software will be further described.

[0130] 14 is a block diagram illustrating an example of the hardware configuration of a computer 900 that realizes the authentication control device 1, etc. The computer 900 may be a dedicated computer designed to realize the authentication control device 1, etc., or may be a general-purpose computer. The computer 900 may also be a portable computer such as a smartphone or tablet terminal.

[0131] For example, by installing a predetermined application on the computer 900, the computer 900 realizes each function of the authentication control device 1, etc. The application is configured by a program for realizing the functional components of the authentication control device 1, etc.

[0132] The computer 900 has a bus 902, a processor 904, a memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path for the processor 904, the memory 906, the storage device 908, the input / output interface 910, and the network interface 912 to transmit and receive data to and from each other. However, the method of connecting the processor 904 and other components to each other is not limited to a bus connection.

[0133] The processor 904 is a variety of processors, such as a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), or a quantum processor (quantum computer control chip). The memory 906 is a main storage device realized using a random access memory (RAM) or the like. The storage device 908 is an auxiliary storage device realized using a hard disk, a solid state drive (SSD), a memory card, a read only memory (ROM), or the like.

[0134] The input / output interface 910 is an interface for connecting the computer 900 with input / output devices. For example, the input / output interface 910 is connected to an input device such as a keyboard and an output device such as a display device.

[0135] The network interface 912 is an interface for connecting the computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).

[0136] The storage device 908 stores programs (programs that realize the above-mentioned applications) that realize the various functional components of the authentication control device 1, etc. The processor 904 reads these programs into the memory 906 and executes them to realize the various functional components of the authentication control device 1, etc.

[0137] Each processor executes one or more programs containing instructions for causing a computer to perform an algorithm. The programs contain instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The programs may be stored on various types of non-transitory computer-readable media or tangible storage media. By way of example and not limitation, non-transitory computer-readable media or tangible storage media include RAM, ROM, flash memory, SSD or other memory technologies, CD-ROM, DVD (Digital Versatile Disc), Blu-ray® disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The programs may also be transmitted over various types of transitory computer-readable media or communication media. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0138] Although this disclosure has been described above with reference to the embodiments, this disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of this disclosure within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0139] Each drawing is merely an example for describing one or more embodiments. Each drawing may not relate only to one particular embodiment, but may also relate to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0140] It should be noted that this disclosure is not limited to the above-described embodiments, and can be appropriately modified without departing from the spirit and scope of the present disclosure. In addition, the above-described embodiments can be combined in any manner.

[0141] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Supplementary Note 1) An authentication control device comprising: a display control means for displaying operation buttons corresponding to predetermined processes on a display means; a receiving means for receiving a selection of the operation buttons from a user; a biometric information acquisition means for acquiring one or more pieces of biometric information of the user based on the timing at which a specific operation button corresponding to a specific process requiring biometric authentication is selected; and a selecting means for selecting authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information. (Supplementary Note 2) The authentication control device according to Supplementary Note 1 further comprises: the display means having the function of the receiving means; the display control means determining an arrangement of the operation buttons based on at least one of the position and posture of the user with respect to the position of a camera installed near the display means, and displaying the operation buttons based on the determined arrangement; and the biometric information acquisition means acquiring the biometric information from an image of the user captured by the camera. (Supplementary Note 3) The authentication control device according to Supplementary Note 2, wherein the user position includes at least one of the user's face position and eye position, the user's posture includes at least one of the user's face posture and eye posture, and the display control means determines the layout of the operation buttons so that at least one of the user's face and line of sight is directed toward the camera. (Supplementary Note 4) The authentication control device according to Supplementary Note 3, wherein the display control means displays a guidance display that guides at least one of the user's face posture and eye posture. (Supplementary Note 5) The authentication control device according to Supplementary Note 4, wherein the display means has a first screen and a second screen arranged to sandwich the camera, and the display control means displays the guidance display so that at least one of the user's face direction and line of sight direction changes from the first screen to the second screen or from the second screen to the first screen. (Supplementary Note 6) The authentication control device according to any one of Supplementary Notes 3 to 5, wherein the display control means determines the layout of the operation buttons so that at least one of the direction indicated by the orientation of the user's face and the direction indicated by the direction of the user's line of sight passes through the imaging range of the camera.(Supplementary Note 7) The authentication control device according to any one of Supplements 3 to 6, wherein the display control means changes the arrangement of the operation buttons according to a success rate of the biometric authentication, and, when the success rate of the biometric authentication corresponding to the specific operation button is less than a predetermined value, changes the position of the specific operation button to a position where the success rate is greater than or equal to the predetermined value. (Supplementary Note 8) The authentication control device according to any one of Supplements 3 to 7, wherein the display control means determines the arrangement of the operation buttons according to whether the hand used to select the operation button is right or left. (Supplementary Note 9) The authentication control device according to any one of Supplements 1 to 8, further comprising: authentication control means for controlling biometric authentication of the user using the authentication information selected by the selection means; and processing control means for controlling processing corresponding to the selected specific operation button according to a result of the biometric authentication. (Supplementary Note 10) The authentication control device according to any one of Supplements 1 to 9, wherein the biometric information acquisition means acquires the biometric information corresponding to each of a plurality of authentication methods from a single image obtained by a camera that photographs the user. (Supplementary Note 11) The authentication control device described in Supplementary Note 9, wherein the display control means causes the display means to display a first operation button corresponding to a first process and a second operation button corresponding to a second process that requires a higher security level than the first process, the authentication control means controls at least one of a first biometric authentication corresponding to the first process and a second biometric authentication corresponding to the second process according to the selected specific operation button, and the processing control means controls the processing corresponding to the selected specific operation button according to at least one of the result of the first biometric authentication and the result of the second biometric authentication.an authentication control method comprising: a camera for photographing a user; an authentication control device; and an authentication device, wherein the authentication control device has: display control means for displaying operation buttons corresponding to predetermined processes on a display means; accepting means for accepting selection of the operation buttons from the user; biometric information acquisition means for acquiring one or more pieces of biometric information of the user from the camera based on timing at which a specific operation button corresponding to a specific process requiring biometric authentication is selected; and selection means for selecting authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information, wherein the authentication device performs biometric authentication of the user using the selected authentication information. (Supplementary Note 13) An authentication control method comprising: displaying operation buttons corresponding to predetermined processes on a display means; accepting selection of the operation button from the user; acquiring one or more pieces of biometric information of the user based on timing at which the specific operation button corresponding to the specific process requiring biometric authentication is selected; and selecting authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information. (Supplementary Note 14) A program that causes a computer to execute an authentication control method that displays operation buttons corresponding to predetermined processes on a display means, accepts selection of the operation buttons from a user, acquires one or more pieces of biometric information of the user based on the timing at which a specific operation button that corresponds to a specific process requiring biometric authentication is selected, and selects authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information.

[0142] Some or all of the elements (e.g., configurations and functions) described in Supplementary Notes 2 to 11 that are dependent on Supplementary Notes 1 may also be dependent on Supplementary Notes 12 to 14 in the same dependency relationship as Supplementary Notes 2 to 11. Some or all of the elements described in any Supplementary Note may be applied to various hardware, software, recording means for recording software, systems, and methods.

[0143] REFERENCE SIGNS LIST 1 Authentication control device 2 Authentication device 5 Authentication system 10 Person detection unit 11 Display control unit 12 Reception unit 13 Biometric information acquisition unit 14 Selection unit 15 Display unit 16 Authentication control unit 17 Processing control unit 18 Photography control unit 21 Authentication storage unit 22 Detection unit 23 Feature point extraction unit 24 Registration unit 25 Authentication unit 100 Authentication control device 101 Display control unit 102 Reception unit 103 Biometric information acquisition unit 104 Selection unit 900 Computer 902 Bus 904 Processor 906 Memory 908 Storage device 910 Input / output interface 912 Network interface B Bezel b1 Passbook entry button b2 Withdrawal button b3 Balance inquiry button C Camera L Lighting N Network R Photography range TP Touch panel TP1 First screen TP2 2nd screen

Claims

1. An authentication control device comprising: a display control means for displaying operation buttons corresponding to predetermined processes on a display means; a receiving means for receiving a selection of the operation buttons from a user; a biometric information acquisition means for acquiring one or more pieces of biometric information of the user based on the timing at which a specific operation button corresponding to a specific process requiring biometric authentication is selected; and a selection means for selecting authentication information to be used for biometric authentication of the user from the one or more pieces of biometric information acquired.

2. An authentication control device as described in claim 1, further comprising a display means having the function of the reception means, wherein the display control means determines the layout of the operation buttons based on at least one of the position and posture of the user relative to the position of a camera installed near the display means, and displays the operation buttons based on the determined layout, and the biometric information acquisition means acquires the biometric information from an image of the user captured by the camera.

3. The authentication control device according to claim 2, wherein the user position includes at least one of the user's face position and eye position, the user's posture includes at least one of the user's face posture and eye posture, and the display control means determines the layout of the operation buttons so that at least one of the user's face and line of sight is directed toward the camera.

4. The authentication control device according to claim 3, wherein the display control means displays a guidance display that guides at least one of the user's facial posture and eye posture.

5. An authentication control device as described in claim 4, wherein the display means has a first screen and a second screen arranged on either side of the camera, and the display control means displays the guidance display so that at least one of the user's facial direction and line of sight direction changes from the first screen to the second screen, or from the second screen to the first screen.

6. The authentication control device according to claim 3, wherein the display control means determines the layout of the operation buttons so that at least one of the direction indicated by the user's face and the direction indicated by the user's line of sight passes through the imaging range of the camera.

7. The authentication control device according to claim 3, wherein the display control means changes the arrangement of the operation buttons depending on the success rate of the biometric authentication, and when the success rate of the biometric authentication corresponding to the specific operation button is less than a predetermined value, changes the position of the specific operation button to a position where the success rate is greater than or equal to the predetermined value.

8. The authentication control device according to claim 3, wherein the display control means determines the layout of the operation buttons depending on whether the hand used to select the operation button is the right hand or the left hand.

9. An authentication control device according to claim 1 or 2, further comprising: an authentication control means for controlling biometric authentication of the user using the authentication information selected by the selection means; and a processing control means for controlling processing corresponding to the selected specific operation button depending on the result of the biometric authentication.

10. An authentication control device according to claim 1 or 2, wherein the biometric information acquisition means acquires the biometric information corresponding to each of a plurality of authentication methods from a single image obtained by a camera that photographs the user.

11. An authentication control device as described in claim 9, wherein the display control means causes the display means to display a first operation button corresponding to a first process and a second operation button corresponding to a second process that requires a higher security level than the first process, the authentication control means controls at least one of a first biometric authentication corresponding to the first process and a second biometric authentication corresponding to the second process according to the selected specific operation button, and the processing control means controls processing corresponding to the selected specific operation button according to at least one of the results of the first biometric authentication and the second biometric authentication.

12. An authentication system comprising: a camera that photographs a user; an authentication control device; and an authentication device, wherein the authentication control device has: a display control means that causes a display means to display operation buttons corresponding to predetermined processes; a reception means that receives selection of the operation buttons from the user; a biometric information acquisition means that acquires one or more pieces of biometric information of the user from the camera based on the timing at which a specific operation button that corresponds to a specific process requiring biometric authentication is selected; and a selection means that selects authentication information to be used for biometric authentication of the user from the one or more pieces of biometric information acquired, and the authentication device performs biometric authentication of the user using the selected authentication information.

13. An authentication control method comprising: displaying operation buttons corresponding to predetermined processes on a display means; accepting selection of the operation buttons from a user; acquiring one or more pieces of biometric information of the user based on the timing at which a specific operation button corresponding to a specific process requiring biometric authentication is selected; and selecting authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information.

14. A program that causes a computer to execute an authentication control method that displays operation buttons corresponding to predetermined processes on a display means, accepts selection of the operation button from a user, acquires one or more pieces of biometric information of the user based on the timing at which a specific operation button corresponding to a specific process requiring biometric authentication is selected, and selects authentication information to be used for biometric authentication of the user from the acquired one or more pieces of biometric information.

Images