Biological information acquisition device, biological information acquisition method, and biological information acquisition system

Abstract

This invention provides a biometric information acquisition device, a biometric information acquisition method, and a biometric information acquisition system that support the acquisition of multiple biometric information used in biometric authentication. [Solution] In the authentication system, the terminal device, which is a biometric information acquisition device, acquires an authentication image in which the authentication area of ​​one hand is captured and an authentication image in which the authentication area of ​​the other hand is captured, calculates the position score of the respective captured positions of one hand and the other hand relative to the captured positions of the authentication area, and if it is determined that at least one position score is equal to or greater than a threshold indicating the criteria for acquiring an authentication image, it acquires the authentication image of the corresponding hand, and if it is determined that the position scores of both the one hand and the other hand are not equal to or greater than the threshold, it decreases the threshold value set for either hand and outputs a request to re-image the authentication area.

Description

Technical Field

[0004] , , , , ,

[0005] , , ,

[0003] , , ,

[0001] The present disclosure relates to a biological information acquisition device, a biological information acquisition method, and a biological information acquisition system.

Background Art

[0002] In Patent Document 1, there is a determination means for pre-photographing an authentication target person and determining a plurality of authentication regions of the authentication target person using a pre-photographed image obtained by the pre-photographing, a photographing control means for controlling one photographing device to photograph a plurality of authentication regions of the authentication target person, and an output means for outputting a photographed image of the plurality of authentication regions obtained by the photographing as authentication data for each authentication region.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In authentication using a plurality of elements (a plurality of parts of the body of an authentication target person) as in Patent Document 1, there is a problem that the burden on the authentication target person is large because there are many places where alignment is required to image the plurality of elements. In addition, since authentication is not performed until alignment is completed, authentication using a plurality of elements takes a long time for authentication per authentication target person, and the waiting time of the authentication target person tends to be long. Therefore, in the above-described authentication using a plurality of elements, a technique for assisting the alignment of the plurality of elements performed by the authentication target person has been demanded.

[0005] The present disclosure has been devised in view of the above-described conventional circumstances, and an object thereof is to provide a biological information acquisition device, a biological information acquisition method, and a biological information acquisition system that assist in the acquisition of a plurality of biological information used for biometric authentication. [Means for solving the problem]

[0006] This disclosure provides a biometric information acquisition device comprising: an acquisition unit that acquires an authentication image of an authentication area of ​​one hand of a person to be authenticated and an authentication image of an authentication area of ​​the other hand of the person to be authenticated; a calculation unit that calculates a position score for the respective imaging positions of the one hand and the other hand relative to the imaging position of the authentication area used for authentication, based on the two authentication images; and a selection unit that, if it is determined that at least one of the calculated position scores is equal to or greater than a threshold indicating the acquisition criteria for the authentication image set for the corresponding hand, acquires the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold, wherein if the selection unit determines that the position scores of both the one hand and the other hand are not equal to or greater than the threshold, it decreases the value of the threshold set for either the one hand or the other hand and outputs a request for re-imaging of the authentication area.

[0007] Furthermore, this disclosure provides a method for acquiring biometric information performed by at least one processor, which acquires an authentication image of an authentication area on one of the hands of a person to be authenticated and an authentication image of an authentication area on the other hand of the person to be authenticated, calculates a position score for the respective imaging positions of the one hand and the other hand relative to the imaging position of the authentication area used for authentication based on the two authentication images, and if it is determined that at least one of the calculated position scores is equal to or greater than a threshold indicating the acquisition criteria for the authentication image set for the corresponding hand, it acquires the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold, and if it is determined that the position scores of both the one hand and the other hand are not equal to or greater than the threshold, it decreases the value of the threshold set for either the one hand or the other hand and outputs a request to re-image the authentication area.

[0008] Furthermore, this disclosure provides a biometric information acquisition system comprising at least one camera for imaging a person to be authenticated, and a biometric information acquisition device capable of communicating with the camera, wherein the camera images an authentication area of ​​one hand and an authentication area of ​​the other hand of the person to be authenticated and transmits the images to the biometric information acquisition device, the biometric information acquisition device acquires an authentication image of the authentication area of ​​the transmitted one hand and an authentication image of the authentication area of ​​the other hand, calculates a position score for the respective imaging positions of the one hand and the other hand relative to the imaging position of the authentication area used for authentication based on the two authentication images, and if it is determined that at least one of the calculated position scores is equal to or greater than a threshold indicating the acquisition criteria for the authentication image set for the corresponding hand, it acquires the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold, and if it is determined that the position scores of both the one hand and the other hand are not equal to or greater than the threshold, it decreases the value of the threshold set for either the one hand or the other hand and outputs a request for re-imaging of the authentication area. [Effects of the Invention]

[0009] According to this disclosure, it is possible to support the acquisition of multiple biometric pieces of information used for biometric authentication. [Brief explanation of the drawing]

[0010] [Figure 1] A diagram showing an example of the appearance of the authentication system according to Embodiment 1. [Figure 2] Partial enlarged view of the authentication system according to Embodiment 1 [Figure 3] A diagram showing an example of the internal configuration of a terminal device according to Embodiment 1. [Figure 4] A flowchart showing an example of the operation procedure for a terminal device. [Figure 5] A diagram illustrating an example of the process for determining if two people are the same person. [Figure 6] Flowchart showing example procedure 1 for fingerprint / palm print matching processing on a terminal device. [Figure 7]Flowchart showing an example of the fingerprint / palmprint matching process procedure of the terminal device 2 [Figure 8] Flowchart showing an example of the fingerprint / palmprint matching process procedure of the terminal device 2 [Figure 9] Diagram showing an example of a guide screen [Figure 10] Diagram showing an example of the transition of the guide screen 1 [Figure 11] Diagram showing an example of the transition of the guide screen 2 [Figure 12] Diagram showing an example of the appearance of the authentication system according to Embodiment 2 [Figure 13] Diagram explaining the imaging method of both hands of the authentication system according to Embodiment 2 [Figure 14] Diagram showing an example of the internal configuration of the terminal device according to Embodiments 2 and 3 [Figure 15] Diagram showing an example of the appearance of the authentication system according to Embodiment 3 [Figure 16] Diagram explaining the imaging method of both hands of the authentication system according to Embodiment 3

Embodiments for Carrying Out the Invention

[0011] Hereinafter, each embodiment specifically disclosing the configuration and operation of the biometric information acquisition device, biometric information acquisition method, and biometric information acquisition system according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, a more detailed description than necessary may be omitted. For example, a detailed description of well-known matters and a redundant description of substantially the same configuration may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate the understanding of those skilled in the art. Note that the attached drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and it is not intended to limit the subject matter described in the claims by these.

[0012] (Embodiment 1) Referring to FIGS. 1 and 2 respectively, the authentication system 100 according to Embodiment 1 will be described. FIG. 1 is a diagram showing an external view example of the authentication system 100 according to Embodiment 1. FIG. 2 is a partially enlarged view of the authentication system 100 according to Embodiment 1.

[0013] The authentication system 100 according to Embodiment 1 executes an identical person determination as to whether the user who is the authentication target and the owner of both hands used for authentication are the same person based on captured images captured by a plurality of cameras, and determines whether there is a suspicion of identity theft of the user by others. Further, when it is determined that the user who is the authentication target and the owner of both hands used for authentication are the same person, the authentication system 100 executes user authentication using at least the fingerprints or palm prints of the user's both hands by the terminal device P1.

[0014] The authentication system 100 is integrally configured with the terminal device P1, each of the first camera CM1, the second camera CM2, and the third camera CM3, each of the first sensor SS1, the second sensor SS2, and the third sensor SS3, the lighting units LT1, LT2, the monitor MN, the panel PNL, and the weight sensors HK, TB, WS. Note that the first sensor SS1, the second sensor SS2, the third sensor SS3, and the weight sensors HK, TB, WS are not all essential components of the authentication system 100, and some or all of them may be omitted. The authentication system 100 is connected to be capable of data communication with an external server S1 (see FIG. 3) and executes user authentication.

[0015] The external server S1 (see FIG. 3) is connected to be capable of data communication with the terminal device P1. The external server S1 is used for user authentication and manages the biometric information of pre-registered users. Here, the biometric information refers to information regarding feature amounts of biometric parts (for example, face, fingerprints of both hands, or palm prints of both hands) used for biometric authentication, or images of biometric parts used for biometric authentication (for example, face images, fingerprint images of both hands, or palm print images of both hands, etc.).

[0016] The external server S1 may acquire a biometric image (e.g., a facial image, fingerprint image, or palm print image) transmitted from the terminal device P1, compare it with the user's biometric information registered in advance, perform biometric authentication, and transmit the result of the biometric authentication to the terminal device P1. Alternatively, the external server S1 may transmit the user's biometric information registered in advance to the terminal device P1, thereby causing the terminal device P1 to perform biometric authentication.

[0017] Terminal device P1 is implemented by, for example, a Personal Computer (hereinafter referred to as "PC"), a notebook PC, or a tablet device. Terminal device P1 performs identity determination and user authentication based on the images captured by the first camera CM1, the second camera CM2, and the third camera CM3, respectively.

[0018] Each of the first cameras CM1 to the third camera CM3 is configured to have at least a lens (not shown) and an image sensor (not shown). The image sensor is a solid-state image sensor, such as a Charged-Coupled Device (CCD) or Complementary Metal Oxide Semiconductor (CMOS), which converts the optical image formed on the imaging surface into an electrical signal. Each of the first cameras CM1 to the third camera CM3 starts imaging in response to an imaging start control instruction transmitted from the terminal device P1. Each of the first cameras CM1 to the third camera CM3 outputs the captured image to the processor 11 of the terminal device P1.

[0019] The first camera CM1 is positioned near the monitor MN and captures images of the user's face, the area from the user's face to both elbows, or the area from the user's face to their waist, which is the area to be authenticated. The installation position of the first camera CM1 is not limited to the top of the monitor MN, but may be installed at position CM1A, for example. The first camera CM1 transmits the captured images to the terminal device P1.

[0020] Furthermore, multiple first cameras CM1 may be installed at different heights. In such cases, the first camera CM1 will activate the first camera CM1 installed at a height suitable for capturing the user, based on the user's position (i.e., height) as seen in the image captured by any of the first cameras CM1, and capture the area from the user's face to both elbows, or from the user's face to their waist. This allows the first camera CM1 to capture images tailored to the user's height, such as for children or wheelchair users.

[0021] The second camera CM2 captures an image of the fingertips or palm of the left hand of the user being authenticated. The second camera CM2 transmits the captured image to the terminal device P1. The housing of the authentication system 100 has a guide HND1 that guides the user's left hand within the field of view AR1 of the second camera CM2.

[0022] The guide HND1 indicates the imaging position (normal position) of the left hand, the hand (left hand) inserted into the field of view AR1 of the second camera CM2, and the orientation of the hand (direction of fingers or palm, etc.). The authentication system 100 also has a wall section WL1 that blocks the lighting of the facility where the authentication system 100 is installed or natural light entering from outside the facility, making it easier to image the left hand inserted into the field of view AR1. The guide HND1 may have lighting (not shown) inside or on the surface of the housing to guide the user's left hand. The lighting (not shown) illuminates or flashes to illuminate or flash the guide HND1.

[0023] The third camera CM3 captures an image of the fingertips or palm of the user's right hand, who is the subject of user authentication. The third camera CM3 transmits the captured image to the terminal device P1. The housing of the authentication system 100 has a guide HND2 that guides the user's right hand within the field of view AR2 of the third camera CM3.

[0024] The guide HND2 indicates the imaging position (normal position) of the right hand, the hand (right hand) inserted into the field of view AR2 of the third camera CM3, and the orientation of the hand (direction of fingers or palm, etc.). The authentication system 100 also has a wall section WL2 that blocks the lighting of the facility where the authentication system 100 is installed or natural light entering from outside the facility, making it easier to image the right hand inserted into the field of view AR2. The guide HND2 may have lighting (not shown) inside or on the surface of the housing to guide the user's right hand. The lighting (not shown) illuminates or flashes to illuminate or flash the guide HND2.

[0025] Each of the first to third sensors SS1 to SS3 is implemented, for example, by infrared, ultrasonic, or ToF sensors, and detects the presence of the user or the user's biological parts from the field of view of the corresponding camera. However, if the detection of the user or the user's biological parts is performed by image processing of the images captured by each of the first to third cameras CM1 to CM3, each of the first to third sensors SS1 to SS3 may be omitted.

[0026] The first sensor SS1 is a so-called human presence sensor that detects whether or not a user is present in front of the authentication system 100 (facing the monitor MN and within the field of view of the first camera CM1). The first sensor SS1 generates a detection result indicating the presence or absence of a user and transmits it to the terminal device P1.

[0027] The second sensor SS2 is a so-called human presence sensor that detects whether or not a user is present in the field of view AR1 of the second camera CM2. The second sensor SS2 transmits the detection result of whether or not the user's left hand has been inserted into the field of view AR1 to the terminal device P1.

[0028] The third sensor SS3 is a so-called human presence sensor that detects whether or not a user is present in the field of view AR2 of the third camera CM3. The third sensor SS3 transmits the detection result of whether or not the user's right hand has been inserted into the field of view AR2 to the terminal device P1.

[0029] The process of detecting the insertion of a user's hand is not limited to the second sensor SS2 or the third sensor SS3; the aforementioned second camera CM2 or third camera CM3 may also perform this function.

[0030] The weight sensor WS is installed on the floor or other surface in front of the authentication system 100 and detects whether or not a heavy object resembling a user is present in front of the authentication system 100. The weight sensor WS generates a detection result indicating whether or not a heavy object resembling a user is present and transmits it to the terminal device P1.

[0031] Weight sensor HK is installed on a hook on which a user of the authentication system 100 can hang their luggage, and detects the presence or absence of luggage on the hook. Weight sensor TB is installed on a table on which a user of the authentication system 100 places their luggage, and detects the presence or absence of luggage placed on the table. Weight sensors HK and TB may each be equipped with a weight sensor (not shown) capable of detecting whether or not a heavy object (specifically, the user's luggage) is present.

[0032] The speaker SPK is configured to output sound. Multiple speaker SPKs are provided on the housing of the authentication system 100. One speaker is provided at any position on the left side of the authentication system 100, as viewed from a user standing in front of the housing of the authentication system 100, and is configured to output sound to guide the user to the imaging position (normal position) of their left hand. The other speaker is provided at any position on the right side of the authentication system 100, as viewed from a user standing in front of the housing of the authentication system 100, and is configured to output sound to guide the user to the imaging position (normal position) of their right hand.

[0033] The monitor MN is configured using, for example, a Liquid Crystal Display (LCD) or an organic electroluminescence (EL). The monitor MN outputs and displays various screens generated by the processor 11. These various screens include guide screens SC1, SC21, SC22, SC23, SC24, SC41, SC42, SC43, SC44 (see Figures 9 to 11) that guide the user during user authentication or identity verification, a screen (not shown) that notifies the user of the results of user authentication or identity verification performed by the external server S1, or a warning screen (not shown) that warns of suspected impersonation.

[0034] Each of the lighting units LT1 and LT2 is implemented by at least one light-emitting element, such as a Light Emitting Diode (LED). Note that each of the lighting units LT1 and LT2 may be a point light source or a surface light source.

[0035] The illumination unit LT1 illuminates the user's left hand (fingertips or palm) inserted within the field of view AR1 of the second camera CM2. The illumination unit LT1 performs on / off control based on control commands transmitted from the terminal device P1.

[0036] The illumination unit LT2 illuminates the user's right hand (fingertip or palm) inserted within the field of view AR2 of the third camera CM3. The illumination unit LT2 performs on / off control based on control commands transmitted from the terminal device P1.

[0037] The panel PNL is a reading surface for reading two-dimensional codes (e.g., QR codes® or two-dimensional barcodes) that have been distributed to the user in advance. The panel PNL is located inside the housing of the authentication system 100, and a camera (not shown) located behind the reading surface reads the two-dimensional code held over the panel PNL. The information of the read two-dimensional code is transmitted to the terminal device P1, and the terminal device P1 performs user authentication processing by comparing the two-dimensional code distributed with the read two-dimensional code.

[0038] Next, an example of the internal configuration of terminal device P1 will be described with reference to Figure 3. Figure 3 is a diagram showing an example of the internal configuration of terminal device P1 according to Embodiment 1.

[0039] Terminal device P1 is connected to each of the first camera CM1, second camera CM2, and third camera CM3, each of the first sensor SS1, second sensor SS2, and third sensor SS3, the illumination units LT1 and LT2, the monitor MN, the speaker SPK, the external server S1 (see Figure 3), and the weight sensors WS, HK, and TB, enabling data communication between them. Note that the monitor MN may also be provided by terminal device P1. Terminal device P1 includes a communication unit 10, a processor 11, and a memory 12.

[0040] The communication unit 10 is connected via wired or wireless communication to each of the first camera CM1, second camera CM2, and third camera CM3, each of the first sensor SS1, second sensor SS2, and third sensor SS3, the lighting units LT1 and LT2, the monitor MN, the external server S1 (see Figure 3), and the weight sensors WS, HK, and TB, and performs data transmission and reception. Wireless communication here refers to short-range wireless communication such as Bluetooth® or NFC®, or communication via a wireless Local Area Network (LAN) such as Wi-Fi®.

[0041] The communication unit 10 outputs various data transmitted from the first camera CM1, second camera CM2, third camera CM3, first sensor SS1, second sensor SS2, third sensor SS3, external server S1 (see Figure 3), or weight sensors WS, HK, TB to the processor 11. The communication unit 10 transmits the various data output from the processor 11 to the monitor MN, lighting units LT1, LT2, or external server S1.

[0042] The processor 11 is configured using, for example, a Central Processing Unit (hereinafter referred to as "CPU"), a Field Programmable Gate Array (hereinafter referred to as "FPGA"), or a Graphics Processing Unit (hereinafter referred to as "GPU"), and works in cooperation with the memory 12 to perform various processing and control. Specifically, the processor 11 refers to the programs and data held in the memory 12 and executes those programs to realize various functions such as user detection, imaging of various biological parts of the user (e.g., face, area from face to both elbows or face to waist, fingertips, or palm, etc.), identity determination, user authentication using the captured images, and user authentication using a 2D code. The above-mentioned functions are merely a list of some of the functions that the processor 11 can realize, and are not limited to these.

[0043] The various functions that the processor 11 can implement are the same as the various functions that the processor 11A can implement in the terminal device P1A according to Embodiments 2 and 3 described later.

[0044] Memory 12 includes, for example, Random Access Memory (RAM) used as work memory when executing each process of the processor 11, and Read Only Memory (ROM) which stores programs and data that define the operation of the processor 11. RAM temporarily stores data or information generated or acquired by the processor 11. ROM contains programs that define the operation of the processor 11. Memory 12 may also record data from 2D codes distributed to the user in advance.

[0045] Next, with reference to Figures 4 and 5, examples of the operation procedures of terminal devices P1 and P1A in embodiments 1 to 3 will be described. Figure 4 is a flowchart showing examples of the operation procedures of terminal devices P1 and P1A. Figure 5 is a diagram showing an example of the same person determination process.

[0046] Note that the processes shown in Figures 4 to 6 are described as examples of those performed by terminal device P1, but the same applies to terminal device P1A, which will be described later, so the explanation for terminal device P1A will be omitted. Also, in the following explanation, an authentication system 100 equipped with terminal device P1 will be described as an example, but the same applies to authentication systems 100A and 100B, which each have terminal device P1A, which will be described later, so the explanation for authentication systems 100A and 100B will be omitted.

[0047] The terminal device P1 determines whether or not it has detected a user (person) in front of the authentication system 100 based on detection information transmitted from the first sensor SS1 or weight sensors WS, HK, TB, etc. (St11).

[0048] If terminal device P1 determines in step St11 that it has detected a user (person) in front of the authentication system 100 (St11, YES), it causes the first camera CM1 to capture an image of the user in front of the authentication system 100. Terminal device P1 acquires the captured image transmitted from the first camera CM1. Terminal device P1 detects the user's face and body from the acquired captured image, cuts out the detected area, and acquires the user's face image and body image (St12).

[0049] Furthermore, if terminal device P1 determines in step St11 that it has detected a user (person) from the front of the authentication system 100 (St11, YES), it may guide the user's hands to guides HND1 and HND2 by turning on or flashing the lights (not shown) provided on the lighting unit TL or each of the guides HND1 and HND2. In addition, terminal device P1 may turn on the lights (not shown) on the lighting unit TL or each of the guides HND1 and HND2, along with a guide message "Please insert your hands into the positions of the left and right guides" and an image showing a person standing in front of the housing of the authentication system 100 as shown in Figure 1, with hands inserted into the corresponding fields of view AR1 and AR2, respectively, and display these on monitor MN. This allows terminal device P1 to quickly guide both of the user's hands to the respective positions of guides HND1 and HND2 in order to quickly complete the processing in step St13 described later.

[0050] Here, the face image is, for example, an image generated by cropping the facial regions ARC23 and ARC31 shown in Figure 5. The body image is, for example, an image captured with the field of view ARC1 shown in Figure 5, and is an image of the user's body including biological parts from the user's face (head) to the elbow, or from the user's face (head) to the waist.

[0051] On the other hand, if terminal device P1 determines in step St11 that it has not detected a user (person) in front of the authentication system 100 (St11, NO), it returns to the process of step St11.

[0052] Terminal device P1 determines whether the user's left hand is inserted into the field of view AR1 of the second camera CM2 and the user's right hand is inserted into the field of view AR2 of the third camera CM3, that is, whether the insertion of both of the user's hands is detected (St13).

[0053] If terminal device P1 determines in step St13 that insertion of both user's hands has not been detected (St13, NO), it returns to the process of step St13.

[0054] On the other hand, if terminal device P1 determines in step St13 that the insertion of both of the user's hands has been detected (St13, YES), it performs a determination to determine whether the user shown in the face image and body image is the same person as the user who owns the inserted hands (identity determination) (St14). Terminal device P1 determines whether the user (person) captured by the first camera CM1 is the same person as the user (person) with both hands inserted, that is, the user (person) captured by the second camera CM2 and the third camera CM3, respectively (St15).

[0055] In step St15, if terminal device P1 determines that the user (person) captured by the first camera CM1 and the owner (user) of both hands detected are the same person (St15, YES), it performs a face matching process based on the user's face image (St16) and a fingerprint or palm print matching process (St17, St17A). Note that steps St16 and St17, St17A are not mandatory, and either one may be omitted. Also, in steps St17, St17A, the fingerprint matching process and the palm print matching process are not mandatory, and it is sufficient if at least one of the matching processes is performed.

[0056] On the other hand, in step St15, terminal device P1 determines that the user (person) captured by the first camera CM1 and the owner (user) of both hands detected are not the same person (St15, NO), and determines that there is a suspicion of impersonation by another person. It then generates a screen (not shown) warning of impersonation and displays it on monitor MN, or issues an alert indicating that there is a suspicion of impersonation by the administrator, security guard, or officer of the authentication system 100 (St18).

[0057] <Identical Person Detection Process> Here, we will explain the process of determining the same person. Terminal device P1 performs same person determination based on skeletal detection or based on the size of the face area. Note that whether to perform same person determination using one or both of these two methods may be set in advance by the administrator managing the authentication system 100.

[0058] The first camera CM1 captures images of the user within the field of view ARC1. As shown in Figure 5, when performing skeletal detection, the field of view ARC1 is set to capture the user's body, that is, the area from the user's face to both elbows, or from the user's face to the waist. Also, when determining the size of the face area, the field of view ARC1 is set to capture at least the area including the user's face.

[0059] When performing identity determination based on skeletal detection, terminal device P1 detects the user's skeleton (lines and joint points (black dots) showing the skeleton in Figure 5) and the face region ARC23 containing the user's face from the captured image (body image) captured by the first camera CM1. Terminal device P1 divides the rectangular field of view ARC1 into four equal parts using the x-axis passing through the midpoints of the two opposing short sides and the y-axis passing through the midpoints of the two opposing long sides. Terminal device P1 determines whether the joint points corresponding to the user's elbow or waist are included in the third quadrant region ARC21 and the fourth quadrant region ARC22, respectively, and whether the face region ARC23, in which the user's face is visible, is included in the field of view ARC1.

[0060] If terminal device P1 determines that regions ARC21 and ARC22 contain joint points corresponding to the user's elbow or waist, and also contain a face region AR23 showing the user's face, it determines that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are the same person. On the other hand, if terminal device P1 determines that regions ARC21 and ARC22 do not contain joint points corresponding to the user's elbow or waist, or do not contain a face region AR23 showing the user's face, it determines that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are not the same person, meaning there is a possibility of impersonation by another person.

[0061] When performing same-person determination based on the size of the face region, terminal device P1 detects the face region ARC31 containing the user's face from the captured image (face image) captured by the first camera CM1. Terminal device P1 determines whether the size of the detected face region ARC31 is greater than or equal to a predetermined value.

[0062] If terminal device P1 determines that the size of the detected face region ARC31 is greater than or equal to a predetermined value, it determines that the captured user (person) is close enough to the authentication system 100, that the possibility of impersonation by another person is low, and that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are the same person. On the other hand, if terminal device P1 determines that the size of the detected face region ARC31 is not greater than or equal to a predetermined value, it determines that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are not the same person, that is, that there is a possibility of impersonation by another person.

[0063] <Fingerprint or palm print matching process 1> Here, with reference to Figure 6, the fingerprint or palm print matching process 1 in step St17 will be explained. Figure 6 is a flowchart of example 1 of the fingerprint / palm print matching process procedure for terminal devices P1 and P1A. Example 1 of the fingerprint / palm print matching process procedure (step St17) shows the procedure for acquiring images of the biological parts of both hands when it is determined that both the imaging position of the biological parts of the left hand and the imaging position of the biological parts of the right hand are suitable positions for capturing biological images to be used for matching biological parts.

[0064] In the following explanation of step St17, "biological part" refers to the fingertip when it is a fingerprint matching process, and to the palm when it is a palm print matching process. Furthermore, when terminal device P1 performs both fingerprint matching and palm print matching, it performs the fingerprint and palm print matching process by repeating the process in step St17 twice.

[0065] Terminal device P1 detects biological tissue (i.e., fingertips or palms) from images captured by the second camera CM2 and the third camera CM3, respectively, and calculates a position score for both the left and right hands that indicates the degree to which the imaging position of the biological tissue is suitable for capturing a biological image (i.e., a fingerprint image or a palm print image) used for fingerprint matching (i.e., fingerprint authentication) or palm print matching (i.e., palm print authentication) (hereinafter referred to as "normal position").

[0066] Terminal device P1 performs a determination (hereinafter referred to as "position evaluation determination") based on the calculated position scores of the biological parts of the left and right hands to determine whether the imaging positions of the biological parts are suitable for capturing biological images used for fingerprint or palm print matching (St22). Based on the results of the position evaluation determination, terminal device P1 determines whether the position score of at least one of the biological parts of both hands (i.e., the left hand or the right hand) is above a reference threshold (St23).

[0067] If, in step St23, the terminal device P1 determines that the position score of at least one biological site is above a reference threshold (St23, YES), it generates a guide screen SC22 (see Figure 10) that guides the other biological site, which was determined to be in an abnormal position, to a normal position, and displays it on the monitor MN (St24).

[0068] On the other hand, if terminal device P1 determines in step St23 that the position score of at least one biological part is not above a reference threshold, that is, that the position scores of both biological parts are not above a threshold (St23, NO), it calculates the difference between the position score of the left hand and the current threshold corresponding to the left hand, and the difference between the position score of the right hand and the current threshold corresponding to the right hand. Based on the magnitude (absolute value) of the calculated difference, terminal device P1 lowers the current threshold used in the position evaluation judgment performed on the hand with the smaller difference by a predetermined value (St25). In addition, terminal device P1 generates guide screens SC21 and SC41 (see Figures 10 and 11) that guide the biological part of the other hand, which has a large difference between the current threshold and the position score, to the normal position, and displays them on monitor MN (St25).

[0069] As a result, terminal device P1 guides the other hand, which is further from its normal position, to the normal position, allowing the user to concentrate on aligning the other hand, thereby reducing the physical burden on the user caused by aligning multiple biological parts. The user only needs to align the other hand displayed on guide screens SC21 and SC41, making alignment easier.

[0070] Terminal device P1 displays guide screens SC21 and SC41 on monitor MN, and then instructs the second camera CM2 and the third camera CM3 to perform imaging of the living tissue again. Terminal device P1 acquires the captured images of the left and right hands (St26). Terminal device P1 detects the living tissue (i.e., fingertips or palms) from the acquired images of the left and right hands and calculates a position score for each (St26).

[0071] Terminal device P1 performs position evaluation determination again (St27) based on the calculated position score and the current thresholds corresponding to one hand and the other hand, respectively. The current thresholds used here are the thresholds after they have been modified in step St25. For example, if step St25 is performed only once, the current threshold for the other hand is a predetermined value less than the reference threshold. Also, for example, if step St25 is performed twice and the thresholds corresponding to the left hand and the right hand are each lowered once, the current thresholds for one hand and the other hand are values ​​that have been lowered by a predetermined value from the reference threshold used in step St23.

[0072] Furthermore, if terminal device P1 determines that the position scores of both biological parts of both hands are not equal to or above the current threshold within a predetermined time or a predetermined number of times, it may determine that user authentication by fingerprint or palm print matching is not possible and may call the administrator, security guard, or officer of the authentication system 100.

[0073] Terminal device P1 determines whether the position score of at least one of the calculated right hand position scores and left hand position scores is equal to or greater than a reference threshold (St28).

[0074] In step St28, terminal device P1 determines that the position score of at least one of the right hand and left hand positions is above a reference threshold (St28, YES), and acquires the captured image in which the position score is determined to be above the reference threshold as a biometric image (i.e., a fingerprint image or palm print image) to be used for fingerprint or palm print matching (St29). Terminal device P1 calculates a matching score indicating the likelihood that the acquired biometric image belongs to one of the pre-registered users, based on the matching of the acquired biometric images of the left and right hands with each of the biometric images of multiple users managed by the external server S1 and registered in advance (St30).

[0075] The processing in step St30 may be performed by an external server S1. In this case, terminal device P1 may send the acquired biometric images of the left and right hands, along with a control command requesting user authentication processing based on these biometric images, to the external server S1 and obtain the matching score or user authentication result information from the external server S1.

[0076] On the other hand, in step St28, if terminal device P1 determines that the position score of at least one of the two hands, the right hand and the left hand, is not equal to or greater than the reference threshold (St28, NO), it causes the second camera CM2 and the third camera CM3 to perform imaging of the biological tissue again. Terminal device P1 acquires the captured images of the left and right hands (St31). Terminal device P1 detects the biological tissue (i.e., fingertips or palms) from the acquired images of the left and right hands and calculates the position score for each (St31). Terminal device P1 recalculates the position score for each and performs the position evaluation determination again (St22). The threshold used in the process of step St23 after the processing of steps St31 and St22 is the reference threshold.

[0077] The terminal device P1 determines whether the user being authenticated is one of the users registered in advance (i.e., whether the user authentication result is OK) based on the result of the facial recognition process in step St16 (recognition score) and the result of the fingerprint or palm print recognition in step St17 (recognition score) (St19).

[0078] If terminal device P1 determines in step St19 that the user authentication result is OK (St19, YES), it terminates the operation procedure shown in Figure 4. On the other hand, if terminal device P1 determines in step St19 that the user authentication result is NOT OK (St19, NO), it returns to the process in step St11.

[0079] In the example shown in Figure 6, biometric images are acquired when it is determined that both hand images are in a normal position, but this is not limited to this example. Biometric images may be acquired sequentially when it is determined that the hand image is in a normal position. This reduces the burden on the terminal device P1 to adjust the posture of the face and both hands to match the design of the authentication system 100 in order to acquire images suitable for biometric authentication. In addition, since the terminal device P1 can perform biometric authentication (matching) one hand at a time, the time required to match fingerprints or palm prints of both hands can be shortened.

[0080] Furthermore, in the example described above, if the result of the user authentication is determined to be incorrect in step St19 (St19, NO), further authentication may be performed using a 2D code distributed to the user's device in advance (e.g., a smartphone or tablet device), or a 2D code printed on paper. In such a case, the terminal device P1 may generate a guide screen (not shown) that guides the user to hold the 2D code over the panel PNL, display it on the monitor MN, and read the 2D code held over the panel PNL with a camera (not shown). If the terminal device P1 determines that the read 2D code matches the 2D code distributed to the user in advance, it determines that the user authentication was successful. On the other hand, if the terminal device P1 determines that the read 2D code does not match the 2D code distributed to the user in advance, it determines that the user authentication was unsuccessful.

[0081] As described above, in the embodiments 1 to 3, terminal devices P1 and P1A can reduce the burden on the user in aligning their face and hands to match the imaging positions and postures of the face, left hand, and right hand, respectively, based on the design of the authentication systems 100, 100A, and 100B, that is, the structure of the authentication systems 100, 100A, and 100B. Furthermore, terminal devices P1 and P1A can perform user authentication that more effectively suppresses impersonation by others.

[0082] Furthermore, this allows the authentication systems 100, 100A, and 100B to more efficiently align multiple biometric body parts performed by the user, thereby reducing the time required to authenticate each user. This reduction in the time required to authenticate each user is also useful, for example, when the authentication systems 100, 100A, and 100B are installed in facilities such as airports and train stations, as a way to more effectively reduce the congestion of users waiting for authentication.

[0083] <Fingerprint or palm print matching process 2> Referring to Figures 7 and 8, the fingerprint or palm print matching process 2 in step St17A will be explained. Figure 7 is a flowchart of example 2 of the fingerprint / palm print matching process procedure for terminal devices P1 and P1A. Figure 8 is a flowchart of example 2 of the fingerprint / palm print matching process procedure for terminal devices P1 and P1A. Example 2 of the fingerprint / palm print matching process procedure (step St17A) shows the procedure for acquiring captured images of one or both hands, which are determined to be in a normal position, at the time when the imaging position is determined to be in a normal position.

[0084] The processes in steps St21 to St23 and St25 to St27 shown in Figure 7 are the same as those shown in Figure 6, so their explanation is omitted.

[0085] Similarly, in the explanation of step St17A that follows, "biological part" refers to the fingertip when it is a fingerprint matching process, and to the palm when it is a palm print matching process. Furthermore, when terminal device P1 performs both fingerprint matching and palm print matching, it performs the fingerprint and palm print matching processes by repeating the process in step St17A twice.

[0086] If, in step St23, terminal device P1 determines that the position score of at least one biological site is above the reference threshold (St23, YES), it further determines whether the position scores of the biological sites of both hands are above the reference threshold (St41).

[0087] If, in step St41, the terminal device P1 determines that the position scores of the biological parts of both hands are above a reference threshold (St41, YES), it acquires the captured images of both hands, for which the position scores are determined to be above the reference threshold, as biometric images (i.e., fingerprint images or palm print images) to be used for fingerprint or palm print matching (St42). Based on the matching of the acquired biometric images of the left and right hands with the biometric images of multiple users managed by the external server S1 and registered in advance, the terminal device P1 calculates a matching score indicating the likelihood that the acquired biometric image belongs to one of the pre-registered users (St43).

[0088] Note that the processing in step St43 may be performed by an external server S1. In such a case, terminal device P1 may send the acquired biometric images of the left and right hands, along with a control command requesting user authentication processing based on these biometric images, to the external server S1 and obtain the matching score or user authentication result information from the external server S1.

[0089] On the other hand, if terminal device P1 determines in step St41 that the position scores of the biological parts of both hands are not above a reference threshold (St41, NO), it acquires an image of the hand that is determined to be in a normal position (St44).

[0090] Terminal device P1 generates a guide screen SC22 (see Figure 10) that guides the hand that has been determined to be in an abnormal position to the correct position, and displays it on monitor MN (St45).

[0091] Terminal device P1 displays guide screens SC21 and SC41 on monitor MN, and then instructs a camera capable of capturing images of the hand that was determined to be in an abnormal position (i.e., the second camera CM2 or the third camera CM3) to capture images of the hand that was determined to be in an abnormal position and was guided by guide screens SC21 and SC41 again. Terminal device P1 acquires the captured image of the guided hand and calculates the position score of the biological part (St46), and then performs a position evaluation judgment again based on the calculated position score and the current threshold corresponding to this hand (St47). Note that the current threshold used here is the threshold after it has been changed in the processing of step St25.

[0092] Terminal device P1 determines whether the position score of the biological part of the guided person's hand is above a reference threshold (St48).

[0093] If, in step St48, the terminal device P1 determines that the position score of the biological parts of the guided person's hand is above a reference threshold (St48, YES), it acquires the captured image of the biological parts of the guided person's hand whose position score is determined to be above the reference threshold as a biometric image (i.e., a fingerprint image or palm print image) to be used for fingerprint or palm print matching (St49). Based on the matching of the acquired biometric images of the left and right hands with each of the biometric images of multiple users managed by the external server S1 and registered in advance, the terminal device P1 calculates a matching score indicating the likelihood that the acquired biometric image belongs to one of the pre-registered users (St43).

[0094] As described above, the terminal devices P1 and P1A in Embodiments 1 to 3 can more efficiently enable users to align multiple biological body parts by adjusting the reference threshold, thereby reducing the time required for user authentication per person. Furthermore, such a reduction in the time required for user authentication per person is useful, for example, as a more effective way to reduce the queue of users waiting for authentication when the authentication systems 100, 100A, and 100B are installed in facilities such as airports and train stations.

[0095] Refer to Figure 9 to describe the guide screen SC1 that guides the position of the face and both hands. Figure 9 is a diagram showing an example of the guide screen SC1.

[0096] Guide screen SC1 is generated by terminal devices P1 and P1A and displayed on monitor MN. Guide screen SC1 is a screen that guides each of the multiple biological parts, namely the face and both hands, to the imaging position (normal position) for capturing images suitable for matching the face and both hands, respectively.

[0097] The guide screen SC1 shown in Figure 9 includes an image IMG11 captured by the first camera CM1, a guide frame GD1 that indicates the normal position of the face and guides the position of the face, a cropped image IMG11A of the left hand detected from the image captured by the second camera CM2 and a guide frame GD11 that indicates the normal position of the left hand and guides the position of the left hand, a cropped image IMG11B of the right hand detected from the image captured by the third camera CM3 and a guide frame GD12 that indicates the normal position of the right hand and guides the position of the right hand, and a message MSG1 "Align your face and hands with the guide frame" that notifies the user of the guidance. The guide screen SC1 is generated by superimposing the guide frames GD1, GD11, GD12 and cropped images IMG11A, IMG11B onto the image IMG11.

[0098] Therefore, terminal devices P1 and P1A can display the size and position of the face and both hands relative to each of the guide frames GD1, GD11, and GD12 on monitor MN. This allows terminal devices P1 and P1A to compare the captured image IMG1 and cropped images IMG11A and IMG11B displayed on the guide screen SC1 with the guide frames GD1, GD11, and GD12, thereby assisting the user in aligning their face and both hands and reducing the physical burden on the user during this alignment process. By looking at the guide screen SC1, the user can align multiple body parts without moving their head (face) significantly, making alignment easier.

[0099] As described above, in the authentication systems 100 to 100B of this disclosure, a first camera CM1 that captures the user's face is positioned near the monitor MN on which various guide screens are displayed. This allows the authentication systems 100, 100A, and 100B to capture the user's face using the first camera CM1 positioned near the monitor MN while the user is looking at the monitor MN, thereby reducing the burden on the user in terms of posture and other aspects when aligning multiple body parts. In other words, the user can naturally align their face while aligning their hands while looking at the various guide screens displayed on the monitor MN.

[0100] Furthermore, this allows the authentication systems 100, 100A, and 100B to more efficiently align multiple biological body parts performed by the user, thereby reducing the time required to authenticate each user.

[0101] Next, we will explain the guide screens SC21 to SC24 that guide the position of both hands, referring to Figure 10. Figure 10 shows an example of the transition of guide screens SC21 to SC24. Note that the guide screens SC21 to SC24 shown in Figure 10 are an example of the transition of guide screens when imaging fingertips (fingerprints), but the same applies when imaging the palm (palm print), so the explanation is omitted here. Furthermore, the example of the transition of guide screens 1 shown in Figure 10 describes an example in which, if it is determined that the fingertips of either hand are in the normal position, the fingertips positioned in the normal position are imaged.

[0102] Each of the guide screens SC21 to SC24 is generated by terminal device P1 and displayed on monitor MN. Guide screens SC21 to SC24 are screens that guide the user to the normal position of each biological part of both hands (in this case, the fingertips).

[0103] If terminal devices P1 and P1A determine, based on the detection results of the second sensor SS2 and the third sensor SS3, that the user's hands are not inserted into the fingertip (fingerprint) imaging area of ​​the field of view AR1 and AR2 of the second camera CM2 and the third camera CM3, respectively, they generate a guide screen SC21 and display it on monitor MN.

[0104] Guide screen SC21 includes an image IMG21 captured by the second camera CM2, a guide frame GD21 indicating the normal position of the left hand and guiding the left hand's imaging position, an image IMG31 captured by the third camera CM3, and a guide frame GD31 indicating the normal position of the right hand and guiding the right hand's imaging position. Guide screen SC21 superimposes a guide frame AR11 indicating the fingertip (fingerprint) imaging area on the image IMG21, and a message MSG21 "Please insert your hand" guiding the user's fingertip within this guide frame AR11. Guide screen SC21 also superimposes a guide frame AR21 indicating the fingertip (fingerprint) imaging area on the image IMG31, and a message MSG31 "Please insert your hand" guiding the user's fingertip within this guide frame AR21. For clarity, the illustrations of guide frames GD21 and GD31 are omitted in subsequent guide screens SC22 to SC24.

[0105] If terminal devices P1 and P1A determine, based on the detection results of the second sensor SS2 and the third sensor SS3, that the user's left hand is inserted into the imaging area of ​​the second camera CM2 and the user's right hand is not inserted into the imaging area of ​​the third camera CM3, they generate a guide screen SC22 and display it on monitor MN.

[0106] The guide screen SC22 includes the captured image IMG22 taken by the second camera CM2 and the captured image IMG32 taken by the third camera CM3. On the captured image IMG22, a guide frame AR11 is superimposed, and the user's fingertip is inserted into this guide frame AR11, along with the message MSG22 "Image acquisition in progress" notifying the user that the fingertip image acquisition has begun. Additionally, on the captured image IMG32, a guide frame AR21 indicating the area for capturing the fingertip (fingerprint) is superimposed, along with the message MSG32 "Please place your hand inside" guiding the user's fingertip into this guide frame AR21.

[0107] When terminal devices P1 and P1A have completed capturing images of the left hand's fingertips (fingerprints) using the second camera CM2 and have determined, based on the detection results from the third sensor SS3, that the user's right hand is inserted into the imaging area of ​​the third camera CM3, they generate a guide screen SC23 and display it on the monitor MN.

[0108] The guide screen SC23 includes the captured image IMG23 taken by the second camera CM2 and the captured image IMG33 taken by the third camera CM3. On the guide screen SC23, a guide frame AR11 is superimposed on the captured image IMG23, with the user's fingertip inserted within the guide frame AR11, and a message MSG23 "Image captured. Please remove your hand" notifying the user that the fingertip has been captured. Additionally, on the guide screen SC23, a guide frame AR21 indicating the area for capturing the fingertip (fingerprint) is superimposed on the captured image IMG33, with the user's fingertip inserted within the guide frame AR21, and a message MSG33 "Image capture in progress" notifying the user that the fingertip capture has begun.

[0109] When the left hand is removed from the field of view AR1 of the second camera CM2 and the imaging of the fingertips (fingerprints) of the left hand by the third camera CM3 is completed, terminal devices P1 and P1A generate a guide screen SC24 and display it on monitor MN.

[0110] The guide screen SC24 includes the captured image IMG24 taken by the second camera CM2 and the captured image IMG34 taken by the third camera CM3. On the captured image IMG34, the guide screen SC24 superimposes a guide frame AR21 indicating the area for capturing the fingertip (fingerprint), and a message MSG34 "Image captured. Please remove your hand" which indicates that the user's fingertip has been inserted into the guide frame AR21 and that the fingertip capture is complete.

[0111] In this disclosure, as an example, a screen transition example is described in which guide screens SC21 to SC24 displayed on monitor MN guide both hands to the correct position. However, the guidance of both hands may also be performed using sound. In such a case, the authentication system 100 is equipped with speaker SPKs on the left and right sides of the housing, respectively. Terminal devices P1 and P1A may calculate the distance (difference) between the correct positions of the left and right hands and the current positions of the user's left and right hands, and output sound of a pitch or volume corresponding to the calculated distance from their respective speaker SPKs. For example, terminal devices P1 and P1A may guide the user's hands by outputting higher-pitched sound as the calculated distance decreases, lower-pitched sound as the distance increases, and outputting a specific sound when the distance is less than a predetermined value (for example, a distance at which the position score is equal to or greater than a reference value).

[0112] Furthermore, voice guidance may be provided only for the other hand that is further from its normal position. This allows terminal devices P1 and P1A to focus the user's attention on the other hand that requires alignment by providing voice guidance only for the other hand that is further from its normal position, thereby reducing the physical burden on the user caused by aligning multiple biological parts.

[0113] As a result, terminal devices P1 and P1A can provide guidance corresponding to the user's left and right hands, respectively. The user can more easily align each hand by having the current status (imaging position and posture) of both hands displayed on a single guide screen SC21 to SC24.

[0114] Furthermore, this allows the authentication systems 100, 100A, and 100B to more efficiently align multiple biological body parts performed by the user, thereby reducing the time required to authenticate each user.

[0115] Next, with reference to Figure 11, we will explain the guide screens SC41 to SC44 that guide the position of both hands. Figure 11 shows an example of the transition of guide screens SC41 to SC44 (Example 2). Note that the guide screens SC41 to SC44 shown in Figure 11 are an example of the transition of guide screens when imaging fingertips (fingerprints), but the same applies when imaging palms (palm prints), so the explanation is omitted here. Furthermore, the example of the transition of guide screens (Example 2) shown in Figure 11 describes an example in which, when it is determined that the fingertips of both hands are in the normal position, the fingertips of both hands, which are positioned in the normal position, are imaged almost simultaneously.

[0116] Guide screens SC41 to SC44 are generated by terminal devices P1 and P1A and displayed on monitor MN. Guide screens SC41 to SC44 are screens that guide each hand to the (normal position) for capturing images suitable for matching (authentication) of each hand.

[0117] If terminal devices P1 and P1A determine, based on the detection results of the second sensor SS2 and the third sensor SS3, that the user's hands are not inserted into the fingertip (fingerprint) imaging area of ​​the field of view AR1 and AR2 of the second camera CM2 and the third camera CM3, respectively, they generate a guide screen SC41 and display it on monitor MN.

[0118] Guide screen SC41 includes an image IMG41 captured by the second camera CM2, a guide frame GD41 indicating the normal position of the left hand and guiding the left hand's imaging position, and an image IMG51 captured by the third camera CM3, and a guide frame GD51 indicating the normal position of the right hand and guiding the right hand's imaging position. Guide screen SC41 superimposes a guide frame AR11 indicating the fingertip (fingerprint) imaging area on the image IMG41, and a message MSG41 "Please insert your hand" guiding the user's fingertip within this guide frame AR11. Guide screen SC41 also superimposes a guide frame AR21 indicating the fingertip (fingerprint) imaging area on the image IMG51, and a message MSG51 "Please insert your hand" guiding the user's fingertip within this guide frame AR21. For clarity, the illustrations of guide frames GD41 and GD51 are omitted in subsequent guide screens SC42 to SC44.

[0119] If terminal devices P1 and P1A determine, based on the detection results of the second sensor SS2 and the third sensor SS3, that the user's left hand is inserted into the imaging area of ​​the second camera CM2 and the user's right hand is inserted into the imaging area of ​​the third camera CM3, they generate a guide screen SC42 and display it on monitor MN.

[0120] The guide screen SC42 includes the captured image IMG42 taken by the second camera CM2 and the captured image IMG52 taken by the third camera CM3. On the guide screen SC42, a guide frame AR11 is superimposed on the captured image IMG42, with the user's fingertip inserted into the guide frame AR11 and a message MSG42 "Capturing" notifying the start of fingertip imaging. Additionally, on the guide screen SC42, a guide frame AR21 indicating the fingertip (fingerprint) imaging area is superimposed on the captured image IMG52, with the user's fingertip inserted into the guide frame AR21 and a message MSG52 "Capturing" notifying the start of fingertip imaging.

[0121] When terminal devices P1 and P1A determine that imaging of the fingertips (fingerprints) of the left hand by the second camera CM2 and the fingertips (fingerprints) of the right hand by the third camera CM3 has been completed, they generate a guide screen SC43 and display it on monitor MN.

[0122] The guide screen SC43 includes the captured image IMG43 taken by the second camera CM2 and the captured image IMG53 taken by the third camera CM3. On the guide screen SC43, a guide frame AR11 is superimposed on the captured image IMG43, with the user's fingertip inserted into the guide frame AR11, and a message MSG43 "Image captured. Please remove your hand" notifying the user that the fingertip has been captured. Also, on the guide screen SC43, a guide frame AR21 indicating the area for capturing the fingertip (fingerprint) is superimposed on the captured image IMG53, with the user's fingertip inserted into the guide frame AR21, and a message MSG53 "Image captured. Please remove your hand" notifying the user that the fingertip has been captured.

[0123] Terminal devices P1 and P1A generate a guide screen SC44 and display it on monitor MN after capturing images of the fingertips (fingerprints) of both hands and completing fingerprint authentication based on the captured images.

[0124] The guide screen SC44 includes the captured image IMG44 taken by the second camera CM2 and the captured image IMG54 taken by the third camera CM3. The guide screen SC44 overlays the message MSG44 "Two-handed fingerprint authentication complete" which notifies the user that fingerprint authentication has been completed.

[0125] As a result, terminal devices P1 and P1A can provide guidance corresponding to the user's left and right hands, respectively.

[0126] Furthermore, this allows the authentication systems 100, 100A, and 100B to more efficiently align multiple biological body parts performed by the user, thereby reducing the time required to authenticate each user.

[0127] (Embodiment 2) The authentication system 100 according to Embodiment 1 shows an example in which the face, left hand, and right hand are each captured by different cameras (specifically, the first camera CM1, the second camera CM2, and the third camera CM3). The authentication system 100A according to Embodiment 2 describes an example in which the face is captured by one camera (first camera CM1) and both hands are captured by one camera (second camera CM2A).

[0128] The authentication system 100A according to Embodiment 2 has some of the same configuration and functions as the authentication system 100 according to Embodiment 1. Therefore, in the following description of the authentication system 100A according to Embodiment 2, the same configuration and functions as those of the authentication system 100 according to Embodiment 1 will not be described.

[0129] The authentication system 100A according to Embodiment 2 will be described with reference to Figures 12 to 14. Figure 12 is a diagram showing an example of the external appearance of the authentication system 100A according to Embodiment 2. Figure 13 is a partially enlarged view of the authentication system 100A according to Embodiment 2. Figure 14 is a diagram showing an example of the internal configuration of the terminal device P1A according to Embodiment 2.

[0130] The authentication system 100A according to Embodiment 2 captures the user's face with the first camera CM1 and captures the fingertips or palms of the user's hands (left and right hands, respectively) with the second camera CM2A.

[0131] The authentication system 100A is configured integrally with the terminal device P1A, the first camera CM1 and the second camera CM2A, and the monitor MN. The authentication system 100A according to Embodiment 2 shown in Figures 12 and 13 is an example in which the first sensor SS1, the second sensor SS2, and the third sensor SS3, the panel PNL, and the weight sensors HK, TB, and WS are omitted, but is not limited to this configuration. In the authentication system 100A, the configuration other than the configuration for imaging the user's hands may be the same as that of the authentication system 100. The authentication system 100A is connected to an external server S1 for data communication.

[0132] Terminal device P1A can be implemented as, for example, a PC, notebook PC, tablet device, or smartphone. Terminal device P1A performs identity determination based on the image captured by the first camera CM1, and performs user authentication based on the image captured by either the first camera CM1 or the second camera CM2A.

[0133] Furthermore, if the terminal device P1A has multiple cameras, such as a tablet or smartphone, the first camera CM1 may be implemented as an in-camera and the second camera CM2A as an out-camera. Also, if the terminal device P1A has multiple cameras, such as a tablet or smartphone, the terminal device P1A shown in Figure 12 may be implemented by combining the tablet or smartphone with a housing equipped with a prism PRS1 (described later) and having insertion holes HL11 and HL12.

[0134] The processor 11A is configured using, for example, a CPU, FPGA, or GPU, and works in cooperation with the memory 12 to perform various processing and control. Specifically, the processor 11A refers to the programs and data held in the memory 12 and executes those programs to realize various functions such as user detection, imaging of various biological parts of the user (e.g., face, area from head to elbow or waist, fingers, or palm, etc.), identity determination, user authentication using the captured images, and user authentication using a 2D code. Note that the various functions listed here are only a selection of the functions that the processor 11A can realize, and are not limited to these.

[0135] Each of the insertion holes HL11 and HL12 has a roughly semi-ellipse shape, as viewed from the front of the authentication system 100A, i.e., the side where the user stands, with the shorter side of the ellipse cut through the center. In each of the insertion holes HL11 and HL12, the longer side, which is the cutting line of the roughly semi-ellipse, is positioned towards the terminal device P1A, and the curved portion of the roughly semi-ellipse is positioned outside the terminal device P1A. In each of the insertion holes HL11 and HL12, the inserted fingertips or palms of the user are illuminated by the light from the illumination units LT1 and LT2 (not shown). As a result, as shown in Figure 13, the insertion holes HL11 and HL12 can guide the insertion of both hands so that the fingertips and palms face the side of the terminal device P1A (the longer side of the insertion holes HL11 and HL12).

[0136] The prism PRS1 refracts the light from the illumination units LT1 and LT2, which are reflected by the user's hand inserted into the insertion holes HL11 and HL12 respectively, and directs it towards the lens of the second camera CM2 (in the direction of the dashed arrows shown in Figure 12). As an example, the prism PRS1 shown in Figure 12 refracts the light entering from the insertion holes HL11 and HL12 by approximately 90 degrees, directing it towards the lens of the second camera CM2. Note that the prism PRS1 may be implemented by using multiple mirrors.

[0137] The second camera CM2A comprises at least a lens (not shown) and an image sensor (not shown). The image sensor is, for example, a solid-state image sensor such as a CCD or CMOS, which converts the optical image formed on the imaging surface into an electrical signal. The second camera CM2A starts imaging in response to an imaging start control instruction transmitted from the terminal device P1A. The second camera CM2A outputs the captured image to the processor 11A of the terminal device P1A.

[0138] The second camera CM2A captures images of the fingertips or palms of the user's left and right hands, respectively, inserted into insertion holes HL11 and HL12 provided in the housing of the authentication system 100A, via the prism PRS1. The second camera CM2A transmits the captured images to the terminal device P1A. The authentication system 100A can block out the lighting of the facility where the authentication system 100A is installed or natural light entering from outside the facility by having the user's hands inserted into insertion holes HL11 and HL12, which have smaller openings than the authentication system 100.

[0139] As described above, the authentication system 100A according to Embodiment 2 can capture images of the user's fingertips (fingerprints) or palms (palm prints) using a single camera (second camera CM2A). Furthermore, the authentication system 100A can be manufactured inexpensively by using a tablet terminal or smartphone.

[0140] In the second embodiment, the terminal device P1A may detect the user or a biological part by performing image analysis on the captured image. In other words, the terminal device P1A may have the first camera CM1 and processor 11A implementing the functions of the first sensor SS1, and the second camera CM2A and processor 11A implementing the functions of the second sensor SS2 and the third sensor SS3.

[0141] (Embodiment 3) The authentication system 100A according to Embodiment 2 shows an example in which the user's left and right hands are imaged by the second camera CM2A using one prism PRS1. The authentication system 100B according to Embodiment 3 describes an example in which both hands are imaged by a single camera (second camera CM2A) using three prisms PRS1, PRS21, and PRS22, respectively.

[0142] Furthermore, the authentication system 100B according to Embodiment 3 has some of the same configuration and functions as the authentication system 100A according to Embodiment 2. Therefore, in the following description of the authentication system 100B according to Embodiment 3, the same configuration and functions as the authentication system 100A according to Embodiment 2 will not be described.

[0143] The authentication system 100B according to Embodiment 3 will be described with reference to Figures 14 to 16. Figure 15 is a diagram showing an example of the external appearance of the authentication system 100B according to Embodiment 3. Figure 16 is a partially enlarged view of the authentication system 100B according to Embodiment 3.

[0144] The authentication system 100B according to Embodiment 3 captures the user's face with the first camera CM1 and captures the fingertips or palms of the user's hands (left and right hands, respectively) with the second camera CM2A.

[0145] The authentication system 100B is configured integrally with the terminal device P1A, the first camera CM1 and the second camera CM2A, and the monitor MN. The authentication system 100B according to Embodiment 3 shown in Figures 15 and 16 is shown as an example in which the first sensor SS1, the second sensor SS2, and the third sensor SS3, the panel PNL, and the weight sensors HK, TB, and WS are omitted, but is not limited to this configuration. In the authentication system 100B, the configuration other than the configuration for imaging the user's hands may be the same as that of the authentication system 100. The authentication system 100B is connected to an external server S1 for data communication.

[0146] Terminal device P1A can be implemented as, for example, a PC, notebook PC, tablet device, or smartphone. Terminal device P1A performs identity determination based on the image captured by the first camera CM1, and performs user authentication based on the image captured by either the first camera CM1 or the second camera CM2A.

[0147] Furthermore, if the terminal device P1A has multiple cameras, such as a tablet or smartphone, the first camera CM1 may be implemented as an in-camera and the second camera CM2A as an out-camera. Also, if the terminal device P1A has multiple cameras, such as a tablet or smartphone, the terminal device P1A shown in Figure 15 may be realized by combining the tablet or smartphone with a housing that includes the prisms PRS1, PRS21, and PRS22 described later, and is equipped with stages STG1 and STG2.

[0148] Each of the stages STG1 and STG2 has a roughly rectangular opening when viewed from the front of the authentication system 100B, i.e., the side where the user stands, and is configured so that the user's hand can be inserted. Each of the stages STG1 and STG2 is illuminated by the light from the illumination units LT1 and LT2 (not shown) to illuminate the user's inserted fingertips or palm. In the third embodiment, as shown in Figure 16, the user inserts their hand so that the side of their fingertips or palm is parallel to the stages STG1 and STG2, rather than facing them.

[0149] Prisms PRS21 and PRS22 each refract the light from illumination units LT1 and LT2 (not shown), which are reflected by the user's hand inserted on stages STG1 and STG2, toward prism PRS1 (in the direction of the dashed arrow shown in Figure 15).

[0150] Prism PRS1 is refracted by prisms PRS21 and PRS22, respectively, and the incident light is refracted towards the lens of the second camera CM2 and directed towards it (in the direction of the dashed arrow shown in Figure 15). As an example, prism PRS1 shown in Figure 15 refracts the light incident from insertion holes HL11 and HL12 by approximately 90 degrees, and directs it towards the lens of the second camera CM2.

[0151] As described above, the authentication system 100B according to Embodiment 3 can capture images of the user's fingertips (fingerprints) or palms (palm prints) using a single camera (second camera CM2A). Furthermore, the authentication system 100B can be manufactured inexpensively by using a tablet terminal or smartphone.

[0152] In the third embodiment, the terminal device P1A may detect the user or a biological part by performing image analysis on the captured image. In other words, the terminal device P1A may have the first camera CM1 and processor 11A implementing the functions of the first sensor SS1, and the second camera CM2A and processor 11A implementing the functions of the second sensor SS2 and the third sensor SS3.

[0153] (Note) Based on the descriptions of the embodiments described above, the following technologies are disclosed.

[0154] (Technology 1) An acquisition unit (processor 11, 11A) acquires an authentication image (captured image) of the authentication area (fingertip or palm) of one hand of the person to be authenticated (user), and an authentication image (captured image) of the authentication area (fingertip or palm) of the other hand of the person to be authenticated. A calculation unit (processor 11, 11A) calculates position scores for the imaging positions of one hand and the other hand relative to the imaging position (normal position) of the authentication area used for authentication, based on the two authentication images, The system includes a selection unit (processor 11, 11A) that determines that at least one of the calculated position scores is equal to or greater than a threshold indicating the criteria for acquiring the authentication image set for the corresponding hand, and acquires the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold, If the selection unit (processor 11, 11A) determines that the position scores of both the one hand and the other hand are not equal to or greater than the threshold, it reduces the threshold value set for either the one hand or the other hand and outputs a request for re-imaging of the authentication area. Biometric information acquisition device (terminal devices P1, P1A). As a result, in embodiments 1 to 3, terminal devices P1 and P1A can reduce the level of alignment required from the user and alleviate the physical burden on the user during alignment by reducing one of the threshold values ​​(reference thresholds) set for each hand by a predetermined value.

[0155] (Technology 2) The selection unit (processor 11, 11A) reduces the value of the threshold set for the hand that has a smaller difference between the position score and the threshold among the one hand and the other hand. (Technology 1) Biometric information acquisition device (terminal devices P1, P1A). As a result, in embodiments 1 to 3, terminal devices P1 and P1A can lower the threshold corresponding to the hand that is further from the normal position, making it easier to align the hand that is further from the normal position. In other words, terminal devices P1 and P1A can reduce the physical burden on the user during positioning.

[0156] (Technology 3) The selection unit (processor 11, 11A) generates and outputs a guide (guide screen SC22) that guides the hand with the larger difference between the position score and the threshold among the one hand and the other hand to the imaging position (normal position) of the authentication area. A biological information acquisition device (terminal device P1, P1A) as described in (Technology 1) or (Technology 2). As a result, in embodiments 1 to 3, terminal devices P1 and P1A guide the hand that is further from the normal position to the normal position, allowing the user to concentrate on aligning the hand that needs to be aligned, thereby reducing the physical burden on the user caused by aligning multiple biological parts. The user only needs to align one hand displayed on the guide screens SC21 and SC41, making alignment easier.

[0157] (Technology 4) If the selection unit (processor 11, 11A) determines that the position score of either one of the hands is equal to or greater than the threshold, it generates and outputs a guide (guide screen SC22) that guides the hand whose position score is not equal to or greater than the threshold to the imaging position (normal position) of the authentication area. A biological information acquisition device (terminal device P1, P1A) described in any one of (Technology 1) to (Technology 3). As a result, in embodiments 1 to 3, terminal devices P1 and P1A guide the hand that is further from the normal position to the normal position, allowing the user to concentrate on aligning the hand that needs to be aligned, thereby reducing the physical burden on the user caused by aligning multiple biological parts. The user only needs to align one hand displayed on the guide screens SC21 and SC41, making alignment easier.

[0158] (Technology 5) The system further includes a display unit (monitor MN) that displays the aforementioned guide. A biological information acquisition device (terminal device P1, P1A) as described in (Technology 3) or (Technology 4). As a result, in embodiments 1 to 3, terminal devices P1 and P1A can guide the hand that is further away from the normal position to the normal position using guide screens SC21 and SC41. The user only needs to align the hand corresponding to the hand displayed on guide screens SC21 and SC41, making alignment easier.

[0159] (Technology 6) The guide is an image in which a guide frame (for example, guide frames GD11, GD21, GD31, GD41, GD51, etc.) indicating the imaging position of the authentication area is superimposed on an image of the hand in which the position score is determined to be below the threshold. A biological information acquisition device as described in (Technology 5). This allows terminal devices P1 and P1A to guide the user's hands in real time by visually showing the difference between the current hand position and the normal position through the screen (image).

[0160] (Technology 7) The system further includes a speaker SPK that outputs the aforementioned guide, The guide is an audio output based on the difference between the imaging position of the authentication area and the position of the hand where the position score is determined not to be above the threshold. A biological information acquisition device as described in (Technology 3) or (Technology 4). This allows terminal devices P1 and P1A to guide the user's hands using voice commands.

[0161] (Technology 8) A detection unit (processor 11, 11A) for detecting one hand and the other hand, The system further includes a determination unit (processor 11, 11A) that determines whether the detected hand and the other hand belong to the same person being authenticated. The acquisition unit (processor 11, 11A) further acquires a determination image in which at least the face of the person to be authenticated is captured (for example, an image captured with the field of view ARC1 shown in Figure 5), The determination unit (processor 11, 11A) determines, based on the size of the face (size of the face region ARC31) shown in the determination image, that the detected hand and the other hand belong to the same person being authenticated, and instructs the acquisition unit (processor 11, 11A) to acquire the two authentication images. (Technology 1) Biometric information acquisition device (terminal devices P1, P1A). As a result, in embodiments 1 to 3, terminal devices P1 and P1A can determine, based on the size of the face, that the user's (person's) position relative to terminal devices P1 and P1A is sufficiently close to the authentication systems 100, 100A, and 100B, making impersonation by another person unlikely, and that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are the same person. Therefore, in embodiments 1 to 3, terminal devices P1 and P1A can more effectively suppress impersonation by others by performing a matching process of the biological parts (fingerprints or palm prints) of both hands only when it is determined that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are the same person.

[0162] (Technology 9) A detection unit (processor 11, 11A) for detecting one hand and the other hand, The system further includes a determination unit (processor 11, 11A) that determines whether the detected hand and the other hand belong to the same person being authenticated. The acquisition unit (processor 11, 11A) further acquires a determination image in which at least the face of the person to be authenticated is captured (for example, an image captured with the field of view ARC1 shown in Figure 5), The determination unit (processor 11, 11A) detects the face and both elbows of the person to be authenticated from the determination image, and if it determines that the face and both elbows have been detected, it determines that the detected hand and the other hand belong to the same person to be authenticated, and causes the acquisition unit (processor 11, 11A) to acquire the two authentication images. (Technology 1) Biometric information acquisition device (terminal devices P1, P1A). As a result, in embodiments 1 to 3, terminal devices P1 and P1A can determine that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are the same person if the captured image shows the user's face up to both elbows. Therefore, in embodiments 1 to 3, terminal devices P1 and P1A can more effectively suppress impersonation by only performing a matching process of the biological parts (fingerprints or palm prints) of both hands when they determine that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 are the same person.

[0163] (Technology 10) If the determination unit (processor 11, 11A) determines that one hand and the other hand are not the hands of the same authenticated person, it generates a warning notification indicating that fraud has occurred and outputs or sends it to a set notification destination. A biological information acquisition device (terminal device P1, P1A) as described in (Technology 8) or (Technology 9). As a result, in embodiments 1 to 3, terminal devices P1 and P1A can more effectively suppress impersonation by generating and outputting a warning (notification) if they determine that the user (person) with both hands inserted and the user (person) captured by the first camera CM1 may not be the same person.

[0164] (Technology 11) When the selection unit (processor 11, 11A) obtains the two authentication images, it performs authentication of the person to be authenticated based on a comparison between the two obtained authentication images and the authentication image of at least one person to be authenticated that has been registered in advance. (Technology 1) Biometric information acquisition device (terminal devices P1, P1A). As a result, terminal devices P1 and P1A in embodiments 1 to 3 can perform more accurate biometric authentication by matching the biological parts (fingerprints or palm prints) of both hands.

[0165] (Technology 12) The selection unit (processor 11, 11A) determines that the position scores of both the one hand and the other hand are equal to or greater than the threshold, acquires the two authentication images, and performs authentication of the person to be authenticated based on a comparison of the two acquired authentication images with the registered authentication image of at least one person to be authenticated that has been registered in advance. (Technology 1) Biometric information acquisition device (terminal devices P1, P1A). As a result, terminal devices P1 and P1A in embodiments 1 to 3 can perform more accurate biometric authentication by matching biological parts (fingerprints or palm prints) of both hands using biometric images captured in a normal position.

[0166] (Technology 13) A method for acquiring biological information performed by at least one processor 11,11A, The system acquires an authentication image (captured image) of the authentication area (fingertip or palm) of one of the authenticated person's (user's) hands, and an authentication image (captured image) of the authentication area (fingertip or palm) of the other hand of the authenticated person. Based on the two authentication images, the positional scores of the imaging positions of one hand and the other hand relative to the imaging position (normal position) of the authentication area used for authentication are calculated. If it is determined that at least one of the calculated position scores is equal to or greater than a threshold indicating the criteria for acquiring the authentication image set for the corresponding hand, the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold is acquired. If it is determined that the position scores of both the first hand and the second hand are not equal to or greater than the threshold, the threshold value set for either the first hand or the second hand is reduced, and a request for re-imaging of the authentication area is output. Methods for acquiring biometric information. As a result, in embodiments 1 to 3, terminal devices P1 and P1A can reduce the level of alignment required from the user and alleviate the physical burden on the user during alignment by reducing one of the threshold values ​​(reference thresholds) set for each hand by a predetermined value.

[0167] (Technology 14) At least one camera (second camera CM2 and third camera CM3, or second camera CM2A) that images the authenticated person (user), A biometric information acquisition system (authentication system 100, 100A, 100B) comprising biometric information acquisition devices (terminal devices P1, P1A) capable of communicating with each other with the cameras (second camera CM2 and third camera CM3, or second camera CM2A), The aforementioned cameras (second camera CM2 and third camera CM3, or second camera CM2A) The authentication area (fingertip or palm) of one of the authenticated person's hands and the authentication area (fingertip or palm) of the other hand of the authenticated person are imaged and transmitted to the biometric information acquisition device. The aforementioned biological information acquisition device (terminal devices P1, P1A) The system acquires an authentication image (image captured) of the authentication area of ​​one of the transmitted hands, and an authentication image (image captured) of the authentication area of ​​the other hand. Based on the two authentication images, the positional scores of the imaging positions of one hand and the other hand relative to the imaging position (normal position) of the authentication area used for authentication are calculated. If it is determined that at least one of the calculated position scores is equal to or greater than a threshold indicating the criteria for acquiring the authentication image set for the corresponding hand, the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold is acquired. If it is determined that the position scores of both the first hand and the second hand are not equal to or greater than the threshold, the threshold value set for either the first hand or the second hand is reduced, and a request for re-imaging of the authentication area is output. Biometric information acquisition system (authentication system 100, 100A, 100B). As a result, the authentication systems 100, 100A, and 100B in embodiments 1 to 3 can reduce the level of alignment required of the user and alleviate the physical burden on the user during alignment by reducing one of the thresholds (reference thresholds) set for each hand by a predetermined value during the alignment of both hands.

[0168] Although various embodiments have been described above with reference to the attached drawings, this disclosure is not limited to such examples. It will be clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims, and these will also be understood to fall within the technical scope of this disclosure. Furthermore, the components of the various embodiments described above can be combined arbitrarily without departing from the spirit of the invention. [Industrial applicability]

[0169] This disclosure is useful as a presentation of a biometric information acquisition device, a biometric information acquisition method, and a biometric information acquisition system that support the acquisition of multiple biometric information used in biometric authentication. [Explanation of Symbols]

[0170] 10 Communications Department 11,11A processor 12 memory 100, 100A, 100B Authentication System AR1, AR2, ARC1 field of view AR11, AR21, GD1, GD11, GD12 guide frame ARC23, ARC31 facial region CM1 First Camera CM2, CM2A Second Camera CM3 Third Camera HL11, HL12 insertion holes HND1, HND2 Guide LT1,LT2 Lighting section MN Monitor P1, P1A Terminal Devices PRS1, PRS21, PRS22 Prism S1 External Server SC1, SC21, SC22, SC23, SC24, SC41, SC42, SC43, SC44 Guide Screen SS1 First Sensor SS2 Second Sensor SS3 Third Sensor SPK Speakers

Claims

1. An acquisition unit that acquires an authentication image of the authentication area of ​​one hand of the person to be authenticated and an authentication image of the authentication area of ​​the other hand of the person to be authenticated. A calculation unit calculates positional scores for the imaging positions of one hand and the other hand relative to the imaging position of the authentication area used for authentication, based on the two authentication images. The system includes a selection unit that, if it determines that at least one of the calculated position scores is equal to or greater than a threshold indicating the criteria for acquiring the authentication image set for the corresponding hand, acquires the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold, If the selection unit determines that the position scores of both the one hand and the other hand are not equal to or greater than the threshold, it reduces the threshold value set for either the one hand or the other hand and outputs a request for re-imaging of the authentication area. A device for acquiring biological information.

2. The selection unit reduces the value of the threshold set for the hand that has a smaller difference between the position score and the threshold among the one hand and the other hand. A biological information acquisition device according to claim 1.

3. The selection unit generates and outputs a guide to guide the hand with the larger difference between the position score and the threshold among the one hand and the other hand to the imaging position of the authentication area. A biological information acquisition device according to claim 1.

4. If the selection unit determines that the position score of either the one hand or the other hand is equal to or greater than the threshold, it generates and outputs a guide to guide the hand whose position score is not equal to or greater than the threshold to the imaging position of the authentication area. A biological information acquisition device according to claim 1.

5. The system further comprises a display unit for displaying the aforementioned guide. A biological information acquisition device according to claim 3 or 4.

6. The guide is an image in which a guide frame indicating the imaging position of the authentication area is superimposed on an image of a hand in which the position score is determined to be below the threshold. The biological information acquisition device according to claim 5.

7. The system further includes a speaker that outputs the aforementioned guide, The guide is a sound output based on the difference between the imaging position of the authentication area and the position of the hand where the position score is determined not to be above the threshold. A biological information acquisition device according to claim 3 or 4.

8. A detection unit that detects each of the aforementioned one hand and the aforementioned other hand, The system further includes a determination unit that determines whether the detected hand and the other hand belong to the same person being authenticated. The acquisition unit further acquires a determination image in which at least the face of the person to be authenticated is captured, If the determination unit determines, based on the size of the face shown in the determination image, that the detected hand and the other hand belong to the same person being authenticated, it causes the acquisition unit to acquire the two authentication images. A biological information acquisition device according to claim 1.

9. A detection unit that detects each of the aforementioned one hand and the aforementioned other hand, The system further includes a determination unit that determines whether the detected hand and the other hand belong to the same person being authenticated. The acquisition unit further acquires a determination image in which at least the face of the person to be authenticated is captured, The determination unit detects the face and both elbows of the person to be authenticated from the determination image, and if it determines that the face and both elbows have been detected, it determines that the detected hand and the other hand belong to the same person to be authenticated, and causes the acquisition unit to acquire the two authentication images. A biological information acquisition device according to claim 1.

10. If the determination unit determines that one hand and the other hand are not the hands of the same authenticated person, it generates a warning notification indicating that fraud has occurred and outputs or sends it to a designated recipient. A biological information acquisition device according to claim 8 or 9.

11. When the selection unit obtains the two authentication images, it performs authentication of the person to be authenticated based on a comparison between the two obtained authentication images and the authentication image of at least one person to be authenticated that has been registered in advance. A biological information acquisition device according to claim 1.

12. When the selection unit acquires the authentication image of the hand corresponding to one of the position scores, it repeatedly determines whether the calculated position score of the other hand is equal to or greater than the threshold set for the corresponding hand. If it determines that the position score of the other hand is equal to or greater than the threshold, it acquires the authentication image of the hand corresponding to the other hand's position score and performs authentication of the person to be authenticated based on a comparison between the two acquired authentication images and the registered authentication image of at least one person to be authenticated that has been registered in advance. A biological information acquisition device according to claim 1.

13. A method for acquiring biological information performed by at least one processor, An authentication image is obtained in which the authentication area of ​​one of the hands of the person to be authenticated is captured, and an authentication image is obtained in which the authentication area of ​​the other hand of the person to be authenticated is captured. Based on the two authentication images, the positional scores of the imaging positions of one hand and the other hand relative to the imaging position of the authentication area used for authentication are calculated. If it is determined that at least one of the calculated position scores is equal to or greater than a threshold indicating the criteria for acquiring the authentication image set for the corresponding hand, the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold is acquired. If it is determined that the position scores of both the first hand and the second hand are not equal to or greater than the threshold, the threshold value set for either the first hand or the second hand is reduced, and a request for re-imaging of the authentication area is output. Methods for acquiring biometric information.

14. At least one camera for capturing images of the person being authenticated, A biological information acquisition system comprising a biological information acquisition device capable of communicating with the aforementioned camera, The aforementioned camera, The authentication area of ​​one hand of the person to be authenticated and the authentication area of ​​the other hand of the person to be authenticated are imaged and transmitted to the biometric information acquisition device. The aforementioned biological information acquisition device is The system obtains an authentication image of the authentication area of ​​one of the transmitted hands and an authentication image of the authentication area of ​​the other hand. Based on the two authentication images, the positional scores of the imaging positions of one hand and the other hand relative to the imaging position of the authentication area used for authentication are calculated. If it is determined that at least one of the calculated position scores is equal to or greater than a threshold indicating the criteria for acquiring the authentication image set for the corresponding hand, the authentication image of the hand corresponding to the position score that is equal to or greater than the threshold is acquired. If it is determined that the position scores of both the first hand and the second hand are not equal to or greater than the threshold, the threshold value set for either the first hand or the second hand is reduced, and a request for re-imaging of the authentication area is output. A system for acquiring biometric information.

Images