Biological information acquisition device and biological information acquisition method

Abstract

This biological information acquisition device comprises: a first authentication camera for imaging an authentication portion of one hand of a person to be authenticated, the one hand being inserted into a first insertion port; a second authentication camera for imaging an authentication portion of the other hand of the person to be authenticated, the other hand being inserted into a second insertion port; and a monitoring camera for imaging the person to be authenticated. In cases in which fraud of the imaged authentication portions is not detected on the basis of a captured image captured by the monitoring camera, the imaging performed by the first authentication camera and the second authentication camera is executed to acquire a captured image in which the authentication portions of the one hand and the other hand are imaged.

Description

Biometric information acquisition device and biometric information acquisition method

[0001] The present disclosure relates to a biometric information acquisition device and a biometric information acquisition method.

[0002] Patent Document 1 discloses a fingerprint authentication registration method for registering fingerprint data used in a fingerprint authentication terminal. The fingerprint authentication registration method places one or both hands on a fingerprint collection table provided with at least fingerprint reading means for reading fingerprints at the positions of each finger, sequentially captures fingerprint data of the fingers of one or both hands from the reading output of the fingerprint reading means, and registers the captured fingerprint data corresponding to each finger.

[0003] Japanese Patent Application Laid-Open No. 2000-268174

[0004] The present disclosure has been devised in view of the above-described conventional circumstances, and an object thereof is to provide a biometric information acquisition device and a biometric information acquisition method that suppress fraud during acquisition of a plurality of biometric information used for biometric authentication.

[0005] The present disclosure includes a housing, a first authentication camera housed in the housing and imaging an authentication part of one hand of an authenticated person inserted into a first insertion port, a second authentication camera housed in the housing and imaging an authentication part of the other hand of the authenticated person inserted into a second insertion port different from the first insertion port, a monitoring camera installed in the housing and imaging the authenticated person inserting the hand into each of the first insertion port and the second insertion port, a camera control unit controlling the first authentication camera, the second authentication camera, and the monitoring camera, and a detection unit detecting the presence or absence of fraud in the imaged authentication part based on an imaging image captured by the monitoring camera. When fraud is not detected by the detection unit, the camera control unit causes the first authentication camera and the second authentication camera to perform imaging to obtain an imaging image in which the authentication parts of the one hand and the other hand are imaged, and provides a biometric information acquisition device.

[0006] Furthermore, this disclosure provides a method for acquiring biometric information performed by a biometric information acquisition device, the device comprising: a housing; a first authentication camera housed in the housing and imaging an authentication area of ​​one hand of a person to be authenticated inserted into a first insertion port; a second authentication camera housed in the housing and imaging an authentication area of ​​the other hand of the person to be authenticated inserted into a second insertion port different from the first insertion port; and a surveillance camera installed in the housing and imaging the person to be authenticated as they insert their hands into the first and second insertion ports, respectively, wherein the surveillance camera images the person to be authenticated, the presence or absence of fraud in the imaged authentication area is detected based on the image captured by the surveillance camera, and if it is determined that no fraud is detected, the first authentication camera and the second authentication camera are made to perform imaging to obtain an image of the authentication areas of one hand and the other hand.

[0007] According to this disclosure, fraudulent activity can be suppressed when acquiring multiple biometric pieces of information used for biometric authentication.

[0008] A diagram showing an example of the external appearance of the biometric information acquisition system according to the embodiment. A block diagram showing an example of the internal configuration of the authentication system according to the embodiment. A sequence diagram showing example of operation procedure 1 of the authentication system according to the embodiment. A sequence diagram showing example of operation procedure 2 of the authentication system according to the embodiment. A diagram showing example of the configuration 1 of the imaging unit. A diagram showing examples of the configuration 2 and 3 of the imaging unit. A diagram showing examples of the configuration 4 and 5 of the imaging unit. A diagram showing example of the configuration 6 of the imaging unit. A diagram showing example of the configuration 7 of the imaging unit. A diagram showing another configuration example 1 of the housing. A diagram showing another configuration example 2 of the housing. A diagram showing another configuration example 3 of the housing.

[0009] (Background to this disclosure) In conventional immigration screening, fingerprint authentication is used to compare the fingerprints of entrants with those registered on a blacklist. However, when determining whether an entrant's fingerprint matches those on the blacklist, entrants can easily circumvent the matching by using different types of fingers for fingerprint authentication, using fingers from both hands, or using someone else's fingers. Therefore, there has been a demand for technology that can effectively suppress fraudulent activities in obtaining fingerprints.

[0010] For example, a conventional method for obtaining fingerprints of both hands involves placing either one or both hands on a handprint guide to acquire fingerprint data (see Patent Document 1). Part of the handprint guide is a sensor capable of acquiring fingerprints. However, while this method can prevent fraudulent acts such as switching the type of fingers or the fingers of the left and right hands, it could not prevent fraudulent acts using another person's fingers.

[0011] Hereinafter, with reference to the drawings as appropriate, each embodiment that specifically discloses the configuration and operation of the biological information acquisition device and biological information acquisition method relating to this disclosure will be described in detail. However, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters and redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. The attached drawings and the following explanation are provided to enable those skilled in the art to fully understand this disclosure and are not intended to limit the subject matter described in the claims.

[0012] This disclosure provides a detailed explanation of an example where fingerprints are obtained as biometric information used for biometric authentication, but the biometric information to which this disclosure applies is not limited to fingerprints. Any biometric information that can be obtained from both hands is acceptable, and may include, for example, palm prints or vein patterns.

[0013] The biometric information acquisition system 100 in the embodiment will be described with reference to Figures 1 and 2, respectively. Figure 1 is a diagram showing an example of the external appearance of the biometric information acquisition system 100 according to the embodiment. Figure 2 is a block diagram showing an example of the internal configuration of the authentication system 300 according to the embodiment.

[0014] In this disclosure, the X-axis direction refers to the front or front side of the housing HS. The Y-axis direction refers to the rightward direction of the housing HS. The Z-axis direction is perpendicular to the XY plane and refers to the height direction of the housing HS.

[0015] The authentication system 300 according to this embodiment uses a biometric information acquisition system 100 to capture images of the user's face and both hands, and an external server 200 performs facial authentication based on the captured facial image of the user's face and fingerprint authentication based on the fingerprint images of the user's hands. In this disclosure, the authentication system 300 is described as being installed in a place where immigration checks are conducted, such as an airport, as an example. However, the use and installation location of the authentication system 300 are not limited to this and may be arbitrary.

[0016] The biometric information acquisition system 100 includes a terminal device P1, a monitor MN, a surveillance camera C1, a facial recognition camera C2, a first fingerprint recognition camera C31, a first imaging light L11, a second fingerprint recognition camera C32, and a second imaging light L12. The biometric information acquisition system 100 is configured with each device housed or installed in a housing HS. The biometric information acquisition system 100 is configured such that the terminal device P1 is connected to an external server 200 for data communication and performs user authentication using facial recognition and fingerprint recognition.

[0017] The terminal device P1 is implemented by, for example, a Personal Computer (hereinafter referred to as "PC"), a notebook PC, or a tablet device. The terminal device P1 captures images of the user using the surveillance camera C1, the facial recognition camera C2, the first fingerprint recognition camera C31, and the second fingerprint recognition camera C32, and controls the lighting of the first imaging illumination L11 and the second imaging illumination L12 in order to capture fingerprints.

[0018] Terminal device P1 is connected to the monitor MN, surveillance camera C1, facial recognition camera C2, first fingerprint authentication camera C31, second fingerprint authentication camera C32, first imaging illumination L11, second imaging illumination L12, and external server 200, enabling data communication between them. Note that the monitor MN may also be provided by terminal device P1. Terminal device P1 includes a communication unit 10, a processor 11, and a memory 12.

[0019] The communication unit 10 is connected to the monitor MN, surveillance camera C1, facial recognition camera C2, first fingerprint authentication camera C31, second fingerprint authentication camera C32, first imaging illumination L11, second imaging illumination L12, and external server 200 via wired or wireless communication to perform data transmission and reception. Wireless communication here refers to, for example, short-range wireless communication such as Bluetooth® or NFC®, or communication via a wireless Local Area Network (LAN) such as Wi-Fi®.

[0020] The communication unit 10 outputs various data transmitted from the surveillance camera C1, face recognition camera C2, first fingerprint authentication camera C31, second fingerprint authentication camera C32, monitor MN, first imaging light L11, second imaging light L12, or external server 200 to the processor 11. The communication unit 10 transmits the various data output from the processor 11 to the surveillance camera C1, face recognition camera C2, first fingerprint authentication camera C31, second fingerprint authentication camera C32, monitor MN, first imaging light L11, second imaging light L12, or external server 200.

[0021] The processor 11 is configured using, for example, a Central Processing Unit (CPU), a Field Programmable Gate Array (FPGA), or a Graphics Processing Unit (GPU), and works in cooperation with the memory 12 to perform various processes and controls. Specifically, the processor 11 refers to the programs and data held in the memory 12 and executes those programs to realize various functions such as detecting a user in front of the terminal device P1 and imaging various biological parts of the user (for example, the face, right hand, left hand, or the area from the face to both elbows or from the face to the wrist). The above-mentioned functions are merely a list of some of the functions that the processor 11 can realize, and are not limited to these.

[0022] Memory 12 includes, for example, Random Access Memory (RAM) as work memory used when executing each process of the processor 11, and Read Only Memory (ROM) which stores programs and data that define the operation of the processor 11. Data or information generated or acquired by the processor 11 is temporarily stored in RAM. Programs that define the operation of the processor 11 are written in ROM.

[0023] The monitor MN is configured using, for example, a Liquid Crystal Display (LCD) or an Organic Electroluminescence (EL). The monitor MN outputs and displays various screens generated by the processor 11. These various screens include a guide screen (not shown) that guides the user during user authentication or identity verification, a screen (not shown) that notifies the user of the results of user authentication or identity verification performed by the external server 200, or a warning screen (not shown) that warns of suspected impersonation.

[0024] The housing HS is installed in any location where user imaging is to be performed (for example, an airport, port, or commercial facility). The housing HS houses the terminal device P1. Outside the housing HS are a surveillance camera C1 and a facial recognition camera C2, a monitor MN, and a table TB. Inside the housing HS are a first fingerprint authentication camera C31 and a second fingerprint authentication camera C32, a first imaging illumination L11 and a second imaging illumination L12, and a first imaging unit Ar11 and a second imaging unit Ar12.

[0025] Note that the enclosure HS shown in Figure 1 is just an example and is not limited thereto. The enclosure HS may further include, for example, a camera capable of reading a 2D code displayed on the monitor of a terminal device (not shown), such as a tablet or smartphone, and a camera capable of reading the user's identification document (for example, a driver's license or passport).

[0026] Table TB assists the surveillance camera C1 in capturing images of the user when both hands are inserted into the first imaging unit Ar11 and the second imaging unit Ar12, respectively. Specifically, Table TB can physically prevent unauthorized acts such as another person inserting their fingers into the first imaging unit Ar11 or the second imaging unit Ar12 from the underside of the housing HS (opposite direction to the Z direction). Furthermore, Table TB may also be equipped with a camera capable of reading a 2D code displayed on the monitor of a terminal device (not shown), such as a tablet or smartphone, or a camera capable of reading the user's identification document (e.g., driver's license or passport). Note that Table TB is not a mandatory configuration and may be omitted.

[0027] Each of the surveillance camera C1, face recognition camera C2, first fingerprint authentication camera C31, and second fingerprint authentication camera C32 is configured to have at least a lens (not shown) and an image sensor (not shown). The image sensor is a solid-state image sensor, such as a CCD (Charge-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), which converts the optical image formed on the imaging surface into an electrical signal. Each of the surveillance camera C1, face recognition camera C2, first fingerprint authentication camera C31, and second fingerprint authentication camera C32 starts imaging in response to an imaging start control instruction transmitted from the terminal device P1. Each of the surveillance camera C1, face recognition camera C2, first fingerprint authentication camera C31, and second fingerprint authentication camera C32 outputs the captured image to the processor 11 of the terminal device P1.

[0028] The surveillance camera C1 is installed, for example, on the top of the housing HS (in this disclosure, on the top of the monitor MN). The surveillance camera C1 may be implemented as a so-called wide-angle camera. The surveillance camera C1 is installed to capture the area from the user's face to both elbows or wrists, located in front of the terminal device P1 (the side facing the monitor MN, in the X direction), and the top surface of the table TB (the surface in the Z direction). The surveillance camera C1 is controlled by the processor 11 to capture images of the user in front of the housing HS and the user's arms, which are positioned on the table TB and have their fingers inserted into the first imaging unit Ar11 and the second imaging unit Ar12. The surveillance camera C1 outputs the captured images to the processor 11.

[0029] Furthermore, the surveillance camera C1 does not necessarily have to be installed directly on the housing HS; for example, it may be placed near the housing HS. Also, the surveillance camera C1 is not limited to one unit, but may be multiple units. In addition, the surveillance camera C1 may be a camera that continuously images users using the biometric information acquisition system 100.

[0030] The facial recognition camera C2 is controlled by the processor 11 and captures an image of the user to be authenticated. The facial recognition camera C2 transmits the captured image (facial image) to the terminal device P1. The facial recognition camera C2 is installed, for example, on top of the monitor MN and captures an image of the user viewing the monitor MN.

[0031] The first fingerprint authentication camera C31 is controlled by the processor 11 and captures an image of the fingertip of the user's right hand, which is the target of user authentication. Specifically, the first fingerprint authentication camera C31 captures an image of the fingertip of the user's right hand inserted into the first imaging unit Ar11 provided in the housing HS. The first fingerprint authentication camera C31 transmits the captured image (right hand fingerprint image) to the terminal device P1.

[0032] The second fingerprint authentication camera C32 is controlled by the processor 11 and captures an image of the fingertip of the user's left hand, which is the target of user authentication. Specifically, the second fingerprint authentication camera C32 captures an image of the fingertip of the user's left hand inserted into the second imaging unit Ar12 provided in the housing HS. The second fingerprint authentication camera C32 transmits the captured image (left hand fingerprint image) to the terminal device P1.

[0033] Each of the first imaging illumination L11 and the second imaging illumination L12 is realized by at least one light-emitting element, such as a Light Emitting Diode (LED). The first imaging illumination L11 and the second imaging illumination L12 may be point illumination or surface illumination.

[0034] The first imaging illumination L11 illuminates the user's right hand inserted into the first imaging unit Ar11. The first imaging illumination L11 performs on / off control based on a control command transmitted from the terminal device P1. The processor 11 may also perform on / off control of the first imaging illumination L11 when it detects that the user's fingers have been inserted into the field of view of the first fingerprint authentication camera C31 by a sensor (not shown) that detects the insertion of fingers into the first imaging unit Ar11.

[0035] The second imaging illumination L12 illuminates the user's left hand inserted into the second imaging unit Ar12. The second imaging illumination L12 performs on / off control based on a control command transmitted from the terminal device P1. The processor 11 may also perform on / off control of the second imaging illumination L12 when it detects that the user's fingers have been inserted into the field of view of the second fingerprint authentication camera C32 by a sensor (not shown) that detects the insertion of fingers into the second imaging unit Ar12.

[0036] The external server 200 includes a facial recognition server S11 that performs facial recognition using the user's facial image and a fingerprint recognition server S12 that performs fingerprint recognition using the user's fingerprint image. For the sake of simplicity, this disclosure shows a configuration in which multiple servers are included within a single external server 200, but the facial recognition server S11 and the fingerprint recognition server S12 may be servers managed by different administrators. Furthermore, the facial recognition server S11 and the fingerprint recognition server S12 may each be on-premises servers or cloud servers.

[0037] The facial recognition server S11 is connected to the terminal device P1 so that data communication is possible. The facial recognition server S11 performs facial recognition by comparing the facial image transmitted from the terminal device P1 with the facial image registered in the database (not shown). The facial recognition server S11 generates information notifying the user of the facial recognition result and sends it to the terminal device P1.

[0038] The fingerprint authentication server S12 is connected to the terminal device P1 so that data communication is possible. The fingerprint authentication server S12 performs fingerprint authentication by comparing the fingerprint images of both hands transmitted from the terminal device P1 with the fingerprint images registered in the database (not shown). The fingerprint authentication server S12 generates information notifying the user of the fingerprint authentication result and sends it to the terminal device P1.

[0039] <Example of Operation Procedure 1> An example of operation procedure 1 of the authentication system 300 will be described with reference to Figure 3. Figure 3 is a sequence diagram showing an example of operation procedure 1 of the authentication system 300 according to an embodiment. Example of operation procedure 1 is an operation procedure when fraud detection and fingerprint imaging are performed in succession.

[0040] The processor 11 of the biometric information acquisition system 100 causes the surveillance camera C1 and the facial recognition camera C2 to perform imaging. The processor 11 acquires the captured image (body image) output from the surveillance camera C1 and the captured image (face image) output from the facial recognition camera C2 (St11).

[0041] Here, the body image is, for example, an image of the user's body that includes a living body part from the user's face (head) to the elbow, or the arm on the table TB, or from the user's face (head) to the wrist. The face image is, for example, an image of the user's face that has been captured.

[0042] The processor 11 analyzes the body image and detects the face and skeleton of the user (person) shown in the body image. The processor 11 determines whether fraud has been detected based on the body image (St12).

[0043] Note that the fraud referred to here is a state in which there is suspicion of impersonation or forgery of a living body part (e.g., face or finger) that is the acquisition target by the user or someone other than the user. For example, when the processor 11 determines that the body image includes the user's face and the joint points corresponding to the user's elbow or wrist, there are no fingers of anyone other than the user on the table TB, or the user's left and right hands on the table TB are not crossed, etc., it determines that no fraud has been detected.

[0044] In step St1, if the processor 11 determines based on the body image that fraud has been detected (St12, YES), it determines that there is suspicion that fraud has been committed in the acquisition of biometric information, and generates a screen (not shown) warning of impersonation and displays it on the monitor MN, or reports to the administrator, security guard, or relevant officer of the authentication system 300 that there is suspicion that an impersonation act has been committed (St13).

[0045] On the other hand, in step St12, if the processor 11 determines based on the body image that no fraud has been detected (St12, NO), it generates a face image by cutting out the area where the user's face appears from the captured image. The processor 11 transmits the generated face image to the face authentication server S11 of the external server 200 (St14).

[0046] The face authentication server S11 performs face authentication by comparing the face image transmitted from the terminal device P1 with a plurality of pre-registered face images (St15). The face authentication server S11 records the face authentication result (St16). The face authentication server S11 transmits the face authentication result to the terminal device P1.

[0047] Note that the face authentication performed here may be a process of determining whether the face of the user captured in the face image is the same as or similar to the face image that has been registered in advance as a blacklist (i.e., the detection target), or may be a process of determining whether the face of the user captured in the face image is the same as or similar to the face image that has been registered in advance as a whitelist (i.e., the approval target).

[0048] The processor 11 starts imaging the fingertips (fingerprints) of both hands of the user by the first fingerprint authentication camera C31 and the second fingerprint authentication camera C32 (St17). The processor 11 controls lighting of each of the first imaging illumination L11 and the second imaging illumination L12. Also, for example, the processor 11 may prompt the insertion of the right hand into the first imaging unit Ar11 and the insertion of the left hand into the second imaging unit Ar12 by guidance from the monitor MN or voice guidance from a speaker (not shown).

[0049] The processor 11 causes the monitoring camera C1 to image the user. The processor 11 detects the face of the user and the joint points corresponding to the elbows or wrists of this user from the captured image captured by the monitoring camera C1. The processor 11 determines whether the hand inserted into or about to be inserted into each of the first imaging unit Ar11 and the second imaging unit Ar12 is different from the user who is the owner of this hand based on the information of the detected joint points (St18). Also, the processor 11 determines whether the hands inserted into or about to be inserted into each of the first imaging unit Ar11 and the second imaging unit Ar12 are crossed based on the information of the detected joint points (St18). That is, the processor 11 determines whether fraud has been detected based on the body image (St18).

[0050] When the processor 11 determines in step St18 that the hand inserted into or about to be inserted into each of the first imaging unit Ar11 and the second imaging unit Ar12 is different from the user who is the owner of this hand, that is, when fraud has been detected based on the body image (St18, YES), the processor 11 executes the process of step St13.

[0051] On the other hand, in step St18, if the processor 11 determines that the hand inserted into or about to be inserted into the first imaging unit Ar11 and the second imaging unit Ar12, respectively, is the same as the user who owns that hand, that is, based on the body image, no fraud is detected (St18, NO), then it determines whether or not the right hand was detected in the first imaging unit Ar11 and the left hand in the second imaging unit Ar12 (St19).

[0052] The processor 11 may use multiple sensors (not shown) to simply determine whether or not fingers are inserted into the first imaging unit Ar11 and the second imaging unit Ar12, or it may detect the insertion of the user's fingers based on image analysis using the images captured by the first fingerprint authentication camera C31 and the second fingerprint authentication camera C32, respectively.

[0053] If, in step St19, the processor 11 determines that it has detected the right hand from the first imaging unit Ar11 and the left hand from the second imaging unit Ar12 (St19, YES), it causes the first fingerprint authentication camera C31 to capture an image of the user's right hand (St20A) and the second fingerprint authentication camera C32 to capture an image of the user's left hand (St20B).

[0054] On the other hand, if the processor 11 determines in step St19 that it has not detected the right hand from the first imaging unit Ar11 and the left hand from the second imaging unit Ar12 (St19, NO), it returns to the processing in step St17.

[0055] The processor 11 acquires the image of the right hand output from the first fingerprint authentication camera C31 and the image of the left hand output from the second fingerprint authentication camera C32. The processor 11 generates one or more fingerprint images by extracting the region in which the fingerprint of each finger (for example, the first joint of the fingertip) is visible from the captured image. The processor 11 may generate a fingerprint image corresponding to the fingertip used for fingerprint authentication, or it may generate fingerprint images of all fingers visible in the captured image.

[0056] The processor 11 performs image analysis on the acquired fingerprint images of the right and left hands and evaluates the quality of the fingerprints reflected in the fingerprint images. Based on the evaluation results, the processor 11 calculates quality scores for each fingerprint image of the right hand and each fingerprint image of the left hand (St21A, St21B).

[0057] The processor 11 determines whether the quality scores of the right-hand fingerprint images and the left-hand fingerprint images meet a predetermined quality standard (St22). The predetermined quality standard here refers to a quality score indicating that the fingerprint image is suitable for fingerprint authentication.

[0058] In step St22, if the processor 11 determines that the quality scores of the right hand fingerprint images and the left hand fingerprint images meet the predetermined quality requirements (St22, YES), it transmits the fingerprint images of both hands to the fingerprint authentication server S12 of the external server 200 (St23). The processor 11 generates a screen (not shown) indicating the completion of the imaging process necessary for user authentication and outputs (displays) it on the monitor MN (St24).

[0059] On the other hand, if the processor 11 determines in step St22 that the quality score of either the right-hand fingerprint image or the left-hand fingerprint image does not meet the predetermined quality requirements (St22, NO), it returns to the process in step St17.

[0060] Furthermore, the hands re-imaged after returning to the process in step St17 may be only those hands whose quality score was determined not to meet the predetermined quality. Also, the fingerprint images generated after returning to the process in step St17 may be only those fingers whose quality score was determined not to meet the predetermined quality.

[0061] The fingerprint authentication server S12 compares the fingerprint images of both hands transmitted from the terminal device P1 with multiple pre-registered fingerprint images and performs fingerprint authentication (St25). The fingerprint authentication server S12 records the fingerprint authentication result (St26). The fingerprint authentication server S12 transmits the fingerprint authentication result to the terminal device P1.

[0062] The fingerprint authentication performed here may be a process that determines whether the user's fingerprint is identical or similar to a fingerprint previously registered as a blacklist (i.e., a detection target), or it may be a process that determines whether the user's fingerprint is identical or similar to a fingerprint previously registered as a whitelist (i.e., an approval target).

[0063] In the first example of the operation procedure shown above, the imaging of the user by the surveillance camera C1 and the fraud detection process based on the body image captured by the surveillance camera C1 may be repeatedly executed between steps St11 and St17, or between steps St11 and St17 or steps St20A and St20B. Furthermore, the imaging of the user by the surveillance camera C1 and the fraud detection process based on the body image captured by the surveillance camera C1 may be executed in parallel with the processing in steps St17 to St20A and St20B.

[0064] As a result, the terminal device P1 continues the fraud detection process until fingerprint imaging is started or completed by the first fingerprint authentication camera C31 and the second fingerprint authentication camera C32, respectively, thus more effectively suppressing fraudulent activities such as switching hands or impersonation using another person's hands.

[0065] As described above, the authentication system 300 according to the embodiment can more effectively suppress impersonation by others or fraud by the user themselves, such as switching their left and right hands, by performing fraud detection and fingerprint imaging in succession when acquiring fingerprints used for user authentication.

[0066] <Example of Operation Procedure 2> An example of operation procedure 2 for the authentication system 300 will be described with reference to Figure 4. Figure 4 is a sequence diagram showing an example of operation procedure 2 for the authentication system 300 according to an embodiment. Example of operation procedure 2 is an operation procedure that is performed when imaging the user's body, face, and fingerprints almost simultaneously.

[0067] The processor 11 of the biometric information acquisition system 100 instructs the surveillance camera C1 to perform imaging. The processor 11 acquires the captured image (body image) output from the surveillance camera C1 (St31).

[0068] The processor 11 performs image analysis on the body image and detects the face and skeleton of the user (person) depicted in the image. Based on the body image, the processor 11 determines whether or not fraud has been detected (St32).

[0069] If, in step St32, the processor 11 determines that fraud has been detected based on the body image (St32, YES), it determines that there is a suspicion that fraud has been committed in acquiring biometric information, and generates a screen (not shown) warning of impersonation and displays it on the monitor MN, or issues an alert indicating that there is a suspicion that impersonation is being committed by an administrator, security guard, or officer of the authentication system 300 (St33).

[0070] On the other hand, if the processor 11 determines in step St32 that no fraud is detected based on the body image (St32, NO), it starts capturing images with the face recognition camera C2 and the first fingerprint recognition camera C31 and the second fingerprint recognition camera C32, respectively (St34).

[0071] For example, the processor 11 controls the lighting of the first imaging illumination L11 and the second imaging illumination L12, respectively, in the same manner as in example operation procedure 1. For example, the processor 11 may prompt the user to insert their right hand into the first imaging unit Ar11 and their left hand into the second imaging unit Ar12, respectively, through guidance from the monitor MN or voice guidance from a speaker (not shown). Alternatively, for example, the processor 11 may prompt the user to look at the monitor MN or the facial recognition camera C2 through guidance from the monitor MN or voice guidance from a speaker (not shown).

[0072] The processor 11 determines whether it has detected the user's face from the surveillance camera C1 or the facial recognition camera C2, the right hand from the first imaging unit Ar11, and the left hand from the second imaging unit Ar12 (St35).

[0073] The processor 11 may, similar to example operation procedure 1, use multiple sensors (not shown) to simply determine whether or not fingers are inserted into the first imaging unit Ar11 and the second imaging unit Ar12, or it may detect the insertion of the user's fingers based on image analysis using the images captured by the first fingerprint authentication camera C31 and the second fingerprint authentication camera C32, respectively.

[0074] If, in the process of step St35, the processor 11 determines that it has detected the user's face from the surveillance camera C1 or the facial recognition camera C2, the right hand from the first imaging unit Ar11, and the left hand from the second imaging unit Ar12 (St35, YES), it causes the facial recognition camera C2 to capture an image of the user's face (St36A), the first fingerprint authentication camera C31 to capture an image of the user's right hand (St36B), and the second fingerprint authentication camera C32 to capture an image of the user's left hand (St36C).

[0075] On the other hand, if the processor 11 determines in step St35 that it has not detected the user's face from the surveillance camera C1 or the facial recognition camera C2, the right hand from the first imaging unit Ar11, or the left hand from the second imaging unit Ar12 (St35, NO), it returns to step St34.

[0076] The processor 11 acquires the captured image output from the facial recognition camera C2, the captured image of the right hand output from the first fingerprint recognition camera C31, and the captured image of the left hand output from the second fingerprint recognition camera C32. The processor 11 generates a facial image by extracting the region showing the user's face from the captured image. The processor 11 also generates one or more fingerprint images by extracting the region showing the fingerprint of each finger (for example, the first joint of the fingertip) from the captured image. The processor 11 may generate a fingerprint image corresponding to the fingertip used for fingerprint authentication, or it may generate fingerprint images of all fingers shown in the captured image.

[0077] The processor 11 performs image analysis on the acquired face image and evaluates the quality of the face depicted in the image. Based on the evaluation results, the processor 11 calculates a quality score for the face image (St37A).

[0078] Furthermore, the processor 11 performs image analysis on the acquired fingerprint images of the right and left hands and evaluates the quality of the fingerprints reflected in the fingerprint images. Based on the evaluation results, the processor 11 calculates the quality scores for each fingerprint image of the right hand and each fingerprint image of the left hand, respectively (St37B, St37C).

[0079] The processor 11 determines whether the quality score of the face image, the quality score of the right hand fingerprint image, and the quality score of the left hand fingerprint image meet a predetermined quality (St38). The predetermined quality here refers to a quality score indicating that the face image is suitable for face recognition and the fingerprint image is suitable for fingerprint recognition. Different criteria (thresholds) may be set for the face image and the fingerprint image to determine the predetermined quality.

[0080] In step St38, if the processor 11 determines that the quality scores of the face image, the right hand fingerprint image, and the left hand fingerprint image meet predetermined quality requirements (St38, YES), it transmits the face image to the face authentication server S11 of the external server 200 and the fingerprint images of both hands to the fingerprint authentication server S12 of the external server 200 (St39). The processor 11 generates a screen (not shown) indicating the completion of the imaging process necessary for user authentication and outputs (displays) it on the monitor MN (St40).

[0081] On the other hand, if the processor 11 determines in step St38 that any of the quality scores of the face image, the right hand fingerprint image, or the left hand fingerprint image do not meet the predetermined quality requirements (St38, NO), it returns to the process in step St34.

[0082] Furthermore, the biological body parts that are re-imaged after returning to the process in step St34 may be limited to only those biological body parts whose quality score is determined to not meet the predetermined quality (i.e., the face, right hand, or left hand). Also, the fingerprint images generated after returning to the process in step St34 may be limited to only those fingers whose quality score is determined to not meet the predetermined quality.

[0083] The facial recognition server S11 compares the facial image transmitted from the terminal device P1 with a set of pre-registered facial images and performs facial recognition (St41). The facial recognition server S11 records the facial recognition result (St42). The facial recognition server S11 transmits the facial recognition result to the terminal device P1.

[0084] The fingerprint authentication server S12 compares the fingerprint images of both hands transmitted from the terminal device P1 with multiple pre-registered fingerprint images and performs fingerprint authentication (St43). The fingerprint authentication server S12 records the fingerprint authentication result (St44). The fingerprint authentication server S12 transmits the fingerprint authentication result to the terminal device P1.

[0085] In the second example of the operation procedure shown above, the imaging of the user by the surveillance camera C1 and the fraud detection process based on the body image captured by the surveillance camera C1 may be repeatedly executed between steps St31 and St34, or between steps St11 and St36A to St36C. Furthermore, the imaging of the user by the surveillance camera C1 and the fraud detection process based on the body image captured by the surveillance camera C1 may be executed in parallel with the processing in steps St34 to St36A to St36C.

[0086] As a result, terminal device P1 continues the fraud detection process using surveillance camera C1 until the facial recognition camera C2 starts capturing images of faces and the first fingerprint recognition camera C31 and second fingerprint recognition camera C32 each start capturing images of fingerprints, thereby more effectively suppressing fraudulent activities such as switching hands or impersonation using another person's hands.

[0087] <Example of Imaging Unit Configuration 1> Next, an example of the configuration of the imaging unit (first imaging unit Ar11 and second imaging unit Ar12) will be described with reference to Figure 5. Figure 5 is a diagram showing Example 1 of the imaging unit configuration. Note that Example 1 of the imaging unit configuration shown in Figure 5 is the same as the configuration example shown in Figure 1. Note that the imaging unit shown in Figure 5 is an enlarged view showing only the main parts of the biological information acquisition system 100.

[0088] The first insertion port EN11 of the first imaging unit Ar11 and the second insertion port EN12 of the second imaging unit Ar12 are arranged side by side in the horizontal direction (Y-axis direction). The internal spaces of the first imaging unit Ar11 and the second imaging unit Ar12 are separated by the housing HS11, and each is provided as a separate space.

[0089] Furthermore, the bottom surface IS11 of the first imaging unit Ar11 and the bottom surface IS12 of the second imaging unit Ar12 are formed horizontally and flush with the top surface of the table TB. In other words, the first imaging unit Ar11 and the second imaging unit Ar12 are imaging spaces with a substantially rectangular parallelepiped shape, each having bottom surfaces IS11 and IS12 that are substantially flush with the top surface of the table TB.

[0090] In Configuration Example 1, the user inserts their right hand into the first imaging unit Ar11 through the first insertion port EN11 along the insertion direction DRR. The user also inserts their left hand into the second imaging unit Ar12 through the second insertion port EN12 along the insertion direction DRL.

[0091] As described above, the housing HS in Configuration Example 1 has a configuration in which the first insertion port EN11 and the second insertion port EN12 are arranged horizontally side by side, and the housing HS11 separates the first insertion port EN11 and the second insertion port EN12. This makes it more difficult for the user to insert their hands into the first imaging unit Ar11 and the second imaging unit Ar12 when they cross their right and left hands on the table TB and switch the left and right sides.

[0092] Furthermore, in Configuration Example 1, the housing HS has insertion directions DRR and DRL that are approximately perpendicular to the first insertion port EN11 and the second insertion port EN12, which are aligned horizontally. Also, the surveillance camera C1 has a field of view that includes the entire table TB. Therefore, the biometric information acquisition system 100 has a configuration in which the arm of the person impersonating the user is inevitably captured by the surveillance camera C1, even if a person other than the user (another person) inserts their hand into the first insertion port EN11 or the second insertion port EN12 from around the housing HS on behalf of the user. Thus, the biometric information acquisition system 100 can detect impersonation and other fraudulent activities through the configuration of the housing HS in Configuration Example 1 and the surveillance camera C1.

[0093] Next, with reference to Figure 6, configuration examples 2 and 3 of the imaging unit (first imaging unit Ar11A, Ar11B and second imaging unit Ar12A, Ar12B) will be described. Figure 6 shows configuration examples 2 and 3 of the imaging unit. The dashed line in Figure 6 indicates configuration example 1 of the imaging unit shown in Figure 5. Note that the imaging unit shown in Figure 6 is an enlarged view showing only the essential parts of the biological information acquisition system 100.

[0094] <Example of imaging unit configuration 2> The first insertion port EN11 of the first imaging unit Ar11A and the second insertion port EN12 of the second imaging unit Ar12A are arranged side by side in the horizontal direction (Y-axis direction). The internal space of the first imaging unit Ar11A and the second imaging unit Ar12A are separated by the housing HS11, and are provided as separate spaces.

[0095] Furthermore, the first imaging unit Ar11A and the second imaging unit Ar12A are formed such that their bottom surfaces (bottom surface IS11A, bottom surface IS12A) become higher upward (in the Z-axis direction) as they move inward (opposite direction to the X-axis direction) from the insertion opening (first insertion opening EN11, second insertion opening EN12), that is, as they move away from the table TB. Here, height H0 is the height of the bottom surfaces IS11 and IS12 of the imaging unit shown in Figure 5. The height H1 of the bottom surfaces IS11A and IS12A at the innermost part of the first imaging unit Ar11A and the second imaging unit Ar12A, which is furthest from the first insertion opening EN11 and the second insertion opening EN12, is higher than height H0.

[0096] In Configuration Example 2, the user inserts their right hand into the first imaging unit Ar11A through the first insertion port EN11 along the insertion direction DRR. The user also inserts their left hand into the second imaging unit Ar12A through the second insertion port EN12 along the insertion direction DRL.

[0097] As described above, the housing HS in Configuration Example 2 has a configuration in which the first insertion port EN11 and the second insertion port EN12 are arranged horizontally side by side, and the housing HS11 separates the first insertion port EN11 and the second insertion port EN12. Furthermore, the housing HS in Configuration Example 2 has an incline in which the interiors of the first imaging unit Ar11A and the second imaging unit Ar12A gradually rise toward the rear side (i.e., the side away from the table TB).

[0098] As a result, the housing HS makes it more difficult for a user to insert their hands into the first imaging unit Ar11A and the second imaging unit Ar12A with their right and left hands crossed on the table TB and their positions reversed. Furthermore, since the housing HS is configured so that insertion must be performed with the fingers positioned to follow the internal incline of the first imaging unit Ar11A and the second imaging unit Ar12A, it also makes it more difficult for someone other than the user to insert their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user.

[0099] Furthermore, in the configuration example 2, the housing HS has insertion directions DRR and DRL that are approximately perpendicular to the first insertion port EN11 and the second insertion port EN12, which are aligned horizontally. Here, the surveillance camera C1 has a field of view that includes the entire table TB. Therefore, the biometric information acquisition system 100 has a configuration in which the arm of the person impersonating the user is inevitably captured by the surveillance camera C1, even if a person other than the user (another person) inserts their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user. Thus, the biometric information acquisition system 100 can detect impersonation and other fraudulent activities through the configuration of the housing HS in the configuration example 2 and the surveillance camera C1.

[0100] <Example of imaging unit configuration 3> The first insertion port EN11 of the first imaging unit Ar11B and the second insertion port EN12 of the second imaging unit Ar12B are arranged side by side in the horizontal direction (Y-axis direction). The first imaging unit Ar11B and the second imaging unit Ar12B are separated by the housing HS11, and are provided as separate spaces.

[0101] Furthermore, the first imaging unit Ar11B and the second imaging unit Ar12B are formed such that their bottom surfaces (bottom surfaces IS11B and IS12B) become lower as they move away from the insertion openings (first insertion opening EN11 and second insertion opening EN12) towards the back (opposite direction to the X-axis), that is, as they move away from the table TB. Here, height H0 is the height of the bottom surfaces IS11 and IS12 of the imaging unit shown in Figure 5. The height H2 of the bottom surfaces IS11B and IS12B at the innermost part of the first imaging unit Ar11B and the second imaging unit Ar12B, which is furthest from the first insertion opening EN11 and the second insertion opening EN12, is lower than height H0.

[0102] In configuration example 3, the user inserts their right hand into the first imaging unit Ar11B through the first insertion port EN11 along the insertion direction DRR. The user also inserts their left hand into the second imaging unit Ar12B through the second insertion port EN12 along the insertion direction DRL.

[0103] As described above, the housing HS in Configuration Example 3 has a configuration in which the first insertion port EN11 and the second insertion port EN12 are arranged horizontally side by side, and the housing HS11 separates the first insertion port EN11 and the second insertion port EN12. Furthermore, the housing HS in Configuration Example 3 has a slope in which the interior of the first imaging unit Ar11B and the second imaging unit Ar12B gradually becomes lower toward the back side (i.e., the side away from the table TB). This makes it more difficult for the user to insert their right and left hands, crossed, into the first imaging unit Ar11B and the second imaging unit Ar12B, respectively.

[0104] Furthermore, since the housing HS is configured such that the fingers must be positioned to follow the inclination inside the first imaging unit Ar11B and the second imaging unit Ar12B when inserted, it is similarly more difficult for someone other than the user to insert their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user.

[0105] Furthermore, in Configuration Example 3, the housing HS has insertion directions DRR and DRL that are approximately perpendicular to the first insertion port EN11 and the second insertion port EN12, which are aligned horizontally. Here, the surveillance camera C1 has a field of view that includes the entire table TB. Therefore, even if a person other than the user (another person) inserts their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user, the biometric information acquisition system 100 has a configuration in which the arm of the person impersonating the user is inevitably captured by the surveillance camera C1. Thus, the biometric information acquisition system 100 can detect fraudulent activities such as impersonation by using the configuration of the housing HS in Configuration Example 3 and the surveillance camera C1.

[0106] Next, with reference to Figure 7, an example configuration of the imaging unit (first imaging unit Ar11C, Ar11D and second imaging unit Ar12C, Ar12D) will be described. Figure 7 shows examples 4 and 5 of the imaging unit configuration. Note that the imaging unit shown in Figure 7 is an enlarged view showing only the essential parts of the biological information acquisition system 100.

[0107] <Example of imaging unit configuration 4> The first insertion port EN11 of the first imaging unit Ar11C and the second insertion port EN12 of the second imaging unit Ar12C are arranged side by side in the horizontal direction (Y-axis direction). The first imaging unit Ar11C and the second imaging unit Ar12C are separated by the housing HS11, and are provided as separate spaces.

[0108] In configuration example 4, the first insertion port EN11 and the second insertion port EN12 are separated by a partition PT1 that protrudes from the surface of the housing HS11 toward the front (in the X-axis direction). The height of the partition PT1 along the Z-axis direction may be arbitrary; for example, it may be smaller or larger than the heights of the first insertion port EN11 and the second insertion port EN12. The width of the partition PT1 along the Y-axis direction may be less than or equal to the width of the housing HS11. The length of the partition PT1 along the X-axis direction is not limited and may be arbitrary.

[0109] As described above, in the configuration example 4, the housing HS, with its partition PT1 protruding from the surface of the housing HS11 toward the front (in the X-axis direction), makes it more difficult for the user to cross their right and left hands on the table TB and insert their reversed hands into the first imaging unit Ar11C and the second imaging unit Ar12C, respectively.

[0110] <Example of imaging unit configuration 5> The first insertion port EN11 of the first imaging unit Ar11D and the second insertion port EN12 of the second imaging unit Ar12D are each arranged along the horizontal direction (Y-axis direction). The first imaging unit Ar11D and the second imaging unit Ar12D are separated by the housing HS11.

[0111] In configuration example 5, the space between the first insertion port EN11 and the second insertion port EN12 is separated by a plurality of partitions PT2A and PT2B that protrude from the surface of the housing HS11 toward the front (in the X-axis direction). Specifically, partition PT2A is provided on the side of the first insertion port EN11 that faces the second insertion port EN12. Partition PT2B is provided on the side of the second insertion port EN12 that faces the first insertion port EN11.

[0112] The heights of the partitions PT2A and PT2B along the Z-axis direction may be arbitrary; for example, they may be smaller or larger than the heights of the first insertion port EN11 and the second insertion port EN12.

[0113] As described above, in the configuration example 5, the housing HS, with partitions PT2A and PT2B protruding from the surface of the housing HS11 toward the front (in the X-axis direction), makes it more difficult for the user to cross their right and left hands on the table TB and insert their reversed hands into the first imaging unit Ar11D and the second imaging unit Ar12D, respectively.

[0114] Next, with reference to Figure 8, an example configuration of the imaging unit (first imaging unit Ar11E and second imaging unit Ar12E) will be described. Figure 8 is a diagram showing example configuration 6 of the imaging unit. Note that the imaging unit shown in Figure 8 is an enlarged view showing only the essential parts of the biological information acquisition system 100.

[0115] <Example 6 of Imaging Unit Configuration> The first insertion port EN11E of the first imaging unit Ar11E and the second insertion port EN12E of the second imaging unit Ar12E are positioned at locations rotated by a predetermined angle in opposite directions with respect to the center line J0 of the housing HS, with the X-axis direction as the reference (= 0°). The first insertion port EN11E is positioned at a location rotated by a predetermined angle θE counterclockwise from the X-axis direction from the first insertion port EN11 shown in Configuration Example 1, etc. The second insertion port EN12E is positioned at a location rotated by a predetermined angle θE clockwise from the X-axis direction from the second insertion port EN12 shown in Configuration Example 1, etc. As a result, the first insertion port EN11E and the second insertion port EN12E in Configuration Example 6 are positioned to face outward at a radius from the center line J0 of the housing HS.

[0116] The first insertion port EN11E and the second insertion port EN12E are located behind the surfaces on which the surveillance camera C1, facial recognition camera C2, and monitor MN are installed, respectively, in the X-axis direction. In other words, the front surface of the housing HS on which the surveillance camera C1, facial recognition camera C2, and monitor MN are installed protrudes in front of the first insertion port EN11E and the second insertion port EN12E.

[0117] As described above, in the housing HS of configuration example 6, the first insertion port EN11E and the second insertion port EN12E are positioned to face outward from the radius of the housing HS, making it more difficult for the user to insert their right and left hands, which are crossed on the table TB and swapped, into the first imaging unit Ar11E and the second imaging unit Ar12E, respectively.

[0118] Next, with reference to Figure 9, an example configuration of the imaging unit (first imaging unit Ar11F and second imaging unit Ar12F) will be described. Figure 9 is a diagram showing example configuration 7 of the imaging unit. Note that the imaging unit shown in Figure 9 is an enlarged view showing only the essential parts of the biological information acquisition system 100.

[0119] <Example of Imaging Unit Configuration 7> In Configuration Example 7, the housing HS has a protruding portion HSF that extends from the front of the housing HS toward the front side of the table TB. The protruding portion HSF has a trapezoidal shape when viewed from the Z-axis direction, and is provided such that the longer side is toward the front side of the housing HS and the shorter side is toward the front side of the table TB.

[0120] The first insertion port EN11F of the first imaging unit Ar11F and the second insertion port EN12F of the second imaging unit Ar12F are provided on the protruding portion HSF. The first insertion port EN11F and the second insertion port EN12F are provided at positions rotated by a predetermined angle in opposite directions with respect to the center line J0 of the housing HS as the reference direction (= 0°). The first insertion port EN11F is provided at a position rotated by a predetermined angle θF counterclockwise from the X-axis direction from the first insertion port EN11 shown in Configuration Example 1, etc. The second insertion port EN12F is provided at a position rotated by a predetermined angle θF clockwise from the X-axis direction from the second insertion port EN12 shown in Configuration Example 1, etc. As a result, the first insertion port EN11F and the second insertion port EN12F in Configuration Example 7 are provided so as to face outward at a radius from the center line J0 of the housing HS.

[0121] Furthermore, in configuration example 7, the first insertion port EN11F and the second insertion port EN12F are arranged to face outwards from the housing HS. The first insertion port EN11F and the second insertion port EN12F are located in front of the surface on which the surveillance camera C1, the facial recognition camera C2, and the monitor MN are installed, respectively, in the X-axis direction.

[0122] As described above, in the housing HS of configuration example 7, the first insertion port EN11F and the second insertion port EN12F each face outward from the radius of the housing HS, and the protruding portion HSF that protrudes in front of (towards the user) the first insertion port EN11F and the second insertion port EN12F makes it more difficult for the user to insert their right and left hands, which are crossed on the table TB and swapped, into the first imaging unit Ar11F and the second imaging unit Ar12F, respectively.

[0123] Furthermore, in the housing HS in configuration example 7, the first insertion slot EN11F and the second insertion slot EN12F are both located within the field of view of the surveillance camera C1. Therefore, even if a person other than the user (another person) inserts their hand into the first insertion slot EN11F or the second insertion slot EN12F from the side of the housing HS on behalf of the user, the arm of the person impersonating the user can be captured by the surveillance camera C1, and thus the surveillance camera C1 can detect the fraudulent act of impersonation.

[0124] <Another Configuration Example 1 for the Enclosure> Next, with reference to Figure 10, an example configuration 1 for the enclosure HS will be described. Figure 10 is a diagram showing an alternative configuration example 1 for the enclosure HS.

[0125] In the other configuration example 1, the housing HS is provided with partitions PT3A and PT3B at both ends of the table TB in the direction along the Y-axis. Partition PT3A is provided between the right side (in the direction along the Y-axis) peripheral edge of the first insertion opening EN11 and the end of the table TB. Partition PT3A prevents a hand of a person other than the user from being inserted into the first insertion opening EN11 from the right side (in the direction along the Y-axis) of the housing HS. Partition PT3B is provided between the left side (opposite direction to the Y-axis) peripheral edge of the second insertion opening EN12 and the end of the table TB. Partition PT3B prevents a hand of a person other than the user from being inserted into the second insertion opening EN12 from the left side (opposite direction to the Y-axis) of the housing HS.

[0126] The height of each of the multiple partitions PT3A and PT3B, that is, the size along the Z-axis, is greater than the size (height) along the Z-axis of the first insertion opening EN11 and the second insertion opening EN12, respectively. Note that while Figure 10 shows an example where each of the multiple partitions PT3A and PT3B is provided flush with the side surfaces of the housing HS and table TB, the design is not limited to this configuration.

[0127] As described above, in the other configuration example 1, the enclosure HS is provided with partitions PT3A and PT3B on both sides of the table TB, thereby more effectively preventing fraud by allowing someone other than the user (another person) to insert their hand into the first insertion slot EN11 or the second insertion slot EN12 from the side of the enclosure HS on behalf of the user.

[0128] <Another Configuration Example of the Enclosure 2> Next, with reference to Figure 11, an alternative configuration example of the enclosure HS will be described. Figure 11 is a diagram showing an alternative configuration example of the enclosure HS.

[0129] In the other configuration example 2, the housing HS has multiple partitions PT4A and PT4B. Each of the multiple partitions PT4A and PT4B is provided at a height L1 away from the table TB from each of the multiple partitions PT3A and PT3B shown in the other configuration example 1. Here, the height L1 is preferably less than the thickness of a typical human arm, such as 5 cm or 10 cm, but is not limited to this. The height L1 may be less than or equal to the opening height of the first insertion port EN11 and the second insertion port EN12, respectively.

[0130] As described above, in the other configuration example 2, the enclosure HS is provided with partitions PT4A and PT4B on both sides of the table TB, thereby more effectively preventing fraud by allowing someone other than the user (another person) to insert their hand into the first insertion slot EN11 or the second insertion slot EN12 from the side of the enclosure HS on behalf of the user.

[0131] Furthermore, the height L1 of the gap between partitions PT4A and PT4B and table TB is less than or equal to the opening height of the first insertion port EN11 and the second insertion port EN12, respectively. Therefore, the enclosure HS makes it more difficult for someone other than the user (another person) to insert their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the enclosure HS on behalf of the user.

[0132] <Other Configuration Examples of the Enclosure 3> Next, with reference to Figure 12, a third configuration example of the enclosure HS will be described. Figure 12 is a diagram showing a third configuration example of the enclosure HS.

[0133] In the other configuration example 3, the housing HS is provided with partitions PT5A and PT5B on both ends of the table TB in the direction along the Y-axis. Partition PT5A is provided between the right side (in the direction along the Y-axis) peripheral edge of the first insertion opening EN11 and the end of the table TB. Partition PT5A prevents a hand of a person other than the user from being inserted into the first insertion opening EN11 from the right side (in the direction along the Y-axis) of the housing HS. Partition PT5B is provided between the left side (opposite direction to the Y-axis) peripheral edge of the second insertion opening EN12 and the end of the table TB. Partition PT5B prevents a hand of a person other than the user from being inserted into the second insertion opening EN12 from the left side (opposite direction to the Y-axis) of the housing HS.

[0134] The dimensions (height) of each of the multiple partitions PT5A and PT5B along the Z-axis direction should be greater than or equal to the dimensions (height) of the first insertion port EN11 and the second insertion port EN12 along the Z-axis direction.

[0135] As described above, in the other configuration example 3, the enclosure HS is provided with partitions PT5A and PT5B on both sides of the table TB, thereby more effectively preventing fraud by allowing someone other than the user (another person) to insert their hand into the first insertion slot EN11 or the second insertion slot EN12 from the side of the enclosure HS on behalf of the user.

[0136] Furthermore, the biological information acquisition system 100 in this disclosure is not limited to the above-described configuration examples 1 to 7 of the imaging unit and other configuration examples 1 to 3 of the housing, but may have a configuration obtained by arbitrarily combining one or more of the configuration examples 1 to 7 of the imaging unit and other configuration examples 1 to 3 of the housing.

[0137] (Note) The following technologies are disclosed based on the descriptions of each embodiment above.

[0138] (Technical 1) The system comprises: a housing HS; a first authentication camera (first fingerprint authentication camera C31) housed in the housing HS and capturing an image of the authentication area (e.g., a fingerprint) of one of the authenticated person's hands inserted into a first insertion port EN11; a second authentication camera (second fingerprint authentication camera C32) housed in the housing HS and capturing an image of the authentication area of ​​the other of the authenticated person's hands inserted into a second insertion port EN12 different from the first insertion port EN11; a surveillance camera C1 installed in the housing HS and capturing an image of the authenticated person inserting their hands into the first insertion port EN11 and the second insertion port EN12, respectively; a camera control unit (processor 11) that controls the first authentication camera (first fingerprint authentication camera C31), the second authentication camera (second fingerprint authentication camera C32), and the surveillance camera C1; and a detection unit (processor 11) that detects whether or not the captured authentication area is fraudulent based on the image captured by the surveillance camera C1. The camera control unit (processor 11), when the detection unit (processor 11) does not detect the fraud, causes the first authentication camera (first fingerprint authentication camera C31) and the second authentication camera (second fingerprint authentication camera C32) to perform imaging and acquire captured images (e.g., fingerprint images, etc.) of the authentication parts of one hand and the other hand respectively, as a biometric information acquisition device (biometric information acquisition system 100). As a result, the biometric information acquisition system 100 can more effectively suppress fraud of the biometric parts inserted into the first fingerprint authentication camera C31 and the second fingerprint authentication camera C32, respectively (e.g., fraud of switching hands, or impersonation using another person's hand, etc.) by detecting whether or not fraud is being committed using the surveillance camera C1.

[0139] (Technical 2) The first insertion port EN11 and the second insertion port EN12 are arranged side by side in a direction substantially perpendicular to the hand insertion directions DRR and DRL, as described in (Technical 1), in the biometric information acquisition device (biometric information acquisition system 100). As a result, the biometric information acquisition system 100 in the configuration example 1 of the imaging unit makes it difficult for the user to insert their hands, which are crossed on the table TB and swapped left and right, into the first imaging unit Ar11 and the second imaging unit Ar12, respectively. Furthermore, even if a person other than the user (another person) inserts their hand into the first insertion port EN11 or the second insertion port EN12 from around the housing HS on behalf of the user, the biometric information acquisition system 100 has a configuration in which the arm of the person impersonating the user is inevitably captured by the surveillance camera C1, so that impersonation and other fraud can be detected.

[0140] (Technical 3) The housing HS has a first imaging space (first imaging unit Ar11A) in which one hand inserted into the first insertion port EN11 is imaged, and a second imaging space (second imaging unit Ar12A) in which the other hand inserted into the second insertion port EN12 is imaged, and the height H1 of the bottom surfaces IS11A, IS12A of the first imaging space (first imaging unit Ar11A) and the second imaging space (second imaging unit Ar12A) increases as they move away from the first insertion port EN11 and the second insertion port EN12 along the insertion directions DRR, DRL of the hands, the biological information acquisition device (biological information acquisition system 100) as described in (Technical 1). As described above, the biometric information acquisition system 100 in the configuration example 2 of the imaging unit has a configuration that requires the fingers to be inserted in a position that follows the inclination inside the first imaging unit Ar11A and the second imaging unit Ar12A. Therefore, it makes it more difficult for someone other than the user (another person) to insert their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user. Furthermore, even if someone other than the user (another person) inserts their hand into the first insertion port EN11 or the second insertion port EN12 from the periphery of the housing HS on behalf of the user, the biometric information acquisition system 100 has a configuration in which the arm of the person impersonating the user is inevitably captured by the surveillance camera C1. Therefore, it is possible to detect impersonation and other fraud.

[0141] (Technical 4) The housing HS has a first imaging space (first imaging unit Ar11B) in which one hand inserted into the first insertion port EN11 is imaged, and a second imaging space (second imaging unit Ar12B) in which the other hand inserted into the second insertion port EN12 is imaged, and the height H2 of the bottom surfaces IS11B, IS12B of the first imaging space (first imaging unit Ar11B) and the second imaging space (second imaging unit Ar12B) respectively decreases as they move away from the first insertion port EN11 and the second insertion port EN12 along the insertion directions DRR, DRL of the hands, the biological information acquisition device (biological information acquisition system 100) as described in (Technical 1). As described above, the biometric information acquisition system 100 in the configuration example 3 of the imaging unit has a configuration that requires the fingers to be inserted in a position that follows the inclination inside the first imaging unit Ar11B and the second imaging unit Ar12B, making it more difficult for someone other than the user (another person) to insert their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user. Furthermore, even if someone other than the user (another person) inserts their hand into the first insertion port EN11 or the second insertion port EN12 from the periphery of the housing HS on behalf of the user, the biometric information acquisition system 100 has a configuration in the first imaging unit Ar11B and the second imaging unit Ar12B that inevitably captures the arm of the person impersonating the user by the surveillance camera C1, thus enabling the detection of impersonation and other fraudulent activities.

[0142] (Technical 5) The biological information acquisition device (biological information acquisition system 100) described in (Technical 1), wherein the housing HS has at least one partition PT1, PT2A, PT2B protruding in a direction substantially opposite to the hand insertion directions DRR, DRL between the first insertion port EN11 and the second insertion port EN12. As described above, the biological information acquisition system 100 in the configuration examples 4 and 5 of the imaging unit can make it more difficult for the user to insert their right and left hands, which are crossed on the table TB and swapped left and right, into the first imaging unit Ar11C, Ar11D and the second imaging unit Ar12C, Ar12D, respectively, by means of partitions PT1, PT2A, PT2B protruding from the surface of the housing HS11 toward the front side (X-axis direction).

[0143] (Technical 6) The first insertion ports EN11E, EN11F and the second insertion ports EN12E, EN12F are positioned at predetermined angles θE, θF, respectively, rotated in opposite directions from the front of the housing HS, with respect to the center line J0 of the housing HS, as described in (Technical 1), for the biological information acquisition device (biological information acquisition system 100). As a result, in the biological information acquisition system 100 in the imaging unit configuration examples 6 and 7, the first insertion ports EN11E, EN11F and the second insertion ports EN12E, EN12F each face outward from the radius of the housing HS, making it more difficult for the user to insert their right and left hands, crossed on the table TB and with their hands swapped, into the first imaging units Ar11E, Ar11F and the second imaging units Ar12E, Ar12F, respectively.

[0144] (Technical 7) The housing HS further has a protruding portion HSF that protrudes toward the front of the housing HS between the surveillance camera C1 and the person to be authenticated, and the first insertion port EN11F and the second insertion port EN12F are formed in the protruding portion HSF, as described in (Technical 6) for the biometric information acquisition device (biometric information acquisition system 100). As a result, in the biometric information acquisition system 100 in the configuration example 7 of the imaging unit, the first insertion port EN11F and the second insertion port EN12F are positioned within the field of view of the surveillance camera C1 by the protruding portion HSF that protrudes toward the front (user side) of the first insertion port EN11F and the second insertion port EN12F. Therefore, even if a person other than the user (another person) inserts their hand into the first insertion slot EN11F or the second insertion slot EN12F from the side of the housing HS on behalf of the user, the surveillance camera C1 can capture an image of the arm of the person impersonating the user, and thus the surveillance camera C1 can detect the fraudulent act of impersonation.

[0145] (Technical 8) The biological information acquisition device (biological information acquisition system 100) described in (Technical 1), further comprising: a first partition (partitions PT3A, PT4A, PT5A) between the first insertion port EN11 and one side of the housing HS; and a second partition (partitions PT3B, PT4B, PT5B) between the second insertion port EN12 and the other side of the housing HS. Thus, the biological information acquisition system 100 in the other configuration examples 1 to 3 of the housing HS can more effectively suppress fraud by providing partitions PT3A, PT3B, PT4A, PT4B, PT5A, PT5B on each side of the table TB, which would otherwise involve someone other than the user inserting their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user.

[0146] (Technical 9) The housing HS further includes a table TB protruding toward the front of the housing HS between the surveillance camera C1 and the person to be authenticated, and the first partition (partitions PT3A, PT5A) and the second partition (partitions PT3B, PT5B) are provided on the table TB, as described in (Technical 8) for the biometric information acquisition device (biometric information acquisition system 100). As described above, the biometric information acquisition system 100 in the other configuration examples 1 and 3 of the housing HS can more effectively suppress fraud by providing partitions PT3A, PT3B, PT5A, and PT5B on each of the sides of the table TB, thereby preventing unauthorized insertion of a person other than the user (another person) into the first insertion opening EN11 or the second insertion opening EN12 from the side of the housing HS on behalf of the user.

[0147] (Technical 10) The housing HS further includes a table TB protruding toward the front of the housing HS between the surveillance camera C1 and the person to be authenticated, and the first partition (partition PT4A) and the second partition (partition PT4B) have a gap between them and the table TB, as described in (Technical 8). The biometric information acquisition device (biometric information acquisition system 100) in the other configuration example 2 of the housing HS makes it more difficult for a person other than the user (another person) to insert their hand into the first insertion opening EN11 or the second insertion opening EN12 from the side of the housing HS on behalf of the user by providing partitions PT4A and PT4B on each side of the table TB.

[0148] (Technical 11) The height of the first partition (partition PT5A) and the second partition (partition PT5B) is the opening height of the first insertion port EN11 and the second insertion port EN12, as described in (Technical 8) for the biological information acquisition device (biological information acquisition system 100). As described above, the biological information acquisition system 100 in the other configuration example 3 of the housing HS can be made more difficult to use by providing partitions PT5A and PT5B on each side of the table TB, thereby making it more difficult for someone other than the user (another person) to insert their hand into the first insertion port EN11 or the second insertion port EN12 from the side of the housing HS on behalf of the user.

[0149] (Technical 12) A method for acquiring biometric information performed by a biometric information acquisition device (biometric information acquisition system 100), comprising: a housing HS; a first authentication camera (first fingerprint authentication camera C31) housed in the housing HS and imaging the authentication area (e.g., fingerprint, etc.) of one hand of a person to be authenticated that is inserted into a first insertion port EN11; a second authentication camera (second fingerprint authentication camera C32) housed in the housing HS and imaging the authentication area of ​​the other hand of the person to be authenticated that is inserted into a second insertion port EN12 different from the first insertion port EN11; and a surveillance camera C1 installed in the housing HS and imaging the person to be authenticated as he inserts his hands into the first insertion port EN11 and the second insertion port EN12, respectively, wherein the biometric information acquisition device (biometric information acquisition system 100) images the person to be authenticated with the surveillance camera C1, and detects whether or not the imaged authentication area is fraudulent based on the image captured by the surveillance camera C1. A method for acquiring biometric information, wherein if it is determined that no fraud is detected, the system causes the first authentication camera (first fingerprint authentication camera C31) and the second authentication camera (second fingerprint authentication camera C32) to perform imaging to acquire captured images (e.g., fingerprint images, etc.) of the authentication parts of one hand and the other hand, respectively. By doing so, the biometric information acquisition system 100 can more effectively suppress fraud of the biometric parts inserted into the first fingerprint authentication camera C31 and the second fingerprint authentication camera C32 (e.g., fraud involving switching hands, or impersonation using another person's hand, etc.) by detecting whether or not fraud is being committed using the surveillance camera C1.

[0150] Although various embodiments have been described above with reference to the attached drawings, this disclosure is not limited to such examples. It will be clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims, and these will also be understood to fall within the technical scope of this disclosure. Furthermore, the components of the various embodiments described above can be combined arbitrarily without departing from the spirit of the invention.

[0151] This application is based on a Japanese patent application (Patent Application No. 2025-015492) filed on January 31, 2025, the contents of which are incorporated herein by reference.

[0152] This disclosure is useful as a presentation of a biometric information acquisition device, a biometric information acquisition method, and a biometric information acquisition system that suppress fraudulent activities when acquiring multiple biometric information used for biometric authentication.

[0153] 10 Communication unit 11 Processor 12 Memory 100 Biometric information acquisition system 200 External server 300 Authentication system Ar11, Ar11A, Ar11B, Ar11C, Ar11D, Ar11E, Ar11F First imaging unit Ar12, Ar12A, Ar12B, Ar12C, Ar12D, Ar12E, Ar12F Second imaging unit C1 Surveillance camera C2 Face recognition camera C31 First fingerprint authentication camera C32 Second fingerprint authentication camera EN11, EN11E, EN11F First insertion slot EN12, EN12E, EN12F Second insertion slot HS, HS11 Housing HSF Protruding part IS11, IS11A, IS11B, IS12, IS12A, IS12B Bottom L11 First imaging illumination L12 Second imaging illumination MN Monitor P1 Terminal device PT1, PT2A, PT2B, PT3A, PT3B, PT4A, PT4B, PT5A, PT5B Partition S11 Face recognition server S12 Fingerprint recognition server TB Table

Claims

1. A biometric information acquisition device comprising: a housing; a first authentication camera housed in the housing and imaging an authentication area of ​​one hand of a person to be authenticated inserted into a first insertion port; a second authentication camera housed in the housing and imaging an authentication area of ​​the other hand of the person to be authenticated inserted into a second insertion port different from the first insertion port; a surveillance camera installed in the housing and imaging the person to be authenticated as he inserts his hands into the first and second insertion ports, respectively; a camera control unit that controls the first authentication camera, the second authentication camera, and the surveillance camera; and a detection unit that detects whether or not there is any fraud in the authentication area being imaged based on the image captured by the surveillance camera, wherein if the detection unit does not detect any fraud, the camera control unit causes the first authentication camera and the second authentication camera to perform imaging to obtain an image of the authentication areas of one hand and the other hand.

2. The biological information acquisition device according to claim 1, wherein the first insertion port and the second insertion port are arranged side by side in a direction substantially perpendicular to the direction of insertion of the hand.

3. The biological information acquisition device according to claim 1, wherein the housing has a first imaging space in which one hand inserted into the first insertion port is imaged, and a second imaging space in which the other hand inserted into the second insertion port is imaged, and the height of the bottom surface of the first imaging space and the second imaging space increases as they move away from the first and second insertion ports along the direction of insertion of the hand.

4. The biological information acquisition device according to claim 1, wherein the housing has a first imaging space in which one hand inserted into the first insertion port is imaged, and a second imaging space in which the other hand inserted into the second insertion port is imaged, and the height of the bottom surface of the first imaging space and the second imaging space decreases as they move away from the first and second insertion ports along the direction of insertion of the hand.

5. The biological information acquisition device according to claim 1, wherein the housing has at least one partition protruding in a direction substantially opposite to the direction in which the hand is inserted, between the first insertion opening and the second insertion opening.

6. The biological information acquisition device according to claim 1, wherein the first insertion port and the second insertion port are provided at positions rotated by a predetermined angle in opposite directions from the front of the housing, with respect to the center line of the housing.

7. The biometric information acquisition device according to claim 6, wherein the housing further has a projection that protrudes toward the front of the housing between the surveillance camera and the person to be authenticated, and the first insertion port and the second insertion port are formed in the projection.

8. The biological information acquisition device according to claim 1, wherein the housing further comprises a first partition between the first insertion opening and one side of the housing, and a second partition between the second insertion opening and the other side of the housing.

9. The biometric information acquisition device according to claim 8, wherein the housing further comprises a table protruding toward the front of the housing between the surveillance camera and the person to be authenticated, and the first partition and the second partition are provided on the table.

10. The biometric information acquisition device according to claim 8, wherein the housing further comprises a table protruding toward the front of the housing between the surveillance camera and the person to be authenticated, and the first partition and the second partition have a gap between them and the table.

11. The biological information acquisition device according to claim 8, wherein the height of the first partition and the second partition is the opening height of the first insertion port and the second insertion port.

12. A method for acquiring biometric information performed by a biometric information acquisition device, comprising: a housing; a first authentication camera housed in the housing and imaging an authentication area of ​​one hand of a person to be authenticated inserted into a first insertion port; a second authentication camera housed in the housing and imaging an authentication area of ​​the other hand of the person to be authenticated inserted into a second insertion port different from the first insertion port; and a surveillance camera installed in the housing and imaging the person to be authenticated as he inserts his hands into the first and second insertion ports, respectively, the method comprising: imaging the person to be authenticated with the surveillance camera; detecting whether or not there is any fraud in the authentication area being imaged based on the image captured by the surveillance camera; and, if it is determined that no fraud is detected, causing the first and second authentication cameras to perform imaging to acquire an image of the authentication areas of one hand and the other hand.

Images