Information processing device, authentication system, information processing method and program

Abstract

Provided is an information processing device capable of reducing the possibility of contact between a user and a member in authentication of the user. The information processing device (100) comprises: a detection unit (101) that detects a hand presenting an object to be read including identification information of the user; and a reading unit (102) that reads biological information from an image obtained by imaging the detected hand and that reads the identification information from the object to be read presented by the hand.

Description

Information processing device, authentication system, information processing method, and non-transitory computer-readable medium

[0001] The present disclosure relates to an information processing device, an authentication system, an information processing method, and a program.

[0002] 2. Description of the Related Art There is known a technology for performing biometric authentication at immigration and customs by reading biometric information registered in a passport and comparing it with the biometric information of a user who is the subject of the inspection.

[0003] As a related technology, for example, Patent Document 1 discloses a personal authentication system device that includes a first input means for inputting a fingerprint and a printing means for colorlessly printing the fingerprint input using the first input means on a personal authentication medium.

[0004] The device disclosed in Patent Document 1 reads the colorless barcode printed on the passport's photograph when the passport is set in the barcode reader. It also reads the subject's fingerprint when the subject's finger is pressed against the board. The device authenticates the subject by comparing the contents of the barcode read from the passport with the actual fingerprint pattern read from the subject.

[0005] Japanese Patent Application Publication No. 10-208054

[0006] When performing fingerprint authentication using the above-described device, the user needs to press their finger against the board to read the fingerprint. However, in recent years, from the viewpoint of preventing the spread of infectious diseases, there has been a demand for authentication to be performed without the user having to touch such components. The technology disclosed in Patent Document 1 has a problem in that the user needs to touch a predetermined component during authentication.

[0007] In view of the above-mentioned problems, the purpose of this disclosure is to provide an information processing device, an authentication system, an information processing method, and a program that can reduce the possibility of contact between a user and a component during user authentication.

[0008] The information processing device disclosed herein includes a detection unit that detects a hand presenting a read object containing a user's identification information, and a reading unit that reads biometric information from an image of the detected hand and reads the identification information from the read object presented by the hand.

[0009] The authentication system disclosed herein comprises an information processing device and an authentication device, wherein the information processing device has a detection unit that detects a hand presenting a read object containing a user's identification information, and a reading unit that reads biometric information from an image of the detected hand and reads the identification information from the read object presented by the hand, and the authentication device acquires the biometric information and the identification information from the information processing device and performs biometric authentication of the user based on the biometric information and the identification information.

[0010] The information processing method disclosed herein involves a computer executing a detection step of detecting a hand presenting a read object containing a user's identification information, and a reading step of reading biometric information from an image of the detected hand and reading the identification information from the read object presented by the hand.

[0011] The program disclosed herein causes a computer to execute a detection step of detecting a hand presenting a read object containing a user's identification information, and a reading step of reading biometric information from an image of the detected hand and reading the identification information from the read object presented by the hand.

[0012] 17 is a block diagram showing the configuration of an information processing device according to a first embodiment. FIG. 18 is a flowchart showing processing performed by the information processing device according to the first embodiment. FIG. 19 is a block diagram showing the configuration of an authentication system according to a second embodiment. FIG. 20 is a block diagram showing the configuration of an authentication device according to the second embodiment. FIG. 21 is a block diagram showing the configuration of an information processing device according to the second embodiment. FIG. 22 is a first diagram showing an example of use of the information processing device according to the second embodiment. FIG. 23 is a second diagram showing an example of use of the information processing device according to the second embodiment. FIG. 24 is a flowchart showing processing performed by the information processing device according to the second embodiment. FIG. 25 is a diagram explaining the configuration of a guide unit according to a third embodiment. FIG. 26 is a diagram showing an example of presenting a read object using the guide unit according to the third embodiment. FIG. 27 is a diagram explaining the configuration of a guide unit according to a fourth embodiment. FIG. 28 is a diagram showing the configuration of an information processing device according to the fourth embodiment. FIG. 29 is a diagram showing the configuration of an information processing device when a biometric information reading device according to the fourth embodiment reads biometric information at multiple locations. FIG. 29 is a diagram explaining the configuration of a guide unit according to a fifth embodiment. FIG. 29 is a diagram showing an example of presenting a read object using the guide unit according to the fifth embodiment. FIG. 29 is a diagram explaining the configuration of a guide unit according to a sixth embodiment. FIG. 29 is a diagram showing an example of presenting a read object using the guide unit according to the sixth embodiment. FIG. 21 is a diagram showing the information processing device when the state shown in FIG. 17 is seen from the user's side. FIG. 22 is a block diagram showing an example of the hardware configuration of a computer that realizes an information processing device or the like.

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals. For clarity of explanation, duplicated explanations will be omitted as necessary.

[0014] First Embodiment First, a first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of an information processing device 100 according to this embodiment. The information processing device 100 includes a detection unit 101 and a reading unit 102.

[0015] The detection unit 101 detects a hand presenting a reading object containing a user's identification information. The reading unit 102 reads biometric information from an image of the hand detected by the detection unit 101, and also reads the identification information from the reading object presented by the hand.

[0016] Next, the process performed by the information processing device 100 according to this embodiment will be described with reference to Fig. 2. Fig. 2 is a flowchart showing the process performed by the information processing device 100.

[0017] First, the detection unit 101 detects a hand presenting a read object containing a user's identification information (S101). Next, the reading unit 102 reads biometric information from an image of the hand detected by the detection unit 101, and also reads identification information from the read object presented by the hand (S102). The reading unit 102 may read the biometric information and the identification information at the same time, or may read them at different times.

[0018] By providing such a configuration, the information processing apparatus 100 according to this embodiment can reduce the possibility of the user coming into contact with a member during user authentication.

[0019] Second Embodiment Next, a description will be given of a second embodiment, which is a specific example of the first embodiment described above.

[0020] (Configuration and Overview of Authentication System 1) The authentication system 1 according to this embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the authentication system 1. As shown in Fig. 3, the authentication system 1 includes an information processing device 10 and an authentication device 50. The information processing device 10 and the authentication device 50 are connected via a network N. The network N is a wired or wireless communication line.

[0021] The authentication system 1 is an information processing system for performing biometric authentication of a user using biometric information obtained from the user who is a subject of biometric authentication. The authentication system 1 is used in, for example, but not limited to, airports, ATMs, buildings, stations, stores, hospitals, public facilities, and the like.

[0022] Examples of biometric information that can be used include a fingerprint shape pattern, a vein shape pattern, or a combination thereof. Without being limited to these, various types of information that can calculate feature quantities that indicate physical characteristics unique to a user may be used as biometric information. Without being limited to these, the biometric information may be various types of biometric information that can be read together with the hand that presents the reading target.

[0023] In the authentication system 1, an information processing device 10 detects a hand presenting a read object containing a user's identification information. The information processing device 10 also reads biometric information from an image of the detected hand, and reads the identification information from the read object presented by the hand.

[0024] The identification information is information for uniquely identifying a user. The identification information may be, for example, a character string composed of alphabets and numbers. The identification information may be, for example, a passport number printed on a passport. The identification information may also be biometric information of the user. For example, if a fingerprint image for use in fingerprint authentication is stored in an IC chip built into the passport, the fingerprint image can be used as the identification information.

[0025] The identification information may be a combination of multiple pieces of information. For example, a combination of multiple pieces of information such as the user's name, date of birth, address, and biometric information may be used as the identification information. The identification information may be written on the object to be read by printing or the like, or may be stored in an IC chip or the like built into the object to be read.

[0026] The object to be read may be an article containing identification information. The object to be read may be, for example, a document on which identification information is written. The object to be read may include, for example, a passport, a refugee travel document, a driver's license, a health insurance card, or a My Number card. Identification documents other than these may also be used as the object to be read.

[0027] The object to be read may be a document or the like incorporating an IC chip in which identification information is stored. The object to be read may also be an information terminal that stores identification information. The information terminal may be, for example, a smartphone, a mobile phone terminal, or a tablet terminal owned by the user. The information terminal may also be a wearable terminal such as a smart watch. These are just examples, and the object to be read may also be various media other than those listed above.

[0028] For example, suppose the authentication system 1 is used in immigration control at an airport. The object to be read is a passport or the like that a user presents to pass through immigration control. The authentication system 1 detects the hand of the user presenting the object to be read using the information processing device 10, and reads biometric information from the detected hand. The information processing device 10 also reads identification information from the object to be read that the user presents with their hand.

[0029] The information processing device 10 controls biometric authentication of the user using the read biometric information and identification information. Specifically, the information processing device 10 transmits an authentication request including the biometric information and identification information to the authentication device 50. The authentication device 50 performs authentication in response to the authentication request from the information processing device 10 and transmits the authentication result to the information processing device 10. The information processing device 10 receives the authentication result from the authentication device 50.

[0030] In response to successful authentication, the information processing device 10 issues an instruction to unlock a predetermined gate device installed at the airport, thereby allowing the successfully authenticated user to pass through immigration.

[0031] (Configuration of authentication device 50) Next, the configuration of the authentication device 50 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the authentication device 50. The authentication device 50 is a computer that performs biometric authentication of a user in response to an authentication request from the information processing device 10.

[0032] The authentication device 50 acquires biometric information and identification information of a user from the information processing device 10 and performs biometric authentication of the user based on the acquired biometric information and identification information. The authentication device 50, for example, receives an image related to the user's biometric information from the information processing device 10 and authenticates the person by extracting a predetermined characteristic image from the received image. The characteristic image is, for example, a fingerprint pattern image. The authentication device 50 transmits an authentication result to the information processing device 10.

[0033] The authentication device 50 mainly comprises an authentication storage unit 51 , a feature image extraction unit 52 , a feature point extraction unit 53 , a registration unit 54 , and an authentication unit 55 .

[0034] The authentication storage unit 51 stores a person ID, characteristic data, and identification data of a person registered in advance, in association with each other. The identification data is, for example, a passport number written on the passport.

[0035] The feature image extraction unit 52 detects feature regions included in an image related to the user's biometric information and outputs the detected feature regions to the feature point extraction unit 53. The feature point extraction unit 53 extracts feature points from the feature regions detected by the feature image extraction unit 52 and outputs data related to the feature points to the registration unit 54. The data related to the feature points is a collection of the extracted feature points.

[0036] The registration unit 54 issues a new person ID when registering the feature data and the identification information data. The registration unit 54 associates the issued person ID, the feature data extracted from the registered image, and the person's identification information data with each other, and registers them in the authentication storage unit 51.

[0037] The authentication unit 55 compares feature data extracted from an image related to the user's biometric information with the feature data in the authentication storage unit 51. The authentication unit 55 also compares the user's identification information acquired from the information processing device 10 with the identification information data in the authentication storage unit 51. If there is feature data that matches the user's biometric information and the user's identification information matches the identification information data, the authentication unit 55 determines that authentication has been successful.

[0038] On the other hand, if the condition is not satisfied, the authentication unit 55 determines that the authentication has failed. For example, if there is no feature data that matches the user's biometric information, the authentication unit 55 determines that the authentication has failed. Also, if there is feature data that matches the user's biometric information but the identification information does not match the identification information data, the authentication unit 55 determines that the authentication has failed.

[0039] The authentication unit 55 transmits information regarding the success or failure of the authentication to the information processing device 10. Furthermore, if the authentication is successful, the authentication unit 55 identifies the person ID associated with the successful feature data and identification information data, and notifies the information processing device 10 of the authentication result including the identified person ID.

[0040] (Configuration of information processing device 10) Next, the configuration of the information processing device 10 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the information processing device 10. The information processing device 10 is an example of the information processing device 100 described above. The information processing device 10 is a computer for performing information processing according to this embodiment.

[0041] The information processing device 10 includes a detection unit 11, a reading control unit 12, an authentication control unit 13, an output unit 14, a memory unit 15, a guide unit 18, a detection sensor 20, a biometric information reader 30, and an identification information reader 40.

[0042] The detection unit 11 is an example of the detection unit 101 described above. The detection unit 11 detects the hand of a user presenting an object to be read that includes the user's identification information. Specifically, the detection unit 11 detects the hand based on data acquired by the detection sensor 20. The detection sensor 20 may include, for example, a camera, a distance measurement sensor, or a pressure sensor.

[0043] When the detection sensor 20 is a camera, the detection unit 11 detects the user's hand presenting the object to be read from an image captured of the hand presenting the object to be read on a predetermined stand. The predetermined stand is, for example, a stand provided in a space where immigration inspection is carried out at an airport. The detection unit 11 acquires the captured image from the detection sensor 20 and detects the user's hand presenting the object to be read from the captured image. The detection unit 11 can detect the user's hand presenting the object to be read using well-known image recognition technology.

[0044] Furthermore, when the detection sensor 20 is a distance measurement sensor, the detection unit 11 detects the hand of a user presenting an object to be read on a predetermined mounting base based on distance measurement data acquired from the distance measurement sensor. For example, the detection unit 11 calculates the difference between distance measurement data of the detection target area when no object or the like is placed on the mounting base and distance measurement data acquired by the detection sensor 20. The detection unit 11 uses the difference to detect unevenness present in the detection target area, thereby detecting the hand of the user presenting the object to be read. For example, when unevenness of a predetermined level or more occurs within a predetermined range of the mounting base, the detection unit 11 detects the hand of the user presenting the object to be read on the mounting base.

[0045] If the detection sensor 20 is a pressure sensor, the detection unit 11 detects the hand presenting the object to be read based on pressure data acquired from a pressure sensor provided on a predetermined table. For example, the detection unit 11 determines whether the pressure applied to the table is equal to or greater than a predetermined threshold, and detects the user's hand presenting the object to be read based on the determination result. The detection unit 11 detects the user's hand when the pressure applied to the table is equal to or greater than the predetermined threshold, and does not detect the user's hand when the pressure is less than the threshold.

[0046] The above-described detection method is an example, and the detection unit 11 may use various other methods to detect the user's hand presenting the object to be read.

[0047] The reading control unit 12 is an example of the above-mentioned reading unit 102. The reading control unit 12 controls the biometric information reading device 30 and the identification information reading device 40. The reading control unit 12 controls the biometric information reading device 30 and the identification information reading device 40 so as to read biometric information from an image of a hand detected by the detection unit 11 and to read identification information from a reading target presented by the hand.

[0048] The reading control unit 12 may control the biometric information reading device 30 and the identification information reading device 40 so that the biometric information and the identification information are read at the same time. Alternatively, the reading control unit 12 may control the biometric information reading device 30 and the identification information reading device 40 so that the biometric information and the identification information are read at different times.

[0049] An example will be described in which the reading control unit 12 controls the biometric information reading device 30 and the identification information reading device 40 so that the biometric information and the identification information are read at different times. For example, the reading control unit 12 first acquires the biometric information by having the biometric information reading device 30 read the biometric information. Next, the reading control unit 12 determines whether the quality of the biometric information is equal to or higher than a predetermined level, and, depending on the determination result, has the identification information reading device 40 read the identification information. If the reading control unit 12 determines that the quality of the biometric information is equal to or higher than a predetermined level, the reading control unit 12 has the identification information read, and if the quality is lower than the predetermined level, the reading control unit 12 does not have the identification information read.

[0050] If the biometric information is not read, the reading control unit 12 may notify the user to read the biometric information again, or may notify the user to change the posture of the hand so as to improve the quality of the biometric information.

[0051] Here, the quality of biometric information indicates whether the biometric information is in a state suitable for biometric authentication. For example, the higher the quality of the biometric information, the more suitable the biometric information is for biometric authentication, and the lower the quality of the biometric information, the less suitable the biometric information is for biometric authentication.

[0052] For example, suppose a fingerprint image obtained by capturing a user's fingerprint is used as biometric information. The quality of the fingerprint image can be determined by calculating a quality value using a known index. For example, the NIST Fingerprint Image Quality (NFIQ) established by the National Institute of Standards and Technology (NIST) is known as an index of fingerprint image quality.

[0053] The reading control unit 12 can calculate the quality value of the fingerprint image using an index such as NFIQ, and calculate the quality value based on the calculation result. The reading control unit 12 may also calculate the quality value using another index.

[0054] The reading control unit 12 may also calculate a quality value by accepting the result of a person's visual judgment of the quality of a fingerprint image. For example, the reading control unit 12 may accept the result of a visual judgment by an administrator of the authentication system 1 or the like from an input unit (not shown) and use the result as the quality value. The quality value may be expressed as a binary value such as "OK" or "NG", or may be expressed in multiple levels.

[0055] The authentication control unit 13 controls the biometric authentication of the user using the read biometric information and identification information. Specifically, the authentication control unit 13 transmits an authentication request including the biometric information and the identification information to the authentication device 50. The authentication control unit 13 receives an authentication result from the authentication device 50.

[0056] The output unit 14 is an output device for outputting predetermined information. The output unit 14 outputs, for example, guidance information generated by the guide unit 18. The output unit 14 may be, for example, a display, a speaker, a lamp, or a vibrator. The guide unit 18 may also be, for example, a projector for projecting the guidance information onto a stand or the like.

[0057] The storage unit 15 is a storage device that stores programs for implementing the various functions of the information processing device 10. The storage unit 15 also stores guidance information generated by the guide unit 18.

[0058] Guide unit 18 guides the hand and the object to be read so that biometric information can be read from the hand and identification information can be read from the object. For example, guide unit 18 generates guidance information for guiding the hand and the object to be read so that biometric information can be read from the hand and identification information can be read from the object. Guide unit 18 outputs the guidance information to output unit 14, and causes output unit 14 to output the guidance information. Guide unit 18 may store the guidance information in storage unit 15.

[0059] The guidance information is information for guiding the hand and the object to be read using, for example, text, images, sound, vibration, etc. The guidance information is, for example, audio information for outputting an audio message such as "Place your passport on the stand and place your hand on the passport."

[0060] The guidance information may include information for instructing the positional relationship between the hand and the object to be read. For example, the guidance information may be a voice message such as, "Place your passport on the stand and place your hand on the passport so that your fingers do not overlap with the passport." The guide unit 18 generates such a voice message and causes the output unit 14 to output it. This allows the user to change the positions of their hand and the object to be read in accordance with the guidance information.

[0061] The guidance information may be information for displaying such a message using text or an image. For example, the guidance information may be information for projecting such a message onto the mounting base using a projection device such as a projector.

[0062] The guidance information may also be a guidance image for guiding the hand and the object to be read to a state where biometric information can be read from the hand and identification information can be read from the object to be read. The guidance image may include an image such as an arrow symbol for guiding the hand and the object to be read to a predetermined position. By visually recognizing the guidance information, the user can move the hand and the object to be read to the predetermined position where the above-mentioned state is achieved.

[0063] The detection sensor 20 is a sensor for detecting the hand of a user presenting an object to be read, and may be, for example, a camera, a distance measurement sensor, or a pressure sensor.

[0064] For example, assume that the detection sensor 20 is a camera. The detection sensor 20 captures an image of an area including a hand presenting an object to be read on a predetermined mounting table. The detection sensor 20 outputs the captured image obtained by capturing the image to the detection unit 11. The light used for capturing the image may be visible light or light other than visible light (for example, infrared light).

[0065] Furthermore, it is assumed that the detection sensor 20 is a distance measurement sensor. The detection sensor 20 is, for example, a Time of Flight (ToF) sensor. The detection sensor 20 captures an image of an area including a hand presenting an object to be read on a predetermined mounting table. Specifically, the detection sensor 20 irradiates an object with LD (Laser Diode) light in the infrared region and receives the LD light reflected by the object with an infrared imaging element. The detection sensor 20 calculates the distance between the object and the detection sensor 20 by detecting the time difference between the irradiation and reception of the light for each pixel. The detection sensor 20 measures the calculated distance to the object for each pixel. The detection sensor 20 outputs the measurement result to the detection unit 11 as distance measurement data.

[0066] The detection sensor 20 is not limited to a ToF sensor, and various sensors capable of detecting the distance between the detection sensor 20 and the subject may be used.

[0067] The detection sensor 20 is assumed to be a pressure sensor. The detection sensor 20 is provided on a predetermined mounting table and detects the pressure applied to the mounting table. The detection sensor 20 outputs an output value as pressure data to the detection unit 11. A plurality of detection sensors 20 may be provided on the mounting table.

[0068] The above-described camera, distance measurement sensor, and pressure sensor are merely examples of the detection sensor 20, and other sensors may be used as the detection sensor 20.

[0069] The biometric information reader 30 reads biometric information from an image of the hand detected by the detector 11 under the control of the reader controller 12 .

[0070] The biometric information reading device 30 may be, for example, an OCT (Optical Coherence Tomography) device that uses OCT technology to acquire a pattern image of the surface or interior of an observation target. When a light beam is irradiated onto the observation target, the biometric information reading device 30 acquires a pattern image of the surface or interior of the observation target by utilizing interference between scattered light from inside the observation target and a reference light. The observation target is, for example, a user's finger. The biometric information reading device 30 acquires, for example, a fingerprint image showing a fingerprint pattern of the epidermis or dermis of the user's finger.

[0071] The biometric information reading device 30 can be installed above or below a predetermined stand. For example, when the biometric information reading device 30 is installed above the stand, the user faces their palms upward. When the biometric information reading device 30 is installed below the stand, the user faces their palms downward. This allows the biometric information reading device 30 to read the user's biometric information.

[0072] Furthermore, by using an OCT device, the biometric information reading device 30 can read a fingerprint through a reading object. For example, suppose the biometric information reading device 30 is provided below a table. Furthermore, suppose a user places their hand on the reading object so that it overlaps with the reading object. In this case, the reading object is present between the hand and the biometric information reading device 30, but the biometric information reading device 30 can read the fingerprint from below the table through the reading object. Therefore, the biometric information reading device 30 can read a fingerprint without the user touching the table.

[0073] Furthermore, by using an OCT device, the information processing device 10 can be configured so that a sheet member such as paper or film is placed on a mounting table, and the object to be read is placed on top of that. This prevents the user's hand or the object to be read from coming into contact with the mounting table, etc. The sheet member can be formed to a predetermined thickness that allows light used in the OCT device to pass through.

[0074] Furthermore, by making the case of the object to be read (for example, a passport) transparent, the biometric information reader 30 can read the biometric information with high accuracy.

[0075] The biometric information reading device 30 is not limited to an OCT device. For example, the biometric information reading device 30 may be a camera that captures an image of a hand presenting an object to be read. In this case, the biometric information reading device 30 detects a user's finger area from the captured image and reads the user's fingerprint pattern from the finger area. The biometric information reading device 30 may be, for example, a 3D fingerprint scanner that can read a three-dimensional fingerprint image. The biometric information reading device 30 may use visible light to capture an image of a finger, or may use light other than visible light (for example, infrared light).

[0076] The identification information reader 40 reads the user's identification information from the object to be read that is presented by the hand detected by the detector 11, under the control of the read controller 12. The identification information reader 40 may be provided on a predetermined mounting base. The identification information may be, for example, a passport number. The identification information may be printed or otherwise written on the object to be read, or may be stored in an IC chip or the like built into the object to be read.

[0077] The identification information reader 40 is, for example, a scanner including an image sensor. In this case, the identification information reader 40 takes a picture of the passport presented by the user, identifies characters from the image, and outputs the identified character information to the authentication control unit 13.

[0078] When identification information is associated with an object to be read by a method other than characters, the identification information reading device 40 may have a means for reading the identification information instead of a scanner. For example, the identification information reading device 40 may be a barcode reader, a magnetic information reading device, a near-field wireless communication device, etc. When a user holds the object to be read over the identification information reading device 40, the identification information reading device 40 reads the identification information from the object to be read.

[0079] The components of the authentication system 1 have been described above with reference to Figures 3 to 5. The above-described configuration of the authentication system 1 is merely an example and can be modified as appropriate. For example, the authentication system 1 may be configured using a device that aggregates multiple components. Furthermore, the functions of the information processing device 10 and the authentication device 50 may be aggregated in the same device. Furthermore, the functional units of the information processing device 10 and the authentication device 50 may be distributed and processed using multiple devices.

[0080] (Example of Use of Information Processing Device 10) Next, an example of use of the information processing device 10 according to this embodiment will be described with reference to Fig. 6. Fig. 6 is a first diagram showing an example of use of the information processing device 10. As shown in the figure, the information processing device 10 further includes a mounting table 5 in addition to the above-described configuration.

[0081] The right-handed xyz coordinate system shown in Figure 6 and other drawings is for the convenience of explaining the positional relationships of the components. Normally, the positive z-axis direction is vertically upward, and the xy plane is the horizontal plane, which is common among the drawings.

[0082] As shown in the figure, the mounting base 5 is, for example, a plate-like member having a horizontal main surface. However, the mounting base 5 may be, for example, the top surface of a box-like member or device. Furthermore, the mounting base 5 may have a predetermined angle so that the hand and the object to be read can be easily presented.

[0083] 6, the detection sensor 20 and the biometric information reading device 30 are provided above the mounting base 5. The detection sensor 20 is provided at a position where it can detect the hand of a user presenting an object to be read. For example, the detection sensor 20 is provided at a position where it can capture an image of an area that includes at least the user's hand. While FIG. 6 shows an example in which the detection sensor 20 is a camera or a distance measuring sensor, the detection sensor 20 may also be a pressure sensor provided on the mounting base 5.

[0084] The biometric information reader 30 is provided at a position where it can read biometric information from an image of the detected hand. For example, the biometric information reader 30 is provided at a position where it can capture an image of an area including at least the fingers of the user presenting the object to be read.

[0085] The mounting table 5 is provided with an identification information reader 40 that reads an object to be read. The identification information reader 40 is provided at a position where it can read identification information from the object to be read when the user is presenting the object to be read.

[0086] For example, as shown in FIG. 6 , the identification information reader 40 has a reading surface for reading an object to be read that is provided on the upper surface of the mounting table 5. The reading surface is provided approximately horizontally with the mounting table 5. When a user places an object to be read on the reading surface, the identification information reader 40 reads the identification information from the object to be read. In addition, in this state, the biometric information reader 30 reads biometric information from the user's hand. Note that in the example shown in FIG. 6 , since the biometric information reader 30 is provided above the mounting table 5, the user presents the object to be read with the palm of the hand on which the object is presented facing up.

[0087] The flow of biometric authentication will be explained using a specific example. For example, assume that the object to be read is a passport. The passport contains information such as the passport number, name, nationality, and date of birth on a predetermined page. Alternatively, the passport may contain an IC chip containing this information. The identification information is, for example, the passport number.

[0088] The user presents the passport on the reading surface of the identification information reading device 40 and turns the palm of the hand holding the passport upward. For example, the user holds the passport against the stand 5 with the back of their hand, opens the hand holding the passport, and turns the palm upward. The detection sensor 20 captures an image of the user's hand presenting the passport and outputs the captured image to the detection unit 11. The detection unit 11 detects the user's hand from the captured image.

[0089] The reading control unit 12 controls the biometric information reading device 30 and the identification information reading device 40. The reading control unit 12 controls the biometric information reading device 30 and the identification information reading device 40 so as to read biometric information from an image of the detected hand and to read a passport number from a passport presented by the hand.

[0090] The biometric information reader 30 reads, for example, a fingerprint image as biometric information. The identification information reader 40 reads a passport number from a passport. The identification information reader 40 may read the passport number from text information on a specific page, or may read the passport number from a built-in IC chip.

[0091] The authentication control unit 13 uses the read fingerprint image and passport number to request authentication from the authentication device 50. The authentication control unit 13 receives the authentication result from the authentication device 50 and outputs the authentication result according to the authentication result.

[0092] In this way, while the user is presenting an object to be read, the biometric information reader 30 can read biometric information from the hand presenting the object to be read, and the identification information reader 40 can read identification information from the object to be read. Furthermore, since the user places their hand on an object to be read that they own, biometric authentication can be performed without touching the information processing device 10 or the mounting table 5.

[0093] The positions of the detection sensor 20 and the biometric information reader 30 are not limited to those shown in Fig. 6. For example, the biometric information reader 30 may be provided below the table 5, as will be described below.

[0094] 7 is a second diagram showing an example of how the information processing device 10 is used. In the example shown in FIG. 7, unlike FIG. 6, the biometric information reader 30 is provided below the table 5. The user performs fingerprint authentication with the palm of the hand on which the object to be read is presented facing downwards. This allows the user to more easily present the object to be read on the table 5.

[0095] (Processing of Information Processing Device 10) Next, processing performed by the information processing device 10 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing processing performed by the information processing device 10.

[0096] First, the guide unit 18 notifies the user to present the reading object in a predetermined state (S11). The predetermined state is a state in which biometric information can be read from the user's hand and identification information can be read from the reading object. The guide unit 18 generates guidance information for guiding the hand and the reading object to the predetermined state and outputs the guidance information to the output unit 14.

[0097] For example, the guide unit 18 presents the object to be read on the reading surface of the identification information reader 40 provided on the stand, and generates a voice message to notify the user to place their hand on the object to be read. The voice message may be, for example, "Place your passport on the reading surface of the stand, and place your hand on the passport." The guide unit 18 causes the output unit 14 to output the generated guidance information.

[0098] The guide unit 18 may generate display information for displaying the message as an image and output the display information to the output unit 14. The guide unit 18 may also generate a guidance image to be projected onto the table to guide the hand and the object to be read. The guide unit 18 may store the guidance image in the storage unit 15.

[0099] Next, the detection unit 11 determines whether or not the user's hand presenting the object to be read is detected using the detection sensor 20 (S12). The detection sensor 20 is, for example, a camera, a distance measurement sensor, or a pressure sensor. The detection sensor 20 outputs a captured image, distance measurement data, pressure data, or the like to the detection unit 11. The detection unit 11 detects the user's hand presenting the object to be read based on the captured image, etc.

[0100] If the detection unit 11 does not detect that the user has placed their hand on the object to be read (NO in S12), the detection unit 11 returns to the process of step S11. If the detection unit 11 detects that the user has placed their hand on the object to be read (YES in S12), the reading control unit 12 reads the user's biometric information from an image of the detected hand (S13). Specifically, the reading control unit 12 controls the biometric information reading device 30 to read the user's biometric information. Here, the reading control unit 12 reads the fingerprint image of the hand presenting the object to be read as biometric information.

[0101] Next, the reading control unit 12 determines whether the quality of the read biometric information is equal to or greater than a predetermined value (S14). For example, the reading control unit 12 calculates a quality value of the biometric information using a known index or the like. The reading control unit 12 determines whether the calculated quality value is equal to or greater than a predetermined value. For example, the reading control unit 12 determines whether the quality value is equal to or greater than a predetermined value by comparing the quality value with a preset threshold value.

[0102] If it is determined that the quality value is less than the threshold value (NO in S14), the reading control unit 12 returns to the process of step S13. If it is determined that the quality value is equal to or greater than the threshold value (YES in S14), the reading control unit 12 reads the user's identification information from the reading object presented by the detected hand (S15).

[0103] Specifically, the reading control unit 12 controls the identification information reader 40 to read the identification information from the object to be read. Here, the reading control unit 12 reads the passport number stored in the IC chip in the object to be read. In this way, the reading control unit 12 can read biometric information from an image of the detected hand and can also read identification information from the object to be read presented by the hand.

[0104] Next, the authentication control unit 13 controls biometric authentication (S16). The authentication control unit 13 transmits an authentication request including the read biometric information and identification information to the authentication device 50. For example, the authentication control unit 13 transmits an authentication request including the read fingerprint image and the read passport number to the authentication device 50. The authentication device 50 performs fingerprint authentication of the user in response to the authentication request and transmits the authentication result to the information processing device 10. The information processing device 10 receives the authentication result from the authentication device 50.

[0105] The authentication control unit 13 may cause the output unit 14 to display the authentication result. Furthermore, the authentication control unit 13 may control other devices or the like in response to successful authentication. For example, if the authentication system 1 is used for immigration control at an airport, the authentication control unit 13 controls the unlocking of a predetermined gate device in response to successful authentication. This allows the user to pass through immigration.

[0106] In the above description, the information processing device 10 first reads biometric information and then reads the object to be read, but this is not limiting. The information processing device 10 may read the biometric information and the object to be read at the same time.

[0107] As described above, in the authentication system 1 according to the present embodiment, the information processing device 10 detects a hand presenting a read object containing the user's identification information. The information processing device 10 also reads biometric information from an image of the detected hand, and reads the identification information from the read object presented by the hand. With this configuration, the authentication system 1 can perform biometric authentication of a user while reducing the possibility of contact between the user and a member.

[0108] In addition, the information processing device 10 determines whether the quality of the biometric information is above a predetermined level, and if it determines that the quality is above a predetermined level, it can read the identification information, thereby enabling efficient biometric authentication.

[0109] Furthermore, the information processing device 10 is equipped with a guide unit 18 that guides the hand and the object to be read so that biometric information can be read from the hand and identification information can be read from the object to be read, and therefore can notify the user of the appropriate positions of the hand and the object to be read.

[0110] <Modification of Second Embodiment> In the second embodiment described above, a passport number is used as an example of identification information, but this is not limited to this. If biometric information is stored in an IC chip or the like built into the object to be read, the identification information may be the stored biometric information. If biometric information is written on the object to be read, the authentication control unit 13 can authenticate the biometric information by comparing the biometric information stored on the object to be read with the biometric information read by the biometric information reader 30.

[0111] The configuration and processing flow of the information processing device 10 are the same as those in FIGS. 5 and 8, respectively, and therefore will not be illustrated.

[0112] Here, for example, the biometric information stored in the IC chip in the object to be read is referred to as “registered biometric information.” The registered biometric information is data related to the feature points of the biometric information extracted from the registered image, similar to the feature data stored in the authentication storage unit 51 of the authentication device 50 described above.

[0113] The authentication control unit 13 compares feature data extracted from the image related to the biometric information read by the biometric information reader 30 with the registered biometric information stored in the IC chip. If the feature data matches the registered biometric information, the authentication control unit 13 determines that authentication is successful. On the other hand, if the user's biometric information does not match the registered biometric information, the authentication control unit 13 determines that authentication is unsuccessful.

[0114] The authentication control unit 13 may determine whether biometric information is stored in the object to be read, and may determine whether to perform the processing of the second embodiment described above or the processing of this modified example according to the determination result. In this case, if biometric information is stored in the object to be read, the authentication control unit 13 performs the processing of this modified example. The processing of this modified example may be performed by the information processing device 10, or may be performed by the authentication device 50 as in the second embodiment described above.

[0115] <Embodiment 3> First, embodiment 3 will be described. Embodiment 3 differs from embodiment 2 in the aspect of the guide portion 18. Since the configuration other than the guide portion 18 is the same as embodiment 2, a description of the overlapping content will be omitted.

[0116] The guide portion G1 according to this embodiment will be described with reference to Fig. 9. Fig. 9 is a diagram illustrating the configuration of the guide portion G1. The guide portion G1 is an example of the guide portion 18 described above. As shown in the figure, the guide portion G1 is provided on the mounting base 5. The guide portion G1 is configured using a finger guide member G1a shaped to correspond to the shape of a finger.

[0117] The finger guide member G1a guides the hand and the object to be read so that the biometric information reader 30 can read biometric information from the hand and the identification information reader 40 can read identification information from the object to be read.

[0118] The finger guide member G1a has an insertion opening for inserting an object to be read. The insertion opening is provided so that the object to be read is inserted from the bottom (negative y-axis direction) to the top (positive y-axis direction) in FIG. 9 .

[0119] The finger guide member G1a may be made of, for example, acrylic, glass, polycarbonate, or the like. The finger guide member G1a may be, for example, a plate-shaped member. By making the finger guide member G1a using a transparent material, the user can visually recognize the inserted object to be read. The finger guide member G1a does not have to be made of a transparent material, and may be made of a material other than the above-mentioned materials.

[0120] The finger guide member G1a can be made by molding these materials into a shape that corresponds to the shape of a user's finger. For example, the finger guide member G1a can be made by cutting out the material into the corresponding shape.

[0121] As shown in FIG. 9, the finger guide member G1a may be shaped to accommodate the shape of, for example, four fingers. However, the finger guide member G1a may also be shaped to accommodate the shape of one to three or five fingers. The finger guide member G1a may also be shaped in other shapes that allow the user to grasp the finger guide position. For example, the finger-shaped portions of the finger guide member G1a may be arc-shaped.

[0122] The finger guide member G1a is provided so that at least a portion of the area overlaps with the reading surface of the identification information reading device 40. As a result, when a user inserts an object to be read into the finger guide member G1a and positions the finger according to the finger guide member G1a, the identification information reading device 40 reads the object to be read, and the biometric information reading device 30 reads the biometric information of the finger.

[0123] 10 is a diagram showing an example in which a user presents an object to be read using the guide unit G1. Fig. 10 shows a state in which the user inserts the object to be read P into the finger guide member G1a and places his / her hand H on the object to be read P. The object to be read P is, for example, a passport.

[0124] As shown in the figure, the user inserts the object to be read P into the insertion slot and positions the hand H so that the position of the user's fingers aligns with the positions of the fingers guided by the finger guide member G1a. The posture of the hand H is not limited to the state shown in the figure. The position of the hand H can be changed as appropriate depending on the position of the biometric information reading device 30, etc.

[0125] The user may place his / her hand H on the object to be read P, or may float his / her hand H above the object to be read P. In addition, although the palm is facing downward in the figure, the palm may be facing upward. In addition, although the figure shows an example in which the hand presenting the object to be read P is the left hand, the hand may be the right hand.

[0126] The biometric information reader 30 may be preset to focus on a finger when the user places the finger on the screen, or may have an autofocus function to automatically focus on the finger.

[0127] When a user places a finger on the object to be read P, the finger touches the object to be read P. Therefore, the user can present the hand and the object to be read P without touching the finger to the finger guide member G1a or the placing table 5.

[0128] As described above, according to the information processing device 10 of this embodiment, the guide unit G1 can guide the hand and the object to be read so that biometric information can be read from the user's hand and identification information can be read from the object. Furthermore, by including the guide unit G1, the information processing device 10 can guide the hand and the object to be read so that the user can more intuitively grasp the positions of the hand and the object to be read.

[0129] <Fourth Embodiment> Next, a fourth embodiment will be described. The fourth embodiment differs from the second embodiment in the aspect of the guide portion 18. The configuration other than the guide portion 18 is the same as that of the second embodiment, and therefore, a description of the overlapping content will be omitted.

[0130] The guide unit G2 according to this embodiment will be described with reference to FIG. 11 . FIG. 11 is a diagram illustrating the configuration of the guide unit G2. The guide unit G2 is an example of the guide unit 18 described above. The guide unit G2 is configured such that the guide unit G1 described above further includes, in addition to the finger guide member G1a, a finger guide member for guiding a finger other than the finger guided by the finger guide member G1a. As shown in the figure, the guide unit G2 is provided on the mounting table 5.

[0131] The guide portion G2 has a first finger guide portion G2a that guides the first finger of the hand that presents the object to be read, and a second finger guide portion G2b that guides the second finger of the hand. For example, the first finger guide portion G2a is configured using the finger guide member G1a described above. Furthermore, the second finger guide portion G2b is configured using a recess provided in the mounting base 5 for inserting the second finger.

[0132] The recess may be provided in a position and shape such that when a user places a first finger on the first finger guide portion G2a and inserts a second finger into the second finger guide portion G2b, the wall surface forming the recess does not come into contact with the second finger. The recess may be a through-hole that penetrates the mounting base 5 in the thickness direction. The first finger and the second finger may each include multiple fingers. For example, the first finger is the four fingers other than the thumb (index finger, middle finger, ring finger, and little finger), and the second finger is the thumb.

[0133] For example, suppose the biometric information reading device 30 reads fingerprints of five fingers, including the thumb, using the guide unit G1 of the third embodiment described above. When a user places the thumb together with the palm of their hand on the mounting base 5, the outside of the thumb (the side opposite the index finger) comes into contact with the mounting base 5, but the inside (the side facing the index finger) does not. As a result, the biometric information reading device 30 acquires a fingerprint image in which one side of the thumb appears to be squashed. In this case, the fingerprint image of the thumb cannot be properly acquired, which may result in a decrease in authentication accuracy.

[0134] In contrast, the guide unit G2 includes a first finger guide unit G2a and a second finger guide unit G2b, so that the biometric information reader 30 can read the biometric information of the thumb from a different angle than that of the other four fingers. In this way, the biometric information readers 30a and 30b read the biometric information of different fingers, so that the information processing device 10 can appropriately acquire the biometric information.

[0135] Furthermore, since the second finger guide portion G2b is formed as a recess provided in the mounting base 5, the biometric information reading device 30 can read the biometric information of the second finger without the second finger coming into contact with the mounting base 5.

[0136] 12 is a diagram showing the configuration of the information processing device 10 when the information processing device 10 includes a guide unit G2 as the guide unit 18. As shown in the figure, the information processing device 10 includes two biometric information readers 30a and 30b.

[0137] The biometric information reader 30a reads the biometric information of the finger guided by the first finger guide portion G2a, and the biometric information reader 30b reads the biometric information of the finger guided by the second finger guide portion G2b. Note that, in the drawing, the biometric information reader 30 is provided below the mounting base 5, but it can be provided above the mounting base 5 as well.

[0138] 12, the biometric information readers 30a and 30b are shown parallel to the table 5, but this is not limiting. For example, the biometric information reader 30b that reads the biometric information of the thumb may be provided at an angle that allows it to read a fingerprint or the like of the thumb inserted into the second finger guide portion G2b.

[0139] In addition, in FIG. 12, two biometric information readers 30a and 30b read the biometric information of the fingers corresponding to the first finger guide portion G2a and the second finger guide portion G2b, respectively, but as will be described below, one biometric information reader 30 may read both.

[0140] 13 is a diagram showing the configuration of the information processing device 10 when the biometric information reading device 30 reads biometric information at multiple locations. For example, the information processing device 10 is provided with a drive mechanism for moving the biometric information reading device 30, thereby moving the biometric information reading device 30. The biometric information reading device 30 moves at least between a position corresponding to the first finger guide portion G2a and a position corresponding to the second finger guide portion G2b. In the figure, the biometric information reading device 30 is provided below the mounting table 5, but the same applies if it is provided above the mounting table 5.

[0141] The arrows in Fig. 13 indicate an example of the movement direction of the biometric information reading device 30. The movement direction of the biometric information reading device 30 is not limited to this. The biometric information reading device 30 may be configured to be movable in the vertical direction, the horizontal direction, or both. Furthermore, the biometric information reading device 30 may be configured to be able to change the angle of the reading surface that reads the biometric information.

[0142] By doing this, even if the information processing device 10 is equipped with one biometric information reading device 30, it is possible to read biometric information at positions corresponding to each of the first finger guide portion G2a and the second finger guide portion G2b.

[0143] As described above, according to the information processing device 10 of this embodiment, the guide unit G2 can guide the hand and the object to be read so that biometric information can be read from the user's hand and identification information can be read from the object. Furthermore, by including the guide unit G2, the information processing device 10 can guide the hand and the object to be read so that the user can more intuitively grasp the positions of the hand and the object to be read. Furthermore, by including the first finger guide unit G2a and the second finger guide unit G2b in the guide unit G2, the information processing device 10 can accurately read the biometric information of the hand presenting the object to be read.

[0144] The first and second fingers described above are merely examples, and combinations of fingers other than those described above may also be used.

[0145] <Embodiment 5> Next, embodiment 5 will be described. Embodiment 5 differs from embodiment 2 in the aspect of the guide portion 18. Since the configuration other than the guide portion 18 is the same as embodiment 2, a description of the overlapping content will be omitted.

[0146] The guide portion G3 according to this embodiment will be described with reference to Fig. 14. Fig. 14 is a diagram illustrating the configuration of the guide portion G3. The guide portion G3 is an example of the above-mentioned guide portion 18. As shown in the figure, the guide portion G3 is provided on the mounting table 5.

[0147] The guide section G3, instead of the finger guide member provided in the above-mentioned guide section G1 or G2, displays on the mounting base 5 the position of the area where biometric information can be read and the position of the area where identification information can be read.

[0148] 14, the guide portion G3 has a first area guide portion G3a and a second area guide portion G3b. The first area guide portion G3a displays the position of the area where biometric information can be read on the mounting base 5. In the example shown in FIG. 14, the area where biometric information can be read is the biometric information reading window 31.

[0149] The biometric information reading window 31 is an area provided on the mounting table 5 so that the biometric information reading device 30 can read biometric information. The biometric information reading window 31 can be made of a transparent material such as glass, acrylic, or polycarbonate. The biometric information reading window 31 may also be made of other materials. The biometric information reading window 31 is provided at a position where the biometric information reading device 30 can read biometric information.

[0150] The first area guide unit G3a displays the position of the biometric information reading window 31 on the mounting base 5. For example, the first area guide unit G3a displays the shape of a finger on the mounting base 5 so that the hand presenting the object to be read is positioned on the biometric information reading window 31 and overlaps with the biometric information reading window 31.

[0151] In this way, the first area guide section G3a can guide the user's hand, which presents the reading object, so that the hand is positioned on the biometric information reading window 31. Note that the first area guide section G3a may display a shape including not only the fingers but also the palm so that the palm is positioned on the biometric information reading window 31, for example.

[0152] The first area guide section G3a may also be displayed to indicate the position of the biometric information reading window 31. For example, if the biometric information reading window 31 is a rectangular area as shown in the figure, the first area guide section G3a may display the four sides of the rectangular area.

[0153] The second area guide section G3b displays the position of an area in which the identification information of the object to be read can be read on the mounting table 5. Specifically, the second area guide section G3b displays the position of the reading surface of the identification information reading device 40 on the mounting table 5. In FIG. 14 , the reading surface is shown as the identification information reading device 40.

[0154] For example, the second area guide portion G3b displays a rectangular area including the reading surface. When it is necessary to open a specific page of the object to be read and present it, as shown in the figure, the second area guide portion G3b may display auxiliary lines G3b2 for dividing the rectangular area. This allows the user to intuitively grasp the position where the object to be read should be presented.

[0155] 15 is a diagram showing an example in which a user presents an object to be read using the guide unit G3. The user places the object to be read P on the reading surface of the identification information reader 40 according to the second area guide unit G3b, and places his / her hand H on the object to be read P according to the first area guide unit G3a.

[0156] By placing the hand H on the reading target P, the user can place the fingers of the hand above the biometric information reading window 31 while keeping the fingers above the placing base 5. Therefore, the information processing device 10 can perform biometric authentication without the user's hand H coming into contact with the placing base 5. The biometric information reading device 30 reads the biometric information of the finger placed above the biometric information reading window 31.

[0157] As in FIG. 10 , the posture of the hand H is not limited to the illustrated state. The hand H may be changed as appropriate depending on the position of the biometric information reading device 30, etc. For example, the user may place the hand H on the reading object P, or may float the hand H above the reading object P. The user may also face the palm up, or present the right hand instead of the left. The biometric information reading device 30 may be preset so that when the user places a finger, the focus is on the finger. Alternatively, the biometric information reading device 30 may be configured to automatically focus by having an autofocus function.

[0158] The guide unit G3 can display the first area guide unit G3a and the second area guide unit G3b on the mounting base 5 using various methods. For example, the guide unit G3 generates a projection image for projecting each of the first area guide unit G3a and the second area guide unit G3b onto the mounting base 5, and outputs the projection image to the output unit 14. The output unit 14 outputs the projection image to the mounting base 5. By visually recognizing the projection image, the user can grasp the position of the biometric information reading window 31 and the position of the reading surface of the identification information reading device 40.

[0159] The projected image may also include the above-mentioned arrow symbol image. This allows the user to intuitively understand that even if their hand or the object to be read is not located within the area where it can be read, the user can move their hand and the object to the appropriate position by following the projected arrow symbol.

[0160] The guide portion G3 may be configured to display the first area guide portion G3a and the second area guide portion G3b on the mounting base 5 using printing, tape, or the like.

[0161] As described above, according to the information processing device 10 of this embodiment, the guide unit G3 can guide the hand and the object to be read so that biometric information can be read from the user's hand and identification information can be read from the object. Furthermore, by including the guide unit G3, the information processing device 10 can guide the hand and the object to be read so that the user can more intuitively grasp the positions of the hand and the object to be read.

[0162] Furthermore, by providing the guide portion G3 with a first area guide portion G3a and a second area guide portion G3b, the possibility of the user's hand coming into contact with components, etc. can be further reduced compared to when the above-mentioned finger guide member, etc. is provided.

[0163] <Sixth Embodiment> Next, a sixth embodiment will be described. The sixth embodiment differs from the second embodiment in the aspect of the guide portion 18. The configuration other than the guide portion 18 is the same as the second embodiment, and therefore, a description of the overlapping content will be omitted.

[0164] The guide portion G4 according to this embodiment will be described with reference to Fig. 16. Fig. 16 is a diagram illustrating the configuration of the guide portion G4. The guide portion G4 is an example of the above-mentioned guide portion 18. As shown in the figure, the guide portion G4 is provided on the mounting table 5.

[0165] 16, unlike the above-described embodiment, the guide portion G4 has grooves for guiding the fingers of the hand gripping the object to be read. The grooves are configured using a first groove G4a for guiding the first finger and a second groove G4b for guiding the second finger. The first finger and the second finger may each include multiple fingers. For example, the first finger is the four fingers other than the thumb (index finger, middle finger, ring finger, and little finger), and the second finger is the thumb.

[0166] The first groove G4a and the second groove G4b are provided on the mounting base 5 so as to sandwich the reading surface of the identification information reader 40. In the example shown in Fig. 16, the first groove G4a and the second groove G4b are arranged so that their longitudinal directions are parallel to the y-axis. In other words, the first groove G4a and the second groove G4b are provided so as to extend in the vertical direction as seen by the user.

[0167] However, the first groove G4a and the second groove G4b may be arranged parallel to the x-axis. That is, the first groove G4a and the second groove G4b may be provided so as to extend horizontally as viewed from the user. Furthermore, the first groove G4a and the second groove G4b may be angled with the x-axis or y-axis, respectively, to make it easier for the user to present the object to be read.

[0168] The user presents the object to be read by holding the object to be read over the reading surface of the identification information reading device 40. At this time, part of the hand presenting the object to be read enters the first groove G4a and part enters the second groove G4b. Note that there may be fingers that do not enter either the first groove G4a or the second groove G4b.

[0169] The biometric information reader 30 reads the biometric information of the hand that has entered the first groove G4a or the second groove G4b. The identification information reader 40 reads the identification information from the object to be read that is presented by the hand.

[0170] The first groove G4a and the second groove G4b may be provided in positions and shapes such that, when a user inserts a first finger into the first groove G4a and a second finger into the second groove G4b, the first finger and the second finger do not come into contact with the wall surfaces that form the respective grooves. The first groove G4a and the second groove G4b may be through-holes that penetrate the mounting table 5 in the thickness direction.

[0171] Furthermore, the first groove G4a and the second groove G4b may be arranged so that the distance d between them is smaller than the width of the object to be read. For example, if the object to be read is an information terminal such as a smartphone, the first groove G4a and the second groove G4b may be arranged so that the distance d is smaller than the average width of a smartphone. This allows the user to easily remove the object to be read after reading their hand and the object to be read. The positions and shapes of the first groove G4a and the second groove G4b are not limited to those described above and may be changed as appropriate.

[0172] 17 is a diagram showing an example in which a user uses the guide unit G4 to present a read object T. The read object T is, for example, an information terminal such as a smartphone. The read object T may also be a passport or the like.

[0173] While holding the object to be read T with the hand H, the user follows the guide portion G4 to bring the object to be read T close to the reading surface of the identification information reading device 40. For example, the user places the object to be read T that the user is holding on the reading surface of the identification information reading device 40. Alternatively, the user may bring the object to be read T close to the reading surface in a floating state and hold the object to be read T over the reading surface. While holding the object to be read T, the user inserts their first finger into the first groove portion G4a and their second finger into the second groove portion G4b.

[0174] Fig. 18 is a diagram showing the information processing device 10 as seen from the user side (the negative y-axis side) in the state shown in Fig. 17. As shown in Fig. 18, when the user places the object T to be read on the reading surface of the identification information reading device 40, the biometric information readers 30a and 30b are provided at positions where the biometric information of the user's hand H can be read.

[0175] In this state, the biometric information reader 30a reads the biometric information of the first finger inserted into the first groove G4a, and the biometric information reader 30b reads the biometric information of the second finger inserted into the second groove G4b. For example, the biometric information readers 30a and 30b read the biometric information by photographing the finger inserted into the first groove G4a or the second groove G4b from the palm side toward the finger side of the user's hand. The identification information reader 40 also reads the identification information from the object T placed on the reading surface.

[0176] Although two biometric information readers 30a and 30b are used in the description here, one biometric information reader 30 may move to perform reading at a plurality of reading positions as described with reference to Fig. 13. In this case, the biometric information reader 30 reads the biometric information of the fingers inserted into the first groove G4a and the second groove G4b, respectively.

[0177] The posture of the hand H is not limited to the state shown in the figure. The hand H may be changed as appropriate depending on the position of the biometric information reading device 30, etc. The user may hold the reading target T with their right hand instead of their left hand and present the reading target T. Furthermore, the biometric information reading devices 30a and 30b may be set in advance to focus on a finger when the user places the finger. Alternatively, the biometric information reading devices 30a and 30b may be configured to automatically focus.

[0178] As described above, according to the information processing device 10 of this embodiment, the guide unit G4 can guide the user's hand and the object to be read so that biometric information can be read from the user's hand and identification information can be read from the object. Furthermore, by including the guide unit G4, the information processing device 10 can guide the user's hand and the object to be read while the user is still holding the object. This allows the authentication system 1 to more efficiently perform biometric authentication of the user.

[0179] The above-described embodiments can be implemented in any combination. For example, the information processing device 10 may have a guide unit 18 that combines the second embodiment with any of the third to sixth embodiments. For example, the information processing device 10 may guide the user's hand and the object to be read using the guide members described in the third to sixth embodiments together with the characters, audio, or guide images described in the second embodiment.

[0180] <Example of Hardware Configuration> Each functional component of the information processing device 10 and authentication device 50 according to this disclosure may be realized by hardware that realizes each functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). Below, a case where each functional component of the information processing device 10, etc., is realized by a combination of hardware and software will be described.

[0181] 19 is a block diagram illustrating an example of the hardware configuration of a computer 900 that realizes the information processing device 10, etc. The computer 900 may be a dedicated computer designed to realize the information processing device 10, etc., or may be a general-purpose computer. The computer 900 may also be a portable computer such as a smartphone or a tablet terminal.

[0182] For example, by installing a predetermined application on the computer 900, the computer 900 realizes each function of the information processing device 10, etc. The application is configured by a program for realizing the functional components of the information processing device 10, etc.

[0183] The computer 900 has a bus 902, a processor 904, a memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path for the processor 904, the memory 906, the storage device 908, the input / output interface 910, and the network interface 912 to transmit and receive data to and from each other. However, the method of connecting the processor 904 and other components to each other is not limited to a bus connection.

[0184] The processor 904 is a processor such as a central processing unit (CPU), a graphics processing unit (GPU), or a field-programmable gate array (FPGA). The memory 906 is a main storage device realized using a random access memory (RAM) or the like. The storage device 908 is an auxiliary storage device realized using a hard disk, a solid state drive (SSD), a memory card, a read only memory (ROM), or the like.

[0185] The input / output interface 910 is an interface for connecting the computer 900 with input / output devices. For example, the input / output interface 910 is connected to an input device such as a keyboard and an output device such as a display device.

[0186] The network interface 912 is an interface for connecting the computer 900 to a network. This network may be a LAN (Local Area Network) or a WAN (Wide Area Network).

[0187] The storage device 908 stores programs (programs that realize the above-mentioned applications) that realize the various functional components of the information processing device 10, etc. The processor 904 reads these programs into the memory 906 and executes them to realize the various functional components of the information processing device 10, etc.

[0188] Each processor executes one or more programs containing instructions for causing a computer to perform the algorithms described with reference to the figures. The programs contain instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The programs may be stored on various types of non-transitory computer-readable or tangible storage media. By way of example and not limitation, non-transitory computer-readable or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc, or other optical disk storage. Also by way of example and not limitation, non-transitory computer-readable or tangible storage media include magnetic cassettes, magnetic tapes, magnetic disk storage, or other magnetic storage devices. The programs may also be transmitted over various types of transitory computer-readable or communication media. By way of example, and not limitation, transitory computer-readable or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0189] It should be noted that this disclosure is not limited to the above-described embodiments, and can be modified as appropriate within the scope of the invention.

[0190] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Supplementary Note 1) An information processing device comprising: a detection unit that detects a hand presenting a read object including a user's identification information; and a reading unit that reads biometric information from an image captured of the detected hand and reads the identification information from the read object presented by the hand. (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the reading unit determines whether the quality of the biometric information is equal to or higher than a predetermined level, and reads the identification information if it determines that the quality is equal to or higher than the predetermined level. (Supplementary Note 3) The information processing device according to Supplementary Note 1 or 2, wherein the detection unit detects the hand from an image captured of the hand presenting the read object on a predetermined platform. (Supplementary Note 4) The information processing device according to any one of Supplements 1 to 3, wherein the detection unit detects the hand presenting the read object on a predetermined platform based on distance measurement data acquired from a distance measurement sensor. (Supplementary Note 5) The information processing device according to any one of Supplements 1 to 4, wherein the detection unit detects the hand presenting the object to be read based on pressure data acquired from a pressure sensor provided on a predetermined placing platform. (Supplementary Note 6) The information processing device according to any one of Supplements 1 to 5, further comprising a guide unit that guides the hand and the object to be read to a state where the biometric information can be read from the hand and the identification information can be read from the object to be read. (Supplementary Note 7) The information processing device according to Supplementary Note 6, wherein the guide unit generates guidance information for guiding the hand and the object to be read, and outputs the guidance information using characters, images, sound, or vibration. (Supplementary Note 8) The information processing device according to Supplementary Note 6 or 7, wherein the guide unit is configured using finger guide members shaped to correspond to the shapes of fingers, and guides the fingers of the hand presenting the object to be read on a predetermined placing platform. (Supplementary Note 9) The information processing device described in Supplementary Note 8, wherein the guide section has a first finger guide section that guides a first finger of the hand, and a second finger guide section that guides a second finger of the hand, the first finger guide section being configured using the finger guide member, and the second finger guide section being configured using a recess provided in the base into which the second finger is inserted.(Supplementary Note 10) The information processing device according to any one of Supplementary Notes 6 to 9, wherein the guide unit displays, on a predetermined mounting base, the position of an area where the biometric information can be read and the position of an area where the identification information can be read. (Supplementary Note 11) The information processing device according to any one of Supplementary Notes 6 to 10, wherein the guide unit has a groove that guides the fingers of the hand that grips the object to be read. (Supplementary Note 12) The information processing device according to any one of Supplementary Notes 1 to 11, further comprising an authentication control unit that controls biometric authentication of the user using the biometric information and the identification information. (Supplementary Note 13) An authentication system comprising: an information processing device; and an authentication device, wherein the information processing device has: a detection unit that detects a hand presenting a read object including a user's identification information; and a reading unit that reads biometric information from an image of the detected hand and reads the identification information from the read object presented by the hand, wherein the authentication device acquires the biometric information and the identification information from the information processing device and performs biometric authentication of the user based on the biometric information and the identification information. (Supplementary Note 14) The authentication system according to Supplementary Note 13, wherein the reading unit determines whether the quality of the biometric information is equal to or higher than a predetermined level, and reads the identification information if it determines that the quality is equal to or higher than the predetermined level. (Supplementary Note 15) An information processing method, wherein a computer executes: a detection step of detecting a hand presenting a read object including a user's identification information; and a reading step of reading biometric information from an image of the detected hand and reading the identification information from the read object presented by the hand. (Supplementary Note 16) The information processing method according to Supplementary Note 15, wherein in the reading step, it is determined whether or not quality of the biometric information is equal to or higher than a predetermined level, and if it is determined that the quality is equal to or higher than the predetermined level, the identification information is read. (Supplementary Note 17) A program that causes a computer to execute the following steps: a detecting step of detecting a hand presenting a read object including a user's identification information; and a reading step of reading biometric information from an image of the detected hand and reading the identification information from the read object presented by the hand.(Supplementary Note 18) The program according to Supplementary Note 17, wherein in the reading step, it is determined whether or not quality of the biometric information is equal to or higher than a predetermined level, and when it is determined that the quality is equal to or higher than the predetermined level, the identification information is read.

[0191] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

[0192] This application claims priority based on Japanese Patent Application No. 2022-088392, filed on May 31, 2022, the disclosure of which is incorporated herein in its entirety.

[0193] REFERENCE SIGNS LIST 1 Authentication system 5 Placement base 10 Information processing device 11 Detection unit 12 Reading control unit 13 Authentication control unit 14 Output unit 15 Storage unit 18 Guide unit 20 Detection sensor 30, 30a, 30b Biometric information reading device 31 Biometric information reading window 40 Identification information reading device 50 Authentication device 51 Authentication storage unit 52 Feature image extraction unit 53 Feature point extraction unit 54 Registration unit 55 Authentication unit 100 Information processing device 101 Detection unit 102 Reading unit 900 Computer 902 Bus 904 Processor 906 Memory 908 Storage device 910 Input / output interface 912 Network interface d Distance G1 to G4 Guide unit G1a Finger guide member G2a First finger guide unit G2b Second finger guide unit G3a First area guide portion G3b Second area guide portion G3b2 Auxiliary line G4a First groove portion G4b Second groove portion H Hand N Network P, T Object to be read

Claims

1. A detection means for detecting a hand presenting a read object including a user's identification information; a reading means for reading biometric information from an image of the detected hand and reading the identification information from the reading object presented by the hand. Information processing device.

2. The reading means judges whether or not the quality of the biometric information is equal to or higher than a predetermined level, and when it judges that the quality is equal to or higher than the predetermined level, reads the identification information. The information processing device according to claim 1 .

3. The detection means detects the hand from an image captured of the hand presenting the object to be read on a predetermined placement stand.

3. The information processing device according to claim 1 or 2.

4. The detection means detects the hand presenting the object to be read on a predetermined placement stand based on distance measurement data acquired from a distance measurement sensor.

3. The information processing device according to claim 1 or 2.

5. The detection means detects the hand presenting the object to be read based on pressure data acquired from a pressure sensor provided on a predetermined placement stand.

3. The information processing device according to claim 1 or 2.

6. The reading device further includes a guide means for guiding the hand and the object to be read so that the biometric information can be read from the hand and the identification information can be read from the object to be read.

3. The information processing device according to claim 1 or 2.

7. The guide means is a first finger guide means for guiding a first finger of the hand; and a second finger guide means for guiding a second finger of the hand, The first finger guide means is configured using a finger guide member having a shape corresponding to the shape of a finger, The second finger guide means is configured using a recess provided on a predetermined placement table into which the second finger is inserted. The information processing device according to claim 6.

8. An information processing device; An authentication device, The information processing device includes: A detection means for detecting a hand presenting a read object including a user's identification information; a reading means for reading biometric information from an image of the detected hand and reading the identification information from the reading object presented by the hand, The authentication device includes: The biometric information and the identification information are acquired from the information processing device, and biometric authentication of the user is performed based on the biometric information and the identification information. Authentication system.

9. The computer Detecting a hand presenting a read object including a user's identification information; Biometric information is read from an image of the detected hand, and the identification information is read from the object to be read that is presented by the hand. Information processing methods.

10. Detecting a hand presenting a read object including a user's identification information; reading biometric information from an image of the detected hand and reading the identification information from the object to be read that is presented by the hand. program.