Identity verification method, identity verification system, identity verification terminal, matching server and program

Abstract

To provide an identity verification method for detecting replacement of an identity verification document when a front side and a back side of the identity verification document are read.SOLUTION: An identity verification method of a target person on the basis of an identity verification document, includes: acquiring first face image data on the basis of document-surface information of a first side of the identity verification document; collating the first face image data with a face capture image generated by capturing a face of the target person; when the collation is successful, storing the face capture image or the first face image data; acquiring second face image data on the basis of document-surface information of a second side of the identity verification document; and collating the second face image data with the stored face capture image or first face image data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a personal identification method, a personal identification system, a personal identification terminal, a collation server, and a program.

Background Art

[0002] Patent Document 1 discloses an information display system in which a terminal and a server are connected. In the information display system of Patent Document 1, the terminal transmits to the server first information read from the user's card and a captured face image of the user. The server executes a face authentication process of the user based on the face image included in the first information transmitted from the terminal and the captured face image of the user. Further, when the user's face authentication is successful, the server acquires the user's second information and transmits the acquired second information to the terminal. Then, the terminal displays the second information transmitted from the server.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, the information read from the personal identification document may be associated with other information. At this time, in order to avoid associating information of a person different from the person who owns the personal identification document, it is necessary to confirm whether the information read from the personal identification document belongs to the person who owns the personal identification document.

[0005] For example, in various procedures at financial institutions, the need to link an account number with a personal number read from a My Number card has been increasing. However, the linking has been done by manually entering the account number and the personal number into a terminal, which has the possibility of human errors such as linking with someone else's personal number and input mistakes.

[0006] Therefore, for example, when it is required to read the front and back of a My Number card by means other than human hands for identity verification of the cardholder and acquisition of information (such as a personal number), it is necessary to prevent substitution of the identity verification document (such as a My Number card) when the front and back of the identity verification document are read, and to prevent information of a person different from the person who owns the identity verification document from being used, for example, for information linking.

[0007] The present disclosure has been devised in view of the above-described conventional situation, and aims to detect substitution of an identity verification document when the front and back of the identity verification document are read.

Means for Solving the Problem

[0008] The present disclosure provides a method for verifying the identity of a target person based on an identity verification document, the method including: obtaining first face image data based on the face value information on the first side of the identity verification document; comparing the first face image data with a face captured image generated by photographing the face of the target person, and if the comparison is successful, saving the face captured image or the first face image data; obtaining second face image data based on the face value information on the second side of the identity verification document; and comparing the second face image data with the saved face captured image or the first face image data.

[0009] In addition, the present disclosure provides an identity verification terminal for verifying the identity of a target person based on identity verification documents, the identity verification terminal including a face capture camera configured to capture an image of the face of the target person to generate a face capture image, a document capture camera configured to capture an image of the face side of the identity verification documents to generate a document capture image, a processor, and a memory. The processor is configured to obtain first face image data based on the face side information obtained from the document capture image of the first side of the identity verification documents, compare the first face image data with the face capture image, and if the comparison is successful, store the face capture image or the first face image data in the memory. The processor is further configured to obtain second face image data based on the face side information obtained from the document capture image of the second side of the identity verification documents, and compare the second face image data with the face capture image or the first face image data stored in the memory.

[0010] In addition, the present disclosure provides a verification server for verifying the face of a person, the verification server including a processor and a memory. The processor is configured to receive first face image data obtained based on the face side information of the first side of the identity verification documents and a face capture image generated by capturing the face of the target person, compare the first face image data with the face capture image, and if the comparison is successful, store the face capture image or the first face image data in the memory. The processor is further configured to receive second face image data obtained based on the face side information of the second side of the identity verification documents, and compare the second face image data with the face capture image or the first face image data stored in the memory.

[0011] In addition, the present disclosure provides an identity verification system including an identity verification terminal that verifies the identity of a target person based on identity verification documents, and a business terminal communicably connected to the identity verification terminal. The identity verification terminal includes a face capture camera that captures the face of the target person to generate a face capture image, and a document capture camera that captures the face of the identity verification document to generate a document capture image. The identity verification terminal obtains first face image data based on the document surface information obtained from the document capture image of the first side of the identity verification document in response to an instruction from the business terminal, collates the first face image data with the face capture image, and if the collation is successful, stores the face capture image or the first face image data in the memory. The identity verification terminal obtains second face image data based on the document surface information obtained from the document capture image of the second side of the identity verification document, and collates the second face image data with the face capture image or the first face image data stored in the memory.

[0012] In addition, the present disclosure provides an identity verification system including a user terminal and a collation server communicably connected to the user terminal. The user terminal includes a camera that captures the face of the target person to generate a face capture image and captures the face of the identity verification document to generate a document capture image. The user terminal obtains first face image data based on the document surface information obtained from the document capture image of the first side of the identity verification document, and transmits the face capture image of the target person and the first face image data to the collation server. The collation server collates the first face image data with the face capture image, and if the collation is successful, transmits the collation result to the user terminal, and stores the face capture image or the first face image data. The user terminal transmits second face image data obtained based on the document surface information obtained from the document capture image of the second side of the identity verification document to the collation server in response to obtaining the collation result from the collation server. The collation server collates the second face image data with the stored face capture image or the first face image data.

[0013] In addition, the present disclosure provides a program for causing an identity verification terminal that verifies the identity of a target person based on identity verification documents to obtain first face image data based on the face value information on the first side of the identity verification documents, collate the first face image data with a face capture image generated by photographing the face of the target person, and when the collation is successful, save the face capture image or the first face image data, obtain second face image data based on the face value information on the second side of the identity verification documents, and collate the second face image data with the saved face capture image or the first face image data.

[0014] In addition, the present disclosure provides an identity verification method that obtains a first number based on the face value information of the first side obtained by photographing the first side of the identity verification documents with a camera, obtains face image data and personal information of a target person who owns the identity verification documents based on the first number, collates the face image data with a face capture image generated by photographing the face of the target person, and when the collation is successful, saves the first number, obtains personal information of the target person who owns the identity verification documents using the saved first number in a state where the camera can photograph the second side of the identity verification documents, and collates the personal information of the target person obtained by the camera photographing the first side of the identity verification documents with the personal information of the target person obtained in a state where the camera can photograph the second side of the identity verification documents.

[0015] In addition, the present disclosure provides an identity verification method that obtains a second number based on the face value information of the second side obtained by photographing the second side of the identity verification documents with a camera, obtains face image data and the personal number of a target person who owns the identity verification documents based on the second number, collates the face image data with a face capture image generated by photographing the face of the target person, and when the collation is successful, saves the second number, obtains the personal number of the target person who owns the identity verification documents using the saved second number in a state where the camera can photograph the first side of the identity verification documents, and collates the personal number of the target person obtained by the camera photographing the second side of the identity verification documents with the personal number of the target person obtained in a state where the camera can photograph the first side of the identity verification documents.

[0016] In addition, any combination of the above components, as well as those obtained by converting the expressions of the present disclosure among methods, apparatuses, systems, storage media, computer programs, etc., are also effective as aspects of the present disclosure.

Advantages of the Invention

[0017] According to the present disclosure, when the front and back surfaces of the identity verification document are read, it is possible to detect the replacement of the identity verification document.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0019] Hereinafter, various embodiments specifically disclosing the personal identification method, personal identification system, personal identification terminal, collation server, and program according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, a more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and duplicate descriptions of substantially the same configurations may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and it is not intended to limit the subject matter described in the claims thereby.

[0020] (Embodiment 1) [System Configuration] FIG. 1 is a block diagram showing a configuration example of the personal identification system 1 according to Embodiment 1.

[0021] The personal identification system 1 according to Embodiment 1 is premised on being introduced into a bank. The personal identification system 1 is a system that uses the personal identification terminal 10 and the My Number card 60 (see FIG. 3) to identify the identity of a customer who newly opens an account and to associate various information of the customer with the newly opened account. Hereinafter, the customer may sometimes be referred to as a user.

[0022] Note that the My Number card 60 is an example of an identity document, and the present embodiment is not limited to the My Number card 60. For example, a smartphone equipped with an application corresponding to the My Number card 60 is also an example of an identity document, and the content of the present embodiment is also applicable to such a smartphone.

[0023] The identity verification system 1 includes an identity verification terminal 10, a business terminal 20, a bank server 30, a signature verification server 40, a public certification server 50, and a customer operation terminal 70. The identity verification terminal 10 and the business terminal 20 are connected via an electrical cable such as a Local Area Network (hereinafter referred to as "LAN") cable and / or a Universal Serial Bus (hereinafter referred to as "USB") cable, for example, and can transmit and receive information to and from each other. Alternatively, the identity verification terminal 10 and the business terminal 20 may be connected via wireless communication such as a wireless LAN or Bluetooth (registered trademark). The same applies to the connections between the identity verification terminal 10 and the customer operation terminal 70, the business terminal 20 and the bank server 30, the business terminal 20 and the signature verification server 40, and the signature verification server 40 and the public certification server 50.

[0024] The identity verification terminal 10 performs the identity verification process of the user 2 using the My Number card 60. In the identity verification system 1 introduced in the bank, the identity verification terminal 10 is used, for example, when the user 2 newly opens a bank account.

[0025] The identity verification terminal 10 includes a processor 11, a memory 12, a mounting portion 13, an Integrated Circuit (hereinafter referred to as "IC") card reader 14, a document photographing camera 15, a face photographing camera 16, a display device 17, an operation device 18, and a communication device 19.

[0026] The processor 11 realizes the functions of the personal identification terminal 10 by executing a computer program stored in the memory 12. Note that the processor 11 may be read as other terms such as a controller, a Central Processing Unit (hereinafter referred to as "CPU"), or a control unit.

[0027] The memory 12 is a storage area for storing and holding a computer program that realizes the functions of the personal identification terminal 10 and various types of data, etc. The memory 12 is composed of, for example, a non-volatile storage area, Read Only Memory (hereinafter referred to as "ROM"), a Hard Disk Drive (hereinafter referred to as "HDD"), and a volatile storage area, Random Access Memory (hereinafter referred to as "RAM"), etc. In this specification, the expressions "store" and "save" are used as being synonymous with each other. However, in this specification, the expression "save" may be used to emphasize that when data or information, etc. is saved (i.e., stored), the data or information, etc. is read out in later processing.

[0028] The mounting portion 13 is the part where the My Number card 60 is mounted.

[0029] The IC card reader 14 reads the data stored in the IC chip 61 of the My Number card 60 mounted on the mounting portion 13 in a non-contact manner. For example, the IC card reader 14 reads the data stored in the IC chip 61 by the Near Field Communication (hereinafter referred to as "NFC") method.

[0030] The document photographing camera 15 photographs the face of the My Number card 60 mounted on the mounting portion 13 and generates a "document photographed image".

[0031] The face photographing camera 16 photographs the face of the user 2 and generates a "face photographed image".

[0032] The display device 17 displays information related to the authentication process by the personal authentication terminal 10. Examples of the display device 17 include a liquid crystal display, an organic Electro Luminescence (hereinafter referred to as "EL") display, and the like.

[0033] The operation device 18 receives operations from the user 2. Note that the display device 17 and the operation device 18 may be an integrated device such as a touch panel display.

[0034] The communication device 19 controls the transmission and reception of various data with the business terminal 20 and the customer operation terminal 70.

[0035] The business terminal 20 sends an instruction to the personal authentication terminal 10 to perform the authentication of the user 2. The business terminal 20 is operated, for example, by a bank clerk and executes the association between a newly opened account and the personal information of the user 2.

[0036] The business terminal 20 includes a processor 21, a memory 22, a display device 23, an operation device 24, and a communication device 25. Examples of the business terminal 20 include a personal computer and the like.

[0037] The processor 21 realizes the functions of the business terminal 20 by executing a program in cooperation with the memory 22. Note that the processor 21 may be read as other terms such as a controller, a CPU, and a control unit.

[0038] The memory 22 is a storage area for storing and holding a computer program and various data for realizing the functions of the business terminal 20. The memory 22 is composed of, for example, a non-volatile storage area such as a ROM and an HDD, and a volatile storage area such as a RAM.

[0039] The display device 23 displays information related to the account opening process and the authentication process. Examples of the display device 23 include a liquid crystal display, an organic EL display, and the like.

[0040] The operation device 24 receives operations from, for example, bank clerks. Note that the display device 23 and the operation device 24 may be an integrated device such as a touch panel display.

[0041] The communication device 25 controls the transmission and reception of various data with the personal identification terminal 10, the bank server 30, and the signature verification server 40.

[0042] The bank server 30 stores and manages the information of the created account. Examples of the bank server 30 include server computers and the like.

[0043] The bank server 30 includes a processor 31, a memory 32, and a communication device 33.

[0044] The processor 31 realizes the functions of the bank server 30 by executing a program in cooperation with the memory 32. Note that the processor 31 may be read as other terms such as a controller, a CPU, or a control unit.

[0045] The memory 32 is a storage area for storing and holding a computer program and various data for realizing the functions of the bank server 30. The memory 32 is composed of, for example, a non-volatile storage area such as a ROM or an HDD, and a volatile storage area such as a RAM.

[0046] The communication device 33 controls the transmission and reception of various data with the business terminal 20.

[0047] The signature verification server 40 and the public certification server 50 acquire the signature electronic certificate of the My Number card 60 and determine the validity of the My Number card 60. Note that in this embodiment, the signature verification server 40 and the public certification server 50 may be omitted.

[0048] The customer operation terminal 70 is a terminal for User 2 to communicate with bank staff or the like. Examples of the customer operation terminal 70 include a personal computer or the like. Note that in the present embodiment, the customer operation terminal 70 may be omitted.

[0049] [My Number Card] FIG. 2 is a table diagram showing the main information of the My Number Card 60. FIG. 3 is a schematic diagram showing an example of the front and back sides of the My Number Card 60. Hereinafter, the front and back sides of the My Number Card 60 may be referred to as the first side and the second side, respectively.

[0050] On the front surface of the My Number Card 60, as shown in FIG. 3, at least the name, address, date of birth, gender, security code, and expiration date are printed as character information 63 (see FIG. 3). The information including the name, address, date of birth, and gender is also called the four-information. In the present embodiment, the four-information and the personal number described later may be referred to as personal information. Further, hereinafter, the information including the four-information may be referred to as the first personal information. Also, the information including the personal number may be referred to as the second personal information. Further, a face photo 62 is printed on the front surface of the My Number Card 60.

[0051] The My Number Card 60 is non-contact readable and has a secure IC chip 61. The personal information of the owner of the My Number Card 60 is stored in the IC chip 61.

[0052] At least the name, address, date of birth, gender, face image data, and personal number are stored in the IC chip 61 of the My Number Card 60. The face image data is image data generated by photographing the face of the owner of the My Number Card 60.

[0053] The My Number Card 60 has, as information used for access control to the IC chip 61, at least a collation number A, a collation number B, an electronic certificate PIN for signature, a PIN for user certificate, a PIN for assisting in inputting face value details, and a PIN for the basic resident register. "PIN" is an abbreviation for Personal Identification Number. Hereinafter, the collation number B may be referred to as the first number. Also, the collation number A may be referred to as the second number.

[0054] The collation number A is obtained when the two-dimensional barcode 64 printed on the back of the My Number Card 60 is read. By using the collation number A, access can be made to the personal number and face image data stored in the IC chip 61 of the My Number Card 60. That is, by reading the two-dimensional barcode 64 printed on the back of the My Number Card 60, access can be made to the personal number and face image data stored in the IC chip 61 of the My Number Card 60.

[0055] The collation number B is a number obtained by combining 6 digits of the date of birth, 4 digits of the Western calendar part of the expiration date, and 4 digits of the security code, which are printed on the front of the My Number Card 60. By using the collation number B, access can be made to the four pieces of information and face image data stored in the IC chip 61 of the My Number Card 60. That is, by obtaining the collation number B printed on the front of the My Number Card 60, access can be made to the four pieces of information and face image data stored in the IC chip 61 of the My Number Card 60.

[0056] Note that the above-mentioned My Number Card 60 is just an example. When the specifications of the My Number Card 60 are changed, various information possessed by the My Number Card 60 is read based on the changed specifications. For example, the gender may not be described on the face of the My Number Card 60. In this case, by using the collation number B, three pieces of information excluding the gender and the face image data may be obtained from the IC chip 61. Also, the collation number B may be a number with a predetermined number of digits different from the 14-digit number obtained by combining the above-mentioned 6 digits of the date of birth, 4 digits of the AD part of the expiration date, and 4 digits of the security code. In this case, the number with the predetermined number of digits read based on the specifications of the My Number Card 60 may be used as the collation number B.

[0057] Hereinafter, the information printed on the face of the My Number Card 60 may be referred to as face information.

[0058] [Application of My Number Card] Figure 4 is a table diagram for explaining the outline of the application of the My Number Card 60. Hereinafter, the application may be referred to as AP.

[0059] As shown in Figure 4, four applications shown in the following (B1) to (B4) are registered in the IC chip 61 of the My Number Card 60.

[0060] (B1) Face Application (Face AP) In the Face AP, image data of surface information (four pieces of information (address, name, date of birth, gender) + face photo) and back surface information (personal number) are recorded.

[0061] (B2) Electronic Certificate Application by Public Personal Authentication Service (JPKI-AP) In the JPKI-AP, information on "electronic certificate for signature" and "electronic certificate for user" is recorded.

[0062] (B3) Face Matter Input Assistance Application (Face Matter Input Assistance AP) In the voucher details input assistance AP, when conducting transactions that utilize the personal number and the four pieces of information, information for using the personal number and the four pieces of information as text data is recorded. The information to be recorded or used is as follows. (1) Personal number and the four pieces of information (as well as their electronic signature data) (2) Personal number (as well as its electronic signature data) (3) The four pieces of information (as well as their electronic data)

[0063] (B4) Resident basic application (Resident basic AP) In the resident basic AP, information for using the resident register code as text data is recorded during resident basic network-related transactions.

[0064] When using (2) or (3) in the voucher AP or the voucher details input assistance AP, it is available by the collation number based on the information described on the voucher. However, for the two electronic certificates of JPKI-AP, (1) in the voucher details input assistance AP, and when using the resident basic AP, the password set at the time of issuance of the My Number Card 60 is used. That is, by using the voucher details input assistance PIN, it is possible to access the four pieces of information and the personal number stored in the IC chip 61 of the My Number Card 60. Hereinafter, the voucher details input assistance PIN may be referred to as the PIN code or the password.

[0065] [Operation] With reference to FIG. 5, the process of newly opening the bank account of user 2 using the personal verification system 1 will be described. FIG. 5 is a conceptual diagram for opening an account using the personal verification system 1 according to Embodiment 1.

[0066] User 2 applies to the bank for opening a new account. Then, the intention of user 2 is confirmed regarding whether to link the newly opened account with the personal number of user 2. Thereafter, the personal verification process of user 2 using the My Number Card 60 is performed.

[0067] When the association between the account and the personal number is necessary, the identity verification process is performed in two stages: Phase 1 and Phase 2. The identity verification terminal 10 acquires the personal number in the Phase 2 process. Also, when the identity verification process is performed in two stages, that is, even when the front and back surfaces of the My Number card 60 are read, the replacement of the My Number card 60 can be detected, so strict identity verification is realized. The details of the process will be described later with reference to FIGS. 7 and 8.

[0068] Even when the association between the account and the personal number is not necessary, the identity verification process is performed. In this case, the identity verification process corresponds to the Phase 1 process of the identity verification process when the association between the account and the personal number is necessary.

[0069] Thereafter, the signature verification server 40 and the public certification server 50 perform the determination of the validity of the My Number card 60, in other words, the public certification process. When it is confirmed that the My Number card 60 is valid, the account is opened. Note that the public certification process may be omitted.

[0070] Thereafter, the opened account is stored and managed by the bank server 30.

[0071] In the following description, attention is paid to the case where the association between the account and the personal number is necessary.

[0072] Next, with reference to FIG. 6, an operation example of the identity verification terminal 10, the business terminal 20, and the bank server 30 related to the opening of a new account will be described. FIG. 6 is a sequence diagram showing an operation example of the identity verification system 1 according to Embodiment 1.

[0073] The business terminal 20 receives an application for opening a new account by the user 2 and a request for associating the account with the personal number (step St80). Specifically, for example, a bank clerk who has confirmed an application for opening a new account by the user 2 and an intention to associate the account with the personal number operates the business terminal 20.

[0074] When the business terminal 20 receives a request for opening a new account and associating an account with a personal number at step St80, it sends a personal information acquisition request and an identity verification request to the identity verification terminal 10 (step St81). The personal information acquisition request is a request to acquire the personal information of user 2 who newly opens an account. The identity verification request is a request to perform an identity verification process for user 2 who newly opens an account.

[0075] When the identity verification terminal 10 receives the personal information acquisition request and the identity verification request sent from the business terminal 20 at step St81, it accepts the selection of an authentication method (step St82). The details of this process will be described in steps St100 to St101 of FIG. 7.

[0076] The identity verification terminal 10 executes an identity verification process using the authentication method accepted at step St82 (step St83). The details of this process will be described in steps St102 to St113 of FIG. 7 and steps St114 to St132 of FIG. 8.

[0077] If the identity verification process at step St83 is successful, the identity verification terminal 10 sends the personal information to the business terminal 20 (step St84).

[0078] When the business terminal 20 receives the personal information of user 2 sent from the identity verification terminal 10, it creates a new account number and sends an account number creation completion notification to the identity verification terminal 10 (step St85). The account number creation completion notification notifies that the creation of the account number is completed. Although not shown in FIG. 6, if the identity verification process fails, the business terminal 20 may, for example, display a message indicating that the identity verification process has failed on the display device 23.

[0079] Also, when the public authentication process is performed, the business terminal 20 may, for example, send a request to obtain an electronic certificate for signature to the personal verification terminal 10 before the process of step St85. In this case, the personal verification terminal 10 obtains the electronic certificate for signature from the My Number card 60 and sends it to the business terminal 20. The business terminal 20 sends the electronic certificate for signature required for signature to the public authentication server 50 via the signature verification server 40. The public authentication server 50 determines the validity of the My Number card 60 and sends the determination result to the business terminal 20 via the signature verification server 40. Then, when the business terminal 20 receives the result that the My Number card 60 is valid, it proceeds to the process of step St85.

[0080] When the personal verification terminal 10 receives the account number creation completion notice sent from the business terminal 20, it deletes various pieces of personal information obtained during the personal verification process (step St86).

[0081] The business terminal 20 associates the newly created account number with the personal information of User 2 (step St87).

[0082] The business terminal 20 newly registers an account and sends the information of the account to the bank server 30 (step St88). Here, registering an account means finalizing the opening of the account.

[0083] The bank server 30 receives and stores the account information sent from the business terminal 20 (step St89).

[0084] Next, with reference to FIGS. 7 and 8, the authentication process of user 2 by the personal authentication terminal 10 will be described. FIG. 7 is a flowchart showing an operation example of the personal authentication terminal 10 according to Embodiment 1. FIG. 8 is a flowchart showing an operation example of the personal authentication terminal 10 following FIG. 7. "A" and "B" shown in the respective flowcharts of FIGS. 7 and 8 represent the connection of the respective flowcharts of FIGS. 7 and 8. Also, at the start point of the flowchart shown in FIG. 7, the personal authentication terminal 10 has received a personal information acquisition request and an authentication request transmitted from the business terminal 20. Note that the personal authentication document in the figure refers to the My Number Card 60.

[0085] The processor 11 of the personal authentication terminal 10 displays an instruction to place the My Number Card 60 for user 2 on the display device 17 (step St100). An example of the display screen will be described later with reference to FIG. 9. For convenience of explanation, it is assumed that user 2 has placed the My Number Card 60 on the placement unit 13. Also, at this time, it is assumed that the document photographing camera 15 is in a state where it can photograph the surface of the My Number Card 60.

[0086] The processor 11 accepts the selection of the authentication method by user 2 (step St101). Note that a screen for user 2 to select the authentication method may be displayed on the display device 17 (see FIG. 9).

[0087] The processor 11 determines whether the authentication method selected by user 2 is either face authentication or password input (step St102).

[0088] When the authentication method selected by user 2 is password input (step St102; password input), the process of the personal authentication terminal 10 proceeds to step St128, and the personal authentication process by password input is performed.

[0089] First, the case where the authentication method selected by user 2 is face authentication (step St102; face authentication) will be described.

[0090] The document photographing camera 15 of the personal verification terminal 10 photographs the face of the personal verification document and generates a document photographed image (step St103).

[0091] The processor 11 performs Optical Character Recognition (hereinafter referred to as "OCR") on the document photographed image, and acquires a collation number B using the character information 63 detected by OCR (step St104).

[0092] The processor 11 determines whether or not the collation number B could be acquired in the process of step St104 (step St105).

[0093] If the processor 11 could not acquire the collation number B in the process of step St104 (step St105; NO), the process proceeds to step St128, and the personal verification process by input of a password is executed. At this time, for example, a screen instructing the user 2 to input a password may be displayed on the display device 17.

[0094] If the processor 11 could acquire the collation number B (step St105; YES), the processor 11 accesses the IC chip 61 of the My Number card 60 using the collation number B as an access key (step St106).

[0095] If the processor 11 could not access the IC chip 61 (step St107; NO), the process proceeds to step St128, and the personal verification process by input of a password is executed. At this time, for example, a screen instructing the user 2 to input a password may be displayed on the display device 17.

[0096] If the processor 11 could access the IC chip 61 (step St107; YES), the processor 11 reads out and acquires 4 information and face image data from the IC chip 61 (step St108).

[0097] When the processor 11 fails to acquire the four pieces of information and the face image data (step St109; NO), the process proceeds to step St128, and the identity verification process by inputting the password is executed. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0098] When the processor 11 has acquired the four pieces of information and the face image data (step St109; YES), the face camera 16 captures the face of the user 2 and generates a face captured image (step St110).

[0099] The processor 11 collates the face captured image of the user 2 generated in step St110 with the face image data acquired in step St108 (step St111). The collation between the face captured image and the face image data may be performed, for example, by comparing face feature amounts.

[0100] When the processor 11 fails in the collation between the face captured image of the user 2 and the face image data (step St112; NO), the process proceeds to step St128, and the identity verification process by inputting the password is executed. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0101] When the processor 11 succeeds in the collation between the face captured image of the user 2 and the face image data (step St112; YES), the processor 11 causes the display device 17 to display the collation result (step St113).

[0102] The processes from step St103 to step St113, that is, the series of processes surrounded by the broken line shown in FIG. 7, correspond to Phase 1 of the identity verification process shown in FIG. 5. In Phase 1, the identity verification terminal 10 verifies the identity of the user 2 by collating the face image data acquired from the IC chip 61 of the My Number card 60 using the collation number B as an access key with the face captured image generated by photographing the face of the user 2.

[0103] Subsequently, the processes after step St114 will be described.

[0104] The processor 11 stores the face captured image of user 2 generated in step St110 (step St114). The face captured image may be stored in the memory 12, for example.

[0105] The processor 11 causes the display device 17 to display an instruction to turn over the my number card 60 (step St115). An example of the display screen will be described later with reference to FIG. 9. For convenience of explanation, it is assumed that user 2 turns over the my number card 60 and places it on the placement unit 13. At this time, the document photographing camera 15 is in a state where it can photograph the back surface of the my number card 60.

[0106] The document photographing camera 15 reads the two-dimensional barcode 64 of the my number card 60 (step St116).

[0107] The processor 11 acquires the collation number A from the two-dimensional barcode 64 read by the document photographing camera 15 in step St116 (step St117).

[0108] When the processor 11 cannot acquire the collation number A (step St117; NO), the process proceeds to step St128, and the identity verification process by input of the password is executed. At this time, for example, a screen instructing user 2 to input the password may be displayed on the display device 17.

[0109] When the processor 11 can acquire the collation number A (step St117; YES), the processor 11 accesses the IC chip 61 of the my number card 60 using the collation number A as an access key (step St118).

[0110] When the processor 11 cannot access the IC chip 61 (step St120; NO), the process proceeds to step St128, and the identity verification process by input of the password is executed. At this time, for example, a screen instructing user 2 to input the password may be displayed on the display device 17.

[0111] When the processor 11 can access the IC chip 61 (step St120; YES), it reads and obtains the personal number and the face image data from the IC chip 61 (step St121).

[0112] When the processor 11 cannot obtain the personal number and the face image data (step St122; NO), it advances the process to step St128 and executes the authentication process by inputting the password. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0113] When the processor 11 can obtain the personal number and the face image data (step St122; YES), it reads the face captured image saved in step St114 (step St123).

[0114] The processor 11 collates the face captured image of the user 2 read in step St123 with the face image data obtained in step St121 (step St124).

[0115] When the collation between the face captured image of the user and the face image data fails (step St125; NO), the processor 11 advances the process to step St128 and executes the authentication process by inputting the password. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0116] When the collation between the face captured image of the user and the face image data succeeds (step St125; YES), the processor 11 causes the display device 17 to display the collation result (step St126).

[0117] The processes from step St114 to step St126, that is, the series of processes enclosed by the dashed line shown in FIG. 8, correspond to Phase 2 of the personal identification process shown in FIG. 5. In Phase 2, the personal identification terminal 10 performs personal identification of user 2 by collating the face image data obtained from the IC chip 61 of the My Number card 60 using the collation number A as an access key with the face captured image generated by photographing the face of user 2 in Phase 1.

[0118] After step St126, the processor 11 causes the display device 17 to display that the personal identification has succeeded and been completed (step St127). Then, this processing flow ends.

[0119] Next, the personal identification process by inputting a PIN will be described.

[0120] The processor 11 causes the display device 17 to display a PIN input screen (step St128). An example of the display screen will be described later with reference to FIG. 9.

[0121] The processor 11 accepts the input of the PIN by user 2 (step St129). For the sake of convenience of explanation, it is assumed that the PIN input in step St129 is the correct PIN.

[0122] The processor 11 accesses the IC chip 61 of the My Number card 60 using the PIN input in step St129 as an access key (step St130).

[0123] The processor 11 reads and acquires four pieces of information and a personal number from the IC chip 61 (step St131). For the sake of convenience of explanation, it is assumed that the processor 11 has acquired four pieces of information and a personal number.

[0124] The processor 11 causes the display device 17 to display that the reading has succeeded (step St132). Then, the processor 11 advances the process to step St127.

[0125] As described above, when the identity verification terminal 10 matches the face image data obtained based on the verification number B with the face photographed image of the user 2 and succeeds in the matching, the face photographed image is saved. After the My Number Card 60 is turned over, the identity verification terminal 10 matches the face image data obtained based on the verification number A with the saved face photographed image, and if the matching is successful, it is determined that the identity verification of the user 2 has succeeded. If the My Number Card 60 is replaced with another My Number Card at the timing when the My Number Card 60 is turned over, the matching between the face image data obtained based on the verification number A and the saved face photographed image fails. Therefore, by performing the identity verification process with two-stage authentication in this way, if the replacement of the My Number Card 60 occurs, the replacement can be detected, and strict identity verification is realized.

[0126] In addition, the various types of information that the identity verification terminal 10 deletes in step St86 shown in FIG. 6 are the face photographed image, four types of information, face image data, and personal number obtained during the identity verification process.

[0127] Note that if the identity verification terminal 10 cannot obtain the verification number B or the verification number A, cannot access the IC chip 61, cannot obtain various types of information (four types of information, face image data, and personal number) from the IC chip 61, or fails in face matching, it may be determined that the identity verification process has failed. In this case, the identity verification terminal 10 may notify the business terminal 20 of the failure of the identity verification process together with the content of the step of the failed process. Further, when the identity verification terminal 10 determines that the identity verification process has failed, the determination result may be displayed on the display device 17.

[0128] In addition, in the identity verification process using face recognition, for example, when face matching fails, an example of shifting to the identity verification process by entering a password was described. However, in the identity verification process by entering a password, there may be a case where User 2 cannot access the IC chip 61 of the My Number card 60 and fails in identity verification because the user has forgotten the PIN code, that is, the password. In this case, a bank clerk may perform corresponding operations such as identity verification of User 2 in person or via the customer operation terminal 70. Also, in this case, a message indicating that individual support is provided by the bank clerk may be displayed on the display device 17 of the identity verification terminal 10 and the display device 23 of the business terminal 20.

[0129] In addition, in order to explain the identity verification process in two phases, Phase 1 and Phase 2, the display of the verification result in step St113 and the display of the instruction to turn over the My Number card 60 in step St115 were explained in separate steps, but these displays may be performed at the same timing.

[0130] Also, when linking with an individual number is not required, Phase 2 of the identity verification process is not performed. In this case, the process of the identity verification terminal 10 proceeds from step St113 to step St127.

[0131] [Display Screen] FIG. 9 is a schematic diagram for explaining an example of the display screen of the identity verification terminal 10 according to Embodiment 1. In step St100 shown in FIG. 7, an instruction prompting to place the My Number card 60 on the placement unit 13 may be displayed, as in the example of the screen 140.

[0132] In step St101 shown in FIG. 7, a screen for User 2 to select either face recognition or password entry as an authentication method may be displayed, as in the example of the screen 141.

[0133] When the authentication method is face authentication, a screen indicating that various information is being read from the IC chip 61 of the My Number Card 60 may be displayed, as in the example of the screen 142. For example, the screen 142 may be displayed during the processes from step St103 to step St109 shown in FIG. 7.

[0134] When the face photographing camera 16 photographs the face of the user 2 in step St110 shown in FIG. 7, a screen during photographing may be displayed, as in the example of the screen 143.

[0135] For the sake of convenience of explanation, it is assumed that the face verification is successful (step St112 shown in FIG. 7; YES). Also, in the process of step St113 shown in FIG. 7, the verification result is displayed on the display device 17, but is omitted in FIG. 9.

[0136] When it is necessary to associate the account with the personal number, the identity verification process proceeds from Phase 1 shown in FIGS. 5 and 7 to Phase 2 shown in FIGS. 5 and 8. That is, the back surface of the My Number Card 60 is read. In step St115 shown in FIG. 8, an instruction prompting the user to turn over the My Number Card 60 may be displayed, as in the example of the screen 144.

[0137] A screen indicating that the reading is in progress, such as the screen 145, may be displayed, for example, during the processes from step St116 to step St125 shown in FIG. 8.

[0138] For the sake of convenience of explanation, it is assumed that the face verification is successful (step St125 shown in FIG. 8; YES). Also, in the process of step St126 shown in FIG. 8, the verification result is displayed on the display device 17, but is omitted in FIG. 9.

[0139] In step St127 shown in FIG. 8, a screen indicating that the identity verification is completed may be displayed, as in the example of the screen 146.

[0140] Note that when it is not necessary to associate the account with the personal number, the back surface of the My Number Card 60 is not read.

[0141] When the authentication method is the input of a password, a screen for the user 2 to input the password may be displayed as in the example of the screen 147. This corresponds to step St128 shown in FIG. 8.

[0142] For example, while various information is being read from the IC chip 61 in steps St130 and St131 shown in FIG. 8, a screen indicating that reading is in progress, such as the screen 148, may be displayed.

[0143] (Modification Example of Embodiment 1) In the above-described Embodiment 1, when the personal identification terminal 10 successfully matched the face image data acquired based on the collation number B with the face photographed image of the user 2, the face photographed image was saved. Then, the personal identification terminal 10 collated the face image data acquired based on the collation number A with the saved face photographed image. However, the present invention is not limited to this. When the personal identification terminal 10 successfully matches the face image data acquired based on the collation number B with the face photographed image of the user 2, the face image data may be saved. In this case, the personal identification terminal 10 may collate the face image data acquired based on the collation number A with the saved face image data. This is because as long as the my number card 60 placed on the placement unit 13 is not replaced with another my number card during the personal identification process, the face image data acquired based on the collation number B and the face image data acquired based on the collation number A should be the same face image data.

[0144] In addition, the identity verification terminal (e.g., identity verification terminal 10) may obtain a first number (e.g., verification number B) based on the voucher information on the first side (e.g., the front surface of the My Number Card 60) of the identity verification document (e.g., My Number Card 60). Then, the identity verification terminal may obtain first face image data and first personal information (e.g., name) based on the first number. Then, the identity verification terminal may compare the first face image data with a face captured image generated by photographing the face of the target person (e.g., User 2). Then, if the comparison is successful, the identity verification terminal may save the first personal information and the first number. Then, the identity verification terminal may use the saved first number to obtain the first personal information from the identity verification document in a state where the camera (e.g., document photographing camera 15) can photograph the second side of the identity verification document (e.g., the back surface of the My Number Card 60). Then, the identity verification terminal may compare the saved first personal information with the first personal information obtained in a state where the camera can photograph the second side of the identity verification document. Then, if the comparison is successful, the identity verification terminal may determine that the identity verification document has not been replaced. Then, the identity verification terminal may determine that the identity verification has been successful.

[0145] For example, when the identity verification terminal 10 successfully matches the face image data obtained based on the collation number B with the face captured image of the user 2, it may save the collation number B and the name among the four pieces of information obtained based on the collation number B. In this case, the identity verification terminal 10 is in a state where the My Number card 60 is turned over, in other words, in a state where the document photographing camera 15 can photograph the back surface of the My Number card 60, and uses the saved collation number B as an access key to access the IC chip 61 of the My Number card 60, and may obtain the name among the four pieces of information from the IC chip 61. The identity verification terminal 10 may determine whether or not the name obtained using the collation number B in a state where the My Number card 60 is not turned over, that is, in a state where the document photographing camera 15 can photograph the front surface of the My Number card 60, and the name obtained using the collation number B in a state where the My Number card 60 is turned over, that is, in a state where the document photographing camera 15 can photograph the back surface of the My Number card 60, match. Then, when the two obtained names match, the identity verification terminal 10 may determine that the My Number card 60 has not been replaced and that the identity verification has been successful. Although the name among the four pieces of information has been described as an example, the address, date of birth, or gender among the four pieces of information may be obtained by the identity verification terminal 10 in a state where the document photographing camera 15 can photograph the front surface of the My Number card 60 and a state where it can photograph the back surface, respectively, and used for the collation for identity verification.

[0146] In addition, the identity verification terminal (e.g., identity verification terminal 10) may obtain a first number (e.g., verification number B) based on the coupon surface information on the first side (e.g., the front surface of the My Number Card 60) of the identity verification document (e.g., My Number Card 60). Then, the identity verification terminal may obtain first face image data based on the first number. Then, the identity verification terminal may compare the first face image data with a face captured image generated by photographing the face of the target person (e.g., User 2). Then, when the comparison is successful, the identity verification terminal may save the first face image data and the first number. Then, with the camera (e.g., document photographing camera 15) being able to photograph the second side (e.g., the back surface of the My Number Card 60) of the identity verification document, the identity verification terminal may obtain second face image data from the identity verification document using the saved first number. Then, the identity verification terminal may compare the saved first face image data with the second face image data. Then, when the comparison is successful, the identity verification terminal may determine that the identity verification document has not been replaced. Then, the identity verification terminal may determine that the identity verification has been successful.

[0147] For example, when the identity verification terminal 10 successfully compares the face image data obtained based on the verification number B with the face captured image of User 2, it may save the verification number B and the face image data. In this case, with the My Number Card 60 turned over, that is, with the document photographing camera 15 being able to photograph the back surface of the My Number Card 60, the identity verification terminal 10 may access the IC chip 61 of the My Number Card 60 using the saved verification number B as an access key and obtain face image data from the IC chip 61. The identity verification terminal 10 may compare the face image data obtained using the verification number B when the My Number Card 60 has not been turned over, that is, when the document photographing camera 15 is able to photograph the front surface of the My Number Card 60, with the face image data obtained using the verification number B after the My Number Card 60 has been turned over, that is, when the document photographing camera 15 is able to photograph the back surface of the My Number Card 60. Then, when the face comparison is successful, the identity verification terminal 10 may determine that the My Number Card 60 has not been replaced and that the identity verification has been successful.

[0148] Further, the personal identification terminal (for example, the personal identification terminal 10) may acquire a first number (for example, the collation number B) based on the face value information on the first side (for example, the front surface of the My Number Card 60) of the personal identification document (for example, the My Number Card 60). Then, the personal identification terminal may acquire first face image data based on the first number of the personal identification document. Then, the personal identification terminal may collate the first face image data with a face captured image generated by photographing the face of the target person (for example, the user 2). Then, when the collation is successful, the personal identification terminal may save the first number. Then, the personal identification terminal may access the IC chip (for example, the IC chip 61) of the personal identification document using the saved first number in a state where the camera (for example, the document photographing camera 15) can photograph the second side (for example, the back surface of the My Number Card 60) of the personal identification document. Then, when the access is successful, the personal identification terminal may determine that the personal identification document has not been replaced.

[0149] For example, when the My Number Card 60 is turned over, if the My Number Card 60 is replaced with another My Number Card, even if the verification number B is stored in the personal verification terminal 10, the personal verification terminal 10 cannot access the IC chip of the other My Number Card using the verification number B as an access key. Therefore, the personal verification terminal 10 may determine whether the My Number Card 60 has not been replaced with another My Number Card as follows. That is, the personal verification terminal 10 accesses the IC chip 61 of the My Number Card 60 to obtain the verification number B, and if the verification of the face image data obtained based on the verification number B and the face captured image of the user 2 is successful, the personal verification terminal 10 may store the verification number B. Then, when the document imaging camera 15 can image the back surface of the My Number Card 60 and can access the IC chip 61 of the My Number Card 60 using the verification number B obtained when the document imaging camera 15 can image the front surface of the My Number Card 60 as an access key, the personal verification terminal 10 may determine that the My Number Card 60 has not been replaced. When the document imaging camera 15 can image the back surface of the My Number Card 60 and can access the IC chip 61 of the My Number Card 60 using the verification number B obtained when the document imaging camera 15 can image the front surface of the My Number Card 60 as an access key, the personal verification terminal 10 may determine that the My Number Card 60 has been replaced.

[0150] Also, in the identity verification process, the order of reading the front and back surfaces of the My Number Card 60 may be reversed. In this case, when the identity verification terminal 10 successfully matches the face image data obtained based on the verification number A with the face captured image of the user 2, the face captured image may be saved. Then, the identity verification terminal 10 may match the face image data obtained based on the verification number B with the saved face captured image. Also, when the back surface of the My Number Card 60 is read before the front surface in this way, the verification number A may be saved. In this case, the identity verification terminal 10 accesses the IC chip 61 of the My Number Card 60 using the saved verification number A as an access key in a state where the My Number Card 60 is turned over, that is, in a state where the document imaging camera 15 can image the front surface of the My Number Card 60, and may obtain the personal number from the IC chip 61. The identity verification terminal 10 determines whether or not the personal number obtained before the My Number Card 60 is turned over matches the personal number obtained after the My Number Card 60 is turned over, and if they match, it may be determined that the identity verification has succeeded.

[0151] (Summary of Embodiment 1) According to the description of Embodiment 1 above, at least the following technologies are disclosed. Although the corresponding components etc. in Embodiment 1 are exemplified in parentheses, it is not limited thereto.

[0152] (Technology 1) A method for verifying the identity of a target person (e.g., user 2) based on an identity verification document (e.g., My Number Card 60) is to obtain first face image data based on the face value information on the first side of the identity verification document (e.g., the front surface of the My Number Card 60), match the first face image data with a face captured image generated by photographing the face of the target person, and if the match is successful, save the face captured image or the first face image data, obtain second face image data based on the face value information on the second side of the identity verification document (e.g., the back surface of the My Number Card 60), and match the second face image data with the saved face captured image or the first face image data.

[0153] Thus, when the collation between the first face image data obtained from the identity document and the face photographed image of the target person is successful, the first face image data or the face photographed image is saved. Then, the saved first face image data or face photographed image is collated with the second face image data obtained from the identity document. As a result, for example, when the identity document is replaced after the collation between the first face image data and the face photographed image of the target person, the collation between the saved first face image data or face photographed image and the second face image data obtained from the identity document fails. In this way, by performing the collation twice, when each of the first side and the second side of the identity document is read, it is guaranteed that the identity document at the time of reading the first side and the identity document at the time of reading the second side are the same, so strict identity verification is realized.

[0154] (Technology 2) In the identity verification method described in Technology 1, the identity document is a My Number card (for example, My Number card 60), the face value information on the first side is the date of birth, the Gregorian calendar of the expiration date, and the security code described on the first side, and the identity verification method accesses the IC chip (for example, IC chip 61) of the My Number card with the collation number B obtained based on the face value information on the first side, and acquires the first face image data stored in the IC chip.

[0155] This enables identity verification using a My Number card. Also, the identity verification method enables access to the IC chip using the collation number B as an access key and acquisition of the face image data stored in the IC chip.

[0156] (Technology 3) In the identity verification method described in Technology 1 or 2, the identity document is a My Number card, the face value information on the second side is the two-dimensional barcode described on the second side, and the identity verification method accesses the IC chip of the My Number card with the collation number A obtained based on the two-dimensional barcode, and acquires the second face image data stored in the IC chip.

[0157] As a result, the personal identification method enables access to the IC chip using the collation number A as an access key and acquisition of the face image data stored in the IC chip.

[0158] (Technology 4) In the personal identification method described in Technology 2, the personal identification method acquires the first personal information stored in the IC chip simultaneously with the acquisition of the first face image data.

[0159] As a result, the personal identification method enables simultaneous acquisition of face image data and personal information from the IC chip.

[0160] (Technology 5) In the personal identification method described in Technology 4, the first personal information includes name, gender, address, and date of birth.

[0161] As a result, the personal identification method enables simultaneous acquisition of face image data and personal information including name, gender, address, and date of birth from the IC chip.

[0162] (Technology 6) In the personal identification method described in Technology 3, the personal identification method acquires the second personal information stored in the IC chip simultaneously with the acquisition of the second face image data.

[0163] As a result, the personal identification method enables simultaneous acquisition of face image data and personal information from the IC chip.

[0164] (Technology 7) In the personal identification method described in Technology 6, the second personal information includes a personal number.

[0165] As a result, the personal identification method enables simultaneous acquisition of face image data and personal information including a personal number from the IC chip.

[0166] (Technology 8) In the personal identification method according to any one of Technologies 1 to 7, the personal identification document consists of a front side and a back side, the first side is the front side of the personal identification document, and the second side is the back side of the personal identification document.

[0167] Thereby, the personal identification method enables the acquisition of face image data based on the respective face sheet information on the front side and the back side of the personal identification document.

[0168] (Technology 9) In the personal identification method according to any one of Technologies 1 to 8, when the personal identification document when the first face image data is acquired and the personal identification document when the second face image data is acquired are the same, the first face image data and the second face image data are the same data.

[0169] When the personal identification document when the first face image data is acquired and the personal identification document when the second face image data is acquired are the same, the first face image data and the second face image data are the same data. In this case, if the collation between the first face image data and the face photographed image is successful, the collation between the second face image data and the face photographed image will also be successful.

[0170] (Technology 10) In the personal identification method according to any one of Technologies 1 to 9, when the personal identification method saves the face photographed image, after collating the second face image data with the saved face photographed image, the saved face photographed image is deleted.

[0171] Thereby, since the saved face photographed image is deleted, the privacy protection of the target person is achieved.

[0172] (Technology 11) In the personal identification method according to any one of Technologies 1 to 10, when the personal identification method succeeds in collating the second face image data with the saved face photographed image or the first face image data, it is determined that the personal identification of the target person is successful, and the determination result is displayed on the display device.

[0173] As a result, for example, the target person can confirm the result of the identity verification on the display device.

[0174] (Technology 12) In the identity verification method according to any one of Technologies 1 to 11, when the collation between the second face image data and the stored face captured image or the first face image data fails, it is determined that the identity verification of the target person has failed, and the determination result is displayed on the display device.

[0175] As a result, for example, the target person can confirm the result of the identity verification on the display device.

[0176] (Technology 13) An identity verification terminal (for example, identity verification terminal 10) that performs identity verification of a target person based on an identity verification document includes a face capture camera (for example, face capture camera 16) that captures the face of the target person to generate a face captured image, a document capture camera (for example, document capture camera 15) that captures the face of the identity verification document to generate a document captured image, a processor (for example, processor 11), and a memory (for example, memory 12). The processor acquires first face image data based on the face information obtained from the document captured image of the first side of the identity verification document, collates the first face image data with the face captured image, and if the collation is successful, stores the face captured image or the first face image data in the memory. Then, the processor acquires second face image data based on the face information obtained from the document captured image of the second side of the identity verification document, and collates the second face image data with the face captured image or the first face image data stored in the memory.

[0177] As a result, the identity verification terminal can obtain the same effect as Technology 1.

[0178] (Technology 14) The personal identification system (e.g., personal identification system 1) includes a personal identification terminal that performs personal identification of a target person based on a personal identification document, and a business terminal (e.g., business terminal 20) communicably connected to the personal identification terminal. The personal identification terminal includes a face capture camera that captures the face of the target person to generate a face capture image, and a document capture camera that captures the face of the personal identification document to generate a document capture image. The personal identification terminal, in response to an instruction from the business terminal, obtains first face image data based on the face information obtained from the document capture image of the first side of the personal identification document, collates the first face image data with the face capture image, and if the collation is successful, stores the face capture image or the first face image data in the memory, obtains second face image data based on the face information obtained from the document capture image of the second side of the personal identification document, and collates the second face image data with the face capture image or the first face image data stored in the memory.

[0179] Thereby, the personal identification system can obtain the same effect as that of Technique 1.

[0180] (Technique 15) The program causes the personal identification terminal that performs personal identification of a target person based on a personal identification document to obtain first face image data based on the face information of the first side of the personal identification document, collate the first face image data with the face capture image generated by capturing the face of the target person, and if the collation is successful, store the face capture image or the first face image data, obtain second face image data based on the face information of the second side of the personal identification document, and collate the second face image data with the stored face capture image or the first face image data.

[0181] Thereby, the program can obtain the same effect as that of Technique 1.

[0182] (Technique 16) The personal identification method acquires a first number (for example, collation number B) based on the front side information of the personal identification document obtained by photographing the first side of the personal identification document with a camera (for example, document photographing camera 15), acquires face image data and personal information of the target person who owns the personal identification document based on the first number, collates the face image data with a face photographed image generated by photographing the face of the target person, and when the collation is successful, saves the first number. With the camera in a state where it can photograph the second side of the personal identification document, it acquires the personal information of the target person who owns the personal identification document using the saved first number, and collates the personal information of the target person acquired by the camera photographing the first side of the personal identification document with the personal information of the target person acquired with the camera in a state where it can photograph the second side of the personal identification document.

[0183] Thereby, for example, based on the collation number B obtained by photographing the front surface of the My Number Card, personal information and face image data are acquired. And when the collation between the face photographed image generated by photographing the face of the target person and the face image data is successful, the collation number B is saved. And with the camera in a state where it can photograph the back surface of the My Number Card, the personal information of the target person is acquired using the saved collation number B. And the personal information acquired based on the collation number B obtained by photographing the front surface of the My Number Card is collated with the personal information acquired based on the collation number B with the camera in a state where it can photograph the back surface of the My Number Card. As a result of the collation, when each personal information matches, it is determined that the My Number Card has not been replaced and the personal identification of the target person has been successful.

[0184] (Technology 17) The personal identification method acquires a second number (e.g., two-dimensional barcode 64) based on the coupon surface information of the second side obtained by photographing the second side of the personal identification document with a camera, acquires the face image data and the personal number of the target person who owns the personal identification document based on the second number, collates the face image data with the face photographed image generated by photographing the face of the target person, and when the collation is successful, saves the second number. With the camera in a state where it can photograph the first side of the personal identification document, the personal number of the target person who owns the personal identification document is acquired using the saved second number, and the personal number of the target person acquired by the camera photographing the second side of the personal identification document is collated with the personal number of the target person acquired with the camera in a state where it can photograph the first side of the personal identification document.

[0185] Thus, for example, based on the collation number A obtained by reading the two-dimensional barcode printed on the back of the My Number card, the personal number and the face image data are acquired. And when the collation between the face photographed image generated by photographing the face of the target person and the face image data is successful, the collation number A is saved. And with the camera in a state where it can photograph the front surface of the My Number card, the personal number of the target person is acquired using the saved collation number A. And the personal number acquired based on the collation number A obtained by photographing the back of the My Number card is collated with the personal number acquired based on the collation number A with the camera in a state where it can photograph the front surface of the My Number card. As a result of the collation, when the respective personal numbers match, it is determined that the My Number card has not been replaced and the personal identification of the target person has been successful.

[0186] (Embodiment 2) In the description of the above Embodiment 1, an example in which the personal identification terminal 10 performs personal identification of the user 2 has been described. In the description of Embodiment 2, an example in which personal identification of the user 2 is performed by the cooperation of the user terminal 150 (see FIG. 10) and the collation server 160 (see FIG. 10) will be described. It was premised that the personal identification terminal 10 according to Embodiment 1 was installed inside the bank. However, the user terminal 150 is a terminal that can be personally owned by the user 2, such as a smartphone. That is, the personal identification system 1A (see FIG. 10) according to Embodiment 2 is not premised on being introduced into the bank.

[0187] In the description of the personal identification system 1A according to Embodiment 2, the description of the same content as that of the personal system 1 according to Embodiment 1 will be simplified or omitted, and the description will focus on the differences.

[0188] [System Configuration] FIG. 10 is a block diagram showing a configuration example of the personal identification system 1A according to Embodiment 2. The personal identification system 1A includes a user terminal 150, a collation server 160, a bank server 30, a signature verification server 40, and a public certification server 50. The user terminal 150 and the collation server 160 are connected via wireless communication such as a wireless LAN, for example, and can transmit and receive information to and from each other. This is the same for the connections between the user terminal 150 and the bank server 30, and between the user terminal 150 and the signature verification server 40.

[0189] The user terminal 150 uses the My Number card 60 and cooperates with the collation server 160 to perform personal identification processing of the user 2. An example of the user terminal 150 is a smartphone.

[0190] The user terminal 150 includes a processor 151, a memory 152, an operating device 153, a camera 154, a display device 155, and a communication device 156.

[0191] In addition, the user terminal 150 has a function of non-contact reading of the data stored in the IC chip 61 of the My Number card 60. For example, the user terminal 150 supports the NFC method. In the following description, it is assumed that when the user terminal 150 accesses the IC chip 61 of the My Number card 60, communication is performed between the user terminal 150 and the IC chip 61 of the My Number card 60 by the NFC method or the like.

[0192] The processor 151 realizes the functions of the user terminal 150 by executing a computer program stored in the memory 152. For example, the processor 151 performs the authentication process of the user 2 by executing the authentication application 157 stored in the memory 152. Note that the processor 151 may be read as other terms such as a controller, a CPU, or a control unit.

[0193] The memory 152 is a storage area for storing and holding a computer program for realizing the functions of the user terminal 150 and various types of data and the like. The memory 152 is composed of, for example, a ROM, an HDD which are non-volatile storage areas, and a RAM which is a volatile storage area. The memory 152 stores the authentication application 157. The authentication application 157 is an application for performing identity verification required for opening a bank account. The authentication application 157 may be installed in the user terminal 150 by the user 2.

[0194] The operation device 153 receives operations from the user 2.

[0195] The camera 154 captures the front side of the My Number card 60 and generates a document capture image. In addition, the camera 154 captures the face of the user 2 and generates a face capture image.

[0196] The display device 155 displays various images and information and the like. The display device 155 and the operation device 153 may be an integrated device such as a touch panel display.

[0197] The communication device 156 controls the transmission and reception of various data with the collation server 160 and the bank server 30.

[0198] The collation server 160 performs face collation using the face captured image and face image data transmitted from the user terminal 150. Examples of the collation server 160 include a server computer and the like.

[0199] The collation server 160 includes a processor 161, a memory 162, and a communication device 163.

[0200] The processor 161 realizes the functions of the collation server 160 by executing a program in cooperation with the memory 162. Note that the processor 161 may be read as other terms such as a controller, a CPU, or a control unit.

[0201] The memory 162 is a storage area for storing and holding a computer program and various data for realizing the functions of the collation server 160. The memory 162 is composed of, for example, a ROM which is a non-volatile storage area, an HDD, and a RAM which is a volatile storage area.

[0202] The communication device 163 controls the transmission and reception of various data with the user terminal 150.

[0203] Descriptions of the bank server 30, the signature verification server 40, and the public certification server 50 are omitted. Note that in this embodiment, the signature verification server 40 and the public certification server 50 may be omitted.

[0204] [Operation] With reference to FIG. 11, the process of newly opening a bank account of user 2 using the personal identification system 1A will be described. FIG. 11 is a conceptual diagram for opening an account using the personal identification system 1A according to Embodiment 2.

[0205] User 2 obtains the authentication app 157 and operates the user terminal 150 to apply for opening a new account. The authentication app 157 may be provided online, for example, by the bank to which User 2 applies for opening an account. User 2 may obtain the authentication app 157 from, for example, an online store that provides various applications, or from the bank's homepage or the like. In the following description, it is assumed that the application for opening an account is made on the authentication app 157, but it is not limited to this.

[0206] Then, User 2 decides whether to associate the newly opened account with User 2's personal number. Here, for example, the decision may be input to the authentication app 157. Thereafter, the identity verification process of User 2 using the My Number Card 60 is performed.

[0207] When it is necessary to associate the account with the personal number, the identity verification process is performed in two stages, namely Phase 1 and Phase 2. The user terminal 150 obtains the personal number in the Phase 2 process. Also, even when the identity verification process is performed in two stages, that is, when the front and back surfaces of the My Number Card 60 are read, the replacement of the My Number Card 60 can be detected, so strict identity verification is realized. The details of the process will be described later with reference to FIGS. 13 and 14.

[0208] Even when it is not necessary to associate the account with the personal number, the identity verification process is still performed. In this case, the identity verification process corresponds to the Phase 1 process of the identity verification process when it is necessary to associate the account with the personal number.

[0209] Thereafter, the validity of the My Number Card 60, in other words, the public authentication process, is determined by the signature verification server 40 and the public authentication server 50. When it is confirmed that the My Number Card 60 is valid, the bank server 30 opens an account. Note that the public authentication process may be omitted.

[0210] Thereafter, the bank server 30 manages the newly opened account.

[0211] In the following description, attention is paid to the case where it is necessary to associate an account with a personal number.

[0212] FIG. 12 is a sequence diagram showing an operation example of the personal authentication system 1A according to the second embodiment.

[0213] The user terminal 150 activates the authentication application 157 based on the operation of User 2 (step St170).

[0214] The user terminal 150 receives a request for opening a new account by User 2 and for associating the account with a personal number (step St171). Specifically, for example, User 2 makes a request for opening a new account and for associating the account with a personal number using the authentication application 157.

[0215] When the user terminal 150 receives a request for opening an account and for associating the account with a personal number in step St171, it receives a selection of an authentication method (step St172). The authentication methods are face authentication and password input. For the sake of convenience of explanation, it is assumed that face authentication is selected as the authentication method.

[0216] When the user terminal 150 receives a selection of face authentication as the authentication method in step St172, it performs a personal authentication process for User 2 in cooperation with the collation server 160 (step St173). Details of this process will be described later with reference to FIGS. 13 and 14. When password input is selected as the authentication method in step St172, the user terminal 150 performs the personal authentication process independently without cooperating with the collation server 160 (see FIG. 15).

[0217] When the personal authentication process in step St173 is successful, the user terminal 150 transmits personal information to the bank server 30 (step St174).

[0218] When the bank server 30 receives the personal information of user 2 sent from the user terminal 150, it creates a new account number and sends an account number creation completion notice to the user terminal 150 (step St175). Although not shown in FIG. 12, when the identity verification process fails, the user terminal 150 may, for example, display a message indicating the failure of the identity verification process on the display device 155, or send such a message to the bank server 30.

[0219] Also, when the public authentication process is performed, the user terminal 150 may, for example, obtain an electronic certificate for signature from the My Number card 60 before the process of step St174. The user terminal 150 sends the electronic certificate for signature required to the public authentication server 50 via the signature verification server 40. The public authentication server 50 determines the validity of the My Number card 60 and sends the determination result to the user terminal 150 via the signature verification server 40. Then, when the user terminal 150 receives the result that the My Number card 60 is valid, it executes the process of step St174.

[0220] When the user terminal 150 receives the account number creation completion notice sent from the bank server 30, it displays a message indicating that the account number has been created on the display device 155 (step St176).

[0221] The user terminal 150 deletes various personal information obtained during the identity verification process (step St177).

[0222] The bank server 30 associates the newly created account number with the personal information of user 2 (step St178). The bank server 30 completes the new account opening and saves the information of the opened account (step St179).

[0223] Next, with reference to FIGS. 13 and 14, the authentication process of User 2 by the user terminal 150 and the collation server 160 will be described. FIG. 13 is a sequence diagram showing an operation example of the authentication system 1A according to Embodiment 2. FIG. 14 is a sequence diagram showing an operation example of the authentication system 1A following FIG. 13. "C" and "D" shown in each of the sequence diagrams of FIGS. 13 and 14 represent the connection of each of the sequence diagrams of FIGS. 7 and 8.

[0224] At the start point of the sequence diagram shown in FIG. 13, the user terminal 150 is displaying a screen for receiving a selection of an authentication method from User 2. As an example of a screen for receiving a selection of an authentication method, the screen 141 shown in FIG. 9 can be mentioned.

[0225] Also, in the following description, the entity that executes the process may be described as the authentication app 157. More precisely, each process of the user terminal 150 in the authentication process is performed by the processor 151 of the user terminal 150 executing the authentication app 157. Note that the authentication document in the figure refers to the My Number Card 60.

[0226] The authentication app 157 receives the selection of the authentication method by User 2 (step St180). For the sake of convenience of explanation, it is assumed that face authentication is selected as the authentication method by User 2.

[0227] The camera 154 of the user terminal 150 photographs the surface of the My Number Card 60, and the authentication app 157 acquires the collation number B based on the generated document photographed image (step St181). More specifically, the authentication app 157 activates the camera 154, and User 2 photographs the surface of the My Number Card 60. Thereby, a document photographed image is generated. The collation number B is acquired based on the character information 63 detected by performing OCR on the document photographed image. Note that the authentication app 157 may display, on the display device 155, a screen for instructing User 2 to photograph the surface of the My Number Card 60.

[0228] The authentication app 157 accesses the IC chip 61 of the My Number Card 60 using the collation number B obtained in step St181 as an access key (step St182).

[0229] The authentication app 157 reads and obtains four pieces of information and face image data from the IC chip 61 (step St183).

[0230] The camera 154 captures the face of user 2 and generates a face capture image (step St184). At this time, the camera 154 is activated by the authentication app 157. Also, at this time, for example, user 2 may capture their own face by operating the user terminal 150. Further, the authentication app 157 may cause the display device 155 to display a screen instructing user 2 to capture their own face.

[0231] The authentication app 157 transmits the face capture image of user 2 generated in step St184 and the face image data obtained in step St183 to the collation server 160 (step St185).

[0232] The collation server 160 receives the face capture image and the face image data transmitted from the user terminal 150 and collates them (step St186). The collation of the face capture image and the face image data may be performed, for example, by comparing face feature amounts. For the sake of explanation, it is assumed that the collation server 160 succeeds in face collation in step St186.

[0233] The collation server 160 transmits the collation result to the user terminal 150 (step St187).

[0234] When the authentication app 157 receives the collation result transmitted from the collation server 160, it causes the display device 155 to display the collation result (step St188).

[0235] The processes from step St180 to step St188, that is, the series of processes enclosed by the dashed line shown in FIG. 13, correspond to Phase 1 of the identity verification process shown in FIG. 11. In Phase 1, the user terminal 150 transmits to the verification server 160 the face image data obtained from the IC chip 61 of the My Number card 60 using the verification number B as an access key and the face captured image generated by photographing the face of User 2, and the verification server 160 verifies them to verify the identity of User 2.

[0236] Subsequently, the processes after step St189 will be described.

[0237] After the face verification in step St186 is successful and the verification server 160 transmits the verification result to the user terminal 150 in step St187, the verification server 160 saves the face captured image of User 2 (step St189). The face captured image is saved in, for example, the memory 162.

[0238] After the authentication app 157 causes the display device 155 to display the verification result in step St188, the authentication app 157 then causes the display device 155 to display an instruction to turn over the My Number card 60 (step St190). Alternatively, the user terminal 150 may display a screen instructing to read the two-dimensional barcode 64 of the My Number card 60.

[0239] The camera 154 of the user terminal 150 reads the two-dimensional barcode 64 of the My Number card 60, and the authentication app 157 obtains the verification number A based on the two-dimensional barcode 64 (step St191). More specifically, the authentication app 157 activates the camera 154 and causes User 2 to read the two-dimensional barcode 64 on the back of the My Number card 60 with the camera 154. Thereby, the authentication app 157 can obtain the verification number A based on the two-dimensional barcode 64.

[0240] The authentication app 157 accesses the IC chip 61 of the My Number card 60 using the verification number A obtained in step St191 as an access key (step St192).

[0241] The authentication app 157 reads and obtains the personal number and face image data from the IC chip 61 (step St193).

[0242] The authentication app 157 transmits the face image data obtained in step St193, that is, the face image data obtained based on the collation number A, to the collation server 160 (step St194).

[0243] When the collation server 160 receives the face image data transmitted from the user terminal 150 in step St194, it reads out the face photographed image saved in step St189 (step St195).

[0244] The collation server 160 collates the face image data transmitted from the user terminal 150 in step St194 with the face photographed image saved in step St189 and read out in St195 (step St196). For the sake of convenience of explanation, it is assumed that the collation server 160 has succeeded in face collation in step St196.

[0245] The collation server 160 transmits the collation result to the user terminal 150 (step St197).

[0246] When the authentication app 157 receives the collation result transmitted from the collation server 160, it causes the display device 155 to display the collation result (step St198).

[0247] The processes from step St189 to step St198, that is, the series of processes enclosed by the broken line shown in FIG. 14, correspond to Phase 2 of the identity verification process shown in FIG. 11. In Phase 2, the collation server 160 collates the face image data obtained from the IC chip 61 of the My Number card 60 by the user terminal 150 using the collation number A as an access key with the face photographed image generated by photographing the face of user 2 in Phase 1, thereby verifying the identity of user 2.

[0248] After step St198, the authentication app 157 causes the display device 155 to display that the identity verification process has been completed (step St199).

[0249] After step St197, the matching server 160 deletes the face image data and the face captured image obtained during the identity verification process (step St200).

[0250] In this way, the matching server 160 matches the face image data acquired by the user terminal 150 based on the matching number B with the face captured image of User 2, and if the matching is successful, saves the face captured image. Then, the matching server 160 matches the face image data acquired by the user terminal 150 based on the matching number A with the saved face captured image. If the matching is successful, the user terminal 150 determines that the identity verification of User 2 has been successful. For example, if the face matching in Phase 1 is successful and then the My Number card 60 is replaced with another My Number card before the two-dimensional barcode 64 of the My Number card 60 is read, the face matching in Phase 2 will fail. Therefore, by performing the identity verification process with two-stage authentication in this way, if the My Number card 60 is replaced, the replacement can be detected, and strict identity verification is achieved.

[0251] Also, in step St177 shown in FIG. 12, the various personal information deleted by the user terminal 150 are the face captured image, four pieces of information, face image data, and personal number obtained during the identity verification process.

[0252] Also, when the association of the personal number is not required, Phase 2 of the identity verification process is not performed. In this case, the processing of the user terminal 150 proceeds from step St188 to step St199, and the processing of the matching server 160 proceeds from step St187 to step 200.

[0253] FIG. 13 and FIG. 14 are sequence diagrams on the premise that user 2 selects face authentication as the authentication method. The case where user 2 selects password input as the authentication method will be described with reference to FIG. 15. FIG. 15 is a flowchart showing an operation example of user terminal 150 according to Embodiment 2.

[0254] The authentication app 157 receives a selection by user 2 to use password input as the authentication method (step St210).

[0255] The authentication app 157 causes the display device 155 to display a PIN code input screen (step St211). As an example of the input screen, the screen 147 shown in FIG. 9 can be mentioned.

[0256] The authentication app 157 receives the PIN code input by user 2 (step St212). For the sake of convenience of explanation, it is assumed that the PIN code input in step St212 is the correct PIN code.

[0257] The authentication app 157 accesses the IC chip 61 of the My Number card 60 using the PIN code input in step St212 as an access key (step St213).

[0258] The authentication app 157 reads and obtains the four-information and the personal number from the IC chip 61 (step St214). For the sake of convenience of explanation, it is assumed that the authentication app 157 has been able to obtain the four-information and the personal number.

[0259] The authentication app 157 causes the display device 155 to display a message indicating that the reading was successful (step St215).

[0260] The authentication app 157 causes the display device 155 to display a message indicating that the identity confirmation has been completed (step St216). Then, this processing flow ends.

[0261] Even when face authentication is selected as the authentication method, the user terminal 150 may determine that the identity verification process by face authentication has failed in the following cases and shift the process to step St211 shown in FIG. 15. The following cases are, namely, when the collation number B or the collation number A cannot be obtained, when the IC chip 61 cannot be accessed, when various types of information (four types of information, face image data, and personal number) cannot be obtained from the IC chip 61, or when the face collation fails. Further, when the user terminal 150 determines that the identity verification process has failed, the user terminal 150 may display the determination result on the display device 155. Note that even if the identity verification process by face authentication fails and the process shifts to the identity verification process by inputting the PIN number, there may be a case where the user 2 cannot access the IC chip 61 of the My Number card 60 and the identity verification fails for reasons such as the user 2 forgetting the PIN number. In this case, for example, a message recommending that the user contact a bank clerk may be displayed on the display device 155.

[0262] In addition, in order to separately explain the identity verification process in Phase 1 and Phase 2, the display of the collation result in step St188 and the display of the instruction to turn over the My Number card 60 in step St190 are explained in separate steps, but these displays may be performed at the same timing.

[0263] (Modification Example of Embodiment 2) In the above-described Embodiment 2, when the collation server 160 successfully collated the face image data acquired by the user terminal 150 based on the collation number B with the face photographed image of User 2, the face photographed image was saved. Then, the collation server 160 collated the face image data acquired by the user terminal 150 based on the collation number A with the saved face photographed image. However, the present invention is not limited to this. When the collation server 160 successfully collates the face image data acquired by the user terminal 150 based on the collation number B with the face photographed image of User 2, the face image data may be saved. In this case, the collation server 160 may collate the face image data acquired by the user terminal 150 based on the collation number A with the saved face image data. This is because as long as the My Number Card 60 used for the identity verification process is not replaced with another My Number Card during the identity verification process, the face image data acquired based on the collation number B and the face image data acquired based on the collation number A should be the same face image data.

[0264] Also, the user terminal (e.g., user terminal 150) may obtain a first number (e.g., collation number B) based on the document surface information obtained from the photographed image of the first side (e.g., the front surface of the my number card 60) of the identity document (e.g., my number card 60). Then, the user terminal 150 may obtain first face image data and first personal information (e.g., name) based on the first number. Then, the user terminal 150 may transmit the face photographed image of the target person (e.g., user 2) and the first face image data to a collation server (e.g., collation server 160). Then, the collation server may collate the first face image data and the face photographed image. Then, if the collation is successful, the collation server may transmit the collation result to the user terminal. Then, the user terminal may save the first number and the first personal information in response to obtaining the collation result from the collation server. Then, the user terminal may obtain the first personal information from the identity document using the saved first number in a state where the camera (e.g., camera 154) can photograph the second side of the identity document (e.g., the back surface of the my number card 60). Then, the user terminal 150 may collate the saved first personal information with the first personal information obtained in a state where the camera can photograph the second side of the identity document. Then, if the collation is successful, the user terminal 150 may determine that the identity document has not been replaced. Then, the user terminal 150 may determine that the identity verification has been successful.

[0265] For example, when the user terminal 150 receives, at step St187, the result of successful verification sent from the verification server 160, it may save the verification number B and the name among the four pieces of information obtained based on the verification number B. In this case, with the my number card 60 turned over, in other words, in a state where the camera 154 can photograph the back surface of the my number card 60, using the saved verification number B as an access key, the user terminal 150 may access the IC chip 61 of the my number card 60 and obtain the name among the four pieces of information from the IC chip 61. The user terminal 150 may verify whether the name obtained using the verification number B in the state where the camera 154 can photograph the front surface of the my number card 60 before the my number card 60 is turned over, that is, before the my number card 60 is turned over, and the name obtained using the verification number B in the state where the camera 154 can photograph the back surface of the my number card 60, that is, after the my number card 60 is turned over, match. Then, when the two obtained names match, the user terminal 150 may determine that the my number card 60 has not been replaced and that the identity verification has been successful. Although the name among the four pieces of information has been described as an example, the address, date of birth, or gender among the four pieces of information may be obtained by the user terminal 150 in the state where the camera 154 can photograph the front surface of the my number card 60 and the state where it can photograph the back surface, respectively, and used for verification for identity confirmation. Further, the verification using any of the above four pieces of information may be performed by the verification server 160.

[0266] Further, the user terminal (e.g., user terminal 150) may obtain a first number (e.g., verification number B) based on the document surface information obtained from the photographed image of the first side (e.g., the front surface of the My Number Card 60) of the identity document (e.g., My Number Card 60). Then, the user terminal may obtain first face image data based on the first number. Then, the user terminal may transmit the face photographed image of the target person (e.g., user 2) and the first face image data to a verification server (e.g., verification server 160). Then, the verification server may verify the first face image data and the face photographed image. Then, if the verification is successful, the verification server may transmit the verification result to the user terminal and save the first face image data. Then, the user terminal may save the first number in response to obtaining the verification result from the verification server. Then, with the camera (e.g., camera 154) capable of photographing the second side (e.g., the back surface of the My Number Card 60) of the identity document, the user terminal may obtain second face image data from the identity document using the saved first number. Then, the user terminal may transmit the second face image data to the verification server. Then, the verification server may verify the saved first face image data and the second face image data. Then, if the verification is successful, the verification server may transmit the verification result to the user terminal. Then, the user terminal may determine that the identity document has not been replaced in response to obtaining the verification result. Then, the user terminal may determine that the identity verification has been successful.

[0267] For example, when the user terminal 150 receives the result of successful verification transmitted from the verification server 160 in step St187, it may save the verification number B. Also, at this time, the verification server 160 may save the face image data. In this case, the user terminal 150 uses the saved verification number B as an access key in a state where the My Number Card 60 is turned over, that is, in a state where the camera 154 can photograph the back surface of the My Number Card 60, access the IC chip 61 of the My Number Card 60, and obtain face image data from the IC chip 61. Then, after the My Number Card 60 is turned over, that is, in a state where the camera 154 can photograph the back surface of the My Number Card 60, the user terminal 150 may transmit the face image data obtained using the verification number B to the verification server 160. The verification server 160 may verify the face image data obtained using the verification number B in a state where the camera 154 can photograph the back surface of the My Number Card 60 with the saved face image data, and transmit the verification result to the user terminal 150. Then, when the user terminal 150 receives the result of successful verification, it may determine that the My Number Card 60 has not been replaced and that the identity verification has been successful.

[0268] Further, the user terminal (e.g., user terminal 150) may obtain a first number (e.g., verification number B) based on the document surface information obtained from the photographed image of the first side (e.g., the front surface of the My Number card 60) of the identity document (e.g., My Number card 60). Then, the user terminal may obtain first face image data based on the first number. Then, the user terminal may transmit the face photographed image of the target person (e.g., user 2) and the first face image data to a verification server (e.g., verification server 160). Then, the verification server may verify the first face image data and the face photographed image. Then, when the verification is successful, the verification server may transmit the verification result to the user terminal. Then, the user terminal may save the first number in response to obtaining the verification result from the verification server. Then, with the camera (e.g., camera 154) being able to photograph the second side (e.g., the back surface of the My Number card 60) of the identity document, the user terminal may access the IC chip (e.g., IC chip 61) of the identity document using the saved first number. Then, when the access is successful, the user terminal may determine that the identity document has not been replaced.

[0269] For example, when the My Number Card 60 is reversed, if the My Number Card 60 is replaced with another My Number Card, even if the user terminal 150 has saved the verification number B, it cannot access the IC chip of the other My Number Card using the verification number B as an access key. Therefore, the user terminal 150 may determine whether the My Number Card 60 has been replaced with another My Number Card as follows. That is, when the identity verification terminal 10 accesses the IC chip 61 of the My Number Card 60 to obtain the verification number B and receives a verification result indicating that the face image data obtained based on the verification number B transmitted from the verification server 160 matches the face photographed image of User 2, the user terminal 150 may save the verification number B. Then, when the camera 154 can photograph the back surface of the My Number Card 60 and the verification number B obtained when the camera 154 can photograph the front surface of the My Number Card 60 can be used as an access key to access the IC chip 61 of the My Number Card 60, the user terminal 150 may determine that the My Number Card 60 has not been replaced. When the camera 154 can photograph the back surface of the My Number Card 60 and the verification number B obtained when the camera 154 can photograph the front surface of the My Number Card 60 can be used as an access key to access the IC chip 61 of the My Number Card 60, the user terminal 150 may determine that the My Number Card 60 has been replaced.

[0270] Also, in the identity verification process, the order of reading the front surface and the back surface of the My Number Card 60 may be reversed. In this case, when the verification server 160 successfully verifies the face image data obtained by the user terminal 150 based on the verification number A and the face photographed image of User 2, the verification server 160 may save the face photographed image. Then, the verification server 160 may verify the face image data obtained by the user terminal 150 based on the verification number B and the saved face photographed image.

[0271] Also, in the description of step St189, an example was described in which the collation server 160 stores the face photographed image in the memory 152. However, the present invention is not limited to this, and the face photographed image may be stored in the authentication application 157 or may be stored in an external server (not shown) or the like.

[0272] (Summary of Embodiment 2) According to the above description of Embodiment 2, at least the following techniques are disclosed. In the parentheses, corresponding components etc. in Embodiment 2 are exemplified, but the present invention is not limited thereto.

[0273] (Technique 18) A collation server (for example, the collation server 160) that collates a person's face includes a processor (for example, the processor 161) and a memory (for example, the memory 162). The processor receives first face image data acquired based on the face value information on the first side (for example, the front surface of the my number card 60) of the identity document (for example, the my number card 60) and a face photographed image generated by photographing the face of the target person (for example, the user 2), collates the first face image data with the face photographed image, and when the collation is successful, stores the face photographed image or the first face image data in the memory. Then, the processor receives second face image data acquired based on the face value information on the second side of the identity document, and collates the second face image data with the face photographed image or the first face image data stored in the memory.

[0274] Thus, when the collation between the first face image data obtained from the identity document and the face captured image of the target person is successful, the first face image data or the face captured image is saved. Then, the saved first face image data or face captured image is collated with the second face image data obtained from the identity document. As a result, for example, when the identity document is replaced after the collation between the first face image data and the face captured image of the target person, the collation between the saved first face image data or face captured image and the second face image data obtained from the identity document fails. In this way, by performing the collation twice, when each of the first side and the second side of the identity document is read, it is guaranteed that the identity document at the time of reading the first side and the identity document at the time of reading the second side are the same, so strict identity verification is realized.

[0275] (Technology 19) The identity verification system (for example, identity verification system 1A) includes a user terminal (for example, user terminal 150) and a collation server communicably connected to the user terminal. The user terminal includes a camera (for example, camera 154) that captures the face of the target person to generate a face captured image and captures the document surface of the identity document to generate a document captured image, obtains first face image data based on the document surface information obtained from the document captured image of the first side of the identity document, transmits the face captured image of the target person and the first face image data to the collation server, the collation server collates the first face image data and the face captured image, and when the collation is successful, transmits the collation result to the user terminal, saves the face captured image or the first face image data, and the user terminal, in response to obtaining the collation result from the collation server, transmits the second face image data obtained based on the document surface information obtained from the document captured image of the second side of the identity document to the collation server, and the collation server collates the second face image data with the saved face captured image or the first face image data.

[0276] As a result, the identity verification system obtains the same effect as that of Technology 18.

[0277] The functions of the various embodiments described above can also be realized by supplying a program and an application for realizing the functions of the various embodiments described above to a system or device using a network or a storage medium or the like, and having one or more processors in the computer of the system or device read and execute the program.

[0278] In addition, the functions of the various embodiments described above may be realized by a circuit (for example, an Application Specific Integrated Circuit (hereinafter referred to as "ASIC") or an FPGA) that realizes one or more functions.

[0279] As described above, the various embodiments according to the present disclosure have been described with reference to the drawings. Needless to say, the present disclosure is not limited to such examples. It is obvious that those skilled in the art can conceive of various modification examples, correction examples, substitution examples, addition examples, deletion examples, and equivalent examples within the scope described in the claims, and it is naturally understood that those also belong to the technical scope of the present disclosure. Further, within the scope not departing from the gist of the invention, the components in the various embodiments described above may be arbitrarily combined.

[0280] For example, in the various embodiments described above, identity verification is performed during the process of newly opening a bank account, and the personal number of the My Number card is obtained for associating the bank account with the personal number. However, in addition to newly opening a bank account, there may be a situation where strict identity verification for detecting the replacement of the My Number card and obtaining the personal number are required when the My Number card is replaced. For example, the present disclosure is applicable to various bank operations and procedures other than newly opening a bank account. Further, the present disclosure is similarly applicable not only to bank operations and procedures but also to, for example, administrative operations and procedures.

[0281] In addition, when linking personal identification documents other than the My Number card with the personal number of the My Number card, the present disclosure is similarly applicable. For example, when a terminal such as a smartphone is equipped with the function of a My Number card and the function of a personal identification document other than the My Number card such as a driver's license is installed on the terminal, the owner of the terminal can execute the linking of the personal identification document and the personal number by applying the present disclosure.

Industrial Applicability

[0282] The present disclosure is useful as a personal identification method, a personal identification system, a personal identification terminal, a collation server, and a program.

Explanation of Signs

[0283] 1, 1A Personal identification system 2 User 10 Personal identification terminal 11, 21, 31, 151, 161 Processor 12, 22, 32, 152, 162 Memory 13 Mounting part 14 IC card reader 15 Document photographing camera 16 Face photographing camera 17, 23, 155 Display device 18, 24, 153 Operating device 19, 25, 33, 156, 163 Communication device 20 Business terminal 30 Bank server 40 Signature verification server 50 Public authentication server 60 My Number card 61 IC chip 64 Two-dimensional barcode 70 Customer operation terminal 150 User terminal 154 Camera 157 Authentication application

Claims

1. A method for verifying the identity of a target person based on identity verification documents, obtaining first face image data based on the voucher information on the first side of the identity verification documents, comparing the first face image data with a face captured image generated by photographing the face of the target person, if the comparison is successful, saving the face captured image or the first face image data, obtaining second face image data based on the voucher information on the second side of the identity verification documents, comparing the second face image data with the saved face captured image or the first face image data, An identity verification method.

2. The identity verification documents are a My Number card, the voucher information on the first side is the date of birth, the Gregorian year of the expiration date, and the security code described on the first side, accessing the IC chip of the My Number card with the verification number B obtained based on the voucher information on the first side, obtaining the first face image data stored in the IC chip, The identity verification method according to Claim 1.

3. The identity verification documents are a My Number card, the voucher information on the second side is the two-dimensional barcode described on the second side, accessing the IC chip of the My Number card with the verification number A obtained based on the two-dimensional barcode, obtaining the second face image data stored in the IC chip, The identity verification method according to Claim 1.

4. Obtaining the first personal information stored in the IC chip simultaneously with the acquisition of the first face image data, The identity verification method according to Claim 2.

5. The first personal information includes name, gender, address, and date of birth, The identity verification method according to Claim 4.

6. Obtaining the second personal information stored in the IC chip simultaneously with the acquisition of the second face image data, The identity verification method according to Claim 3.

7. The second personal information includes a personal number, The identity verification method according to Claim 6.

8. The identity verification documents consist of a front side and a back side, the first side is the front side of the identity verification documents, and the second side is the back side of the identity verification documents, The identity verification method according to Claim 1.

9. When the identity verification documents when obtaining the first face image data and the identity verification documents when obtaining the second face image data are the same, the first face image data and the second face image data are the same data, The personal identification method according to claim 1.

10. When the face captured image is saved, after comparing the second face image data with the saved face captured image, delete the saved face captured image. The personal identification method according to claim 1.

11. When the comparison between the second face image data and the saved face captured image or the first face image data is successful, it is determined that the personal identification of the target person is successful. Cause the determination result to be displayed on a display device. The personal identification method according to claim 1.

12. When the comparison between the second face image data and the saved face captured image or the first face image data fails, it is determined that the personal identification of the target person fails. Cause the determination result to be displayed on a display device. The personal identification method according to claim 11.

13. A personal identification terminal that performs personal identification of a target person based on a personal identification document, A face capture camera that captures the face of the target person and generates a face captured image, A document capture camera that captures the face of the personal identification document and generates a document captured image, A processor, A memory, and is provided with The processor is Obtain first face image data based on the face information obtained from the document captured image of the first side of the personal identification document, Compare the first face image data with the face captured image, When the comparison is successful, save the face captured image or the first face image data in the memory, Obtain second face image data based on the face information obtained from the document captured image of the second side of the personal identification document, Compare the second face image data with the face captured image or the first face image data saved in the memory. Personal identification terminal.

14. A verification server that performs face verification of a person, A processor, A memory, and is provided with The processor is Receive the first face image data obtained based on the face information of the first side of the personal identification document and the face captured image generated by capturing the face of the target person, Compare the first face image data with the face captured image, When the comparison is successful, save the face captured image or the first face image data in the memory, Receive the second face image data obtained based on the face information of the second side of the personal identification document, Compare the second face image data with the face captured image or the first face image data saved in the memory. Verification server.

15. An identity verification system comprising an identity verification terminal for verifying the identity of a target person based on identity verification documents, and a business terminal communicably connected to the identity verification terminal, The identity verification terminal includes a face capture camera for capturing an image of the face of the target person to generate a face capture image, and a document capture camera for capturing an image of the face of the identity verification document to generate a document capture image, The identity verification terminal, in response to an instruction from the business terminal, Obtains first face image data based on the face information obtained from the document capture image of the first side of the identity verification document, Compares the first face image data with the face capture image, If the comparison is successful, the face capture image or the first face image data is stored in the memory, Obtains second face image data based on the face information obtained from the document capture image of the second side of the identity verification document, Compares the second face image data with the face capture image or the first face image data stored in the memory, Identity verification system.

16. An identity verification system comprising a user terminal and a verification server communicably connected to the user terminal, The user terminal, Includes a camera for capturing an image of the face of the target person to generate a face capture image and for capturing an image of the face of the identity verification document to generate a document capture image, Obtains first face image data based on the face information obtained from the document capture image of the first side of the identity verification document, Transmits the face capture image of the target person and the first face image data to the verification server, The verification server, Compares the first face image data with the face capture image, If the comparison is successful, transmits the comparison result to the user terminal and stores the face capture image or the first face image data, The user terminal, In response to obtaining the comparison result from the verification server, transmits second face image data obtained based on the face information obtained from the document capture image of the second side of the identity verification document to the verification server, The verification server, Compares the second face image data with the stored face capture image or the first face image data, Identity verification system.

17. An identity verification terminal for verifying the identity of a target person based on identity verification documents, Causes first face image data to be obtained based on the face information of the first side of the identity verification document, Causes the first face image data to be compared with a face capture image generated by capturing an image of the face of the target person, When the verification is successful, save the face captured image or the first face image data, obtain second face image data based on the voucher information on the second side of the personal identification document, and verify the second face image data with the saved face captured image or the first face image data, for a program.

18. Obtain a first number based on the voucher information on the first side obtained by photographing the first side of the personal identification document with a camera, obtain face image data and personal information of the target person who owns the personal identification document based on the first number, verify the face image data with a face captured image generated by photographing the face of the target person, when the verification is successful, save the first number, in a state where the camera can photograph the second side of the personal identification document, obtain the personal information of the target person who owns the personal identification document using the saved first number, verify the personal information of the target person obtained by the camera photographing the first side of the personal identification document with the personal information of the target person obtained in a state where the camera can photograph the second side of the personal identification document, A personal identification method.

19. Obtain a second number based on the voucher information on the second side obtained by photographing the second side of the personal identification document with a camera, obtain face image data and the personal number of the target person who owns the personal identification document based on the second number, verify the face image data with a face captured image generated by photographing the face of the target person, when the verification is successful, save the second number, in a state where the camera can photograph the first side of the personal identification document, obtain the personal number of the target person who owns the personal identification document using the saved second number, verify the personal number of the target person obtained by the camera photographing the second side of the personal identification document with the personal number of the target person obtained in a state where the camera can photograph the first side of the personal identification document, A personal identification method.

Images