Identity verification method, identity verification system, identity verification terminal, matching server and program

Abstract

To provide an identity verification method for detecting replacement of an identity verification document when a front side and a back side of the identity verification document are read.SOLUTION: An identity verification method of a target person on the basis of an identity verification document, includes: acquiring first face image data on the basis of document-surface information of a first side of the identity verification document; collating the first face image data with a face capture image generated by capturing a face of the target person; when the collation is successful, storing the face capture image or the first face image data; acquiring second face image data on the basis of document-surface information of a second side of the identity verification document; and collating the second face image data with the stored face capture image or first face image data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an identity verification method, an identity verification system, an identity verification terminal, a collation server, and a program.

Background Art

[0002] Patent Document 1 discloses an information display system in which a terminal and a server are connected. In the information display system of Patent Document 1, the terminal transmits first information read from the user's card and a captured face image of the user to the server. The server executes a face authentication process of the user based on the face image included in the first information transmitted from the terminal and the captured face image of the user. Further, when the user's face authentication is successful, the server acquires the user's second information and transmits the acquired second information to the terminal. Then, the terminal displays the second information transmitted from the server.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, the information read from the identity verification document may be associated with other information. At this time, in order to avoid associating information of a person different from the person who owns the identity verification document, it is necessary to confirm whether the information read from the identity verification document belongs to the person who owns the identity verification document.

[0005] For example, in various procedures at financial institutions, the need to link an account number with a personal number read from a My Number card has been increasing. However, the linking is currently done by manually entering the account number and the personal number into a terminal, which may lead to human errors such as linking with someone else's personal number or input mistakes.

[0006] Therefore, for example, when using a My Number card for identity verification and obtaining information (such as a personal number), it may be required to read the front and back surfaces of the My Number card without human intervention. When the front and back surfaces of such an identity verification document (such as a My Number card) are read, it is necessary to prevent the substitution of the identity verification document and prevent information of a person different from the person who owns the identity verification document from being used, for example, in information linking.

[0007] This disclosure was devised in view of the above-described conventional situation, and aims to detect the substitution of an identity verification document when the front and back surfaces of the identity verification document are read.

Means for Solving the Problem

[0008] This disclosure provides a method for verifying the identity of a target person based on an identity verification document, which includes obtaining first face image data based on the face value information of the first side of the identity verification document, comparing the first face image data with a face captured image generated by photographing the face of the target person, and if the comparison is successful, saving the face captured image or the first face image data. Then, obtaining second face image data based on the face value information of the second side of the identity verification document, and comparing the second face image data with the saved face captured image or the first face image data.

[0009] Furthermore, the present disclosure provides an identity verification terminal for verifying the identity of a target person based on identity verification documents, comprising a face capture camera for capturing the face of the target person to generate a face capture image, a document capture camera for capturing the face of the identity verification document to generate a document capture image, a processor, and a memory. The processor obtains first face image data based on the document surface information obtained from the document capture image of the first side of the identity verification document, compares the first face image data with the face capture image, and if the comparison is successful, stores the face capture image or the first face image data in the memory. The processor then obtains second face image data based on the document surface information obtained from the document capture image of the second side of the identity verification document, and compares the second face image data with the face capture image or the first face image data stored in the memory.

[0010] In addition, the present disclosure provides a verification server for verifying the face of a person, comprising a processor and a memory. The processor receives the first face image data obtained based on the document surface information of the first side of the identity verification document and the face capture image generated by capturing the face of the target person, compares the first face image data with the face capture image, and if the comparison is successful, stores the face capture image or the first face image data in the memory. The processor then receives the second face image data obtained based on the document surface information of the second side of the identity verification document, and compares the second face image data with the face capture image or the first face image data stored in the memory.

[0011] The present disclosure also provides a personal identification system including a personal identification terminal that performs personal identification of a target person based on personal identification documents, and a business terminal communicably connected to the personal identification terminal. The personal identification terminal includes a face camera that captures an image of the face of the target person to generate a face captured image, and a document camera that captures an image of the face side of the personal identification documents to generate a document captured image. The personal identification terminal acquires first face image data based on the face side information obtained from the document captured image of the first side of the personal identification documents in response to an instruction from the business terminal, compares the first face image data with the face captured image, and when the comparison is successful, stores the face captured image or the first face image data in the memory. Then, the personal identification terminal acquires second face image data based on the face side information obtained from the document captured image of the second side of the personal identification documents, and compares the second face image data with the face captured image or the first face image data stored in the memory.

[0012] The present disclosure also provides a personal identification system including a user terminal and a verification server communicably connected to the user terminal. The user terminal includes a camera that captures an image of the face of the target person to generate a face captured image, and captures an image of the face side of the personal identification documents to generate a document captured image. The user terminal acquires first face image data based on the face side information obtained from the document captured image of the first side of the personal identification documents, and transmits the face captured image of the target person and the first face image data to the verification server. The verification server compares the first face image data with the face captured image, and when the comparison is successful, transmits the comparison result to the user terminal, and stores the face captured image or the first face image data. In response to obtaining the comparison result from the verification server, the user terminal transmits second face image data acquired based on the face side information obtained from the document captured image of the second side of the personal identification documents to the verification server. The verification server compares the second face image data with the stored face captured image or the first face image data.

[0013] In addition, the present disclosure provides a program for causing an identity verification terminal that verifies the identity of a target person based on identity verification documents to obtain first face image data based on the face value information on the first side of the identity verification documents, compare the first face image data with a face captured image generated by photographing the face of the target person, and when the comparison is successful, save the face captured image or the first face image data, obtain second face image data based on the face value information on the second side of the identity verification documents, and compare the second face image data with the saved face captured image or the first face image data.

[0014] In addition, the present disclosure provides an identity verification method that obtains a first number based on the face value information on the first side obtained by photographing the first side of the identity verification documents with a camera, obtains face image data and personal information of a target person who owns the identity verification documents based on the first number, compares the face image data with a face captured image generated by photographing the face of the target person, and when the comparison is successful, saves the first number, obtains personal information of the target person who owns the identity verification documents using the saved first number when the camera is in a state where it can photograph the second side of the identity verification documents, and compares the personal information of the target person obtained by the camera photographing the first side of the identity verification documents with the personal information of the target person obtained when the camera is in a state where it can photograph the second side of the identity verification documents.

[0015] In addition, the present disclosure provides an identity verification method that obtains a second number based on the face value information on the second side obtained by photographing the second side of the identity verification documents with a camera, obtains face image data and the personal number of a target person who owns the identity verification documents based on the second number, compares the face image data with a face captured image generated by photographing the face of the target person, and when the comparison is successful, saves the second number, obtains the personal number of the target person who owns the identity verification documents using the saved second number when the camera is in a state where it can photograph the first side of the identity verification documents, and compares the personal number of the target person obtained by the camera photographing the second side of the identity verification documents with the personal number of the target person obtained when the camera is in a state where it can photograph the first side of the identity verification documents.

[0016] In addition, any combination of the above components, as well as those obtained by converting the expressions of the present disclosure among methods, devices, systems, storage media, computer programs, etc., are also effective as aspects of the present disclosure.

Advantages of the Invention

[0017] According to the present disclosure, when the front and back surfaces of an identity document are read, it is possible to detect the substitution of the identity document.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Mode for Carrying Out the Invention

[0019] Hereinafter, various embodiments specifically disclosing the personal identification method, personal identification system, personal identification terminal, collation server, and program according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, a more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and duplicate descriptions of substantially the same configurations may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and it is not intended to limit the subject matter described in the claims thereby.

[0020] (Embodiment 1) [System Configuration] FIG. 1 is a block diagram showing a configuration example of the personal identification system 1 according to Embodiment 1.

[0021] The personal identification system 1 according to Embodiment 1 is premised on being introduced into a bank. The personal identification system 1 is a system that uses the personal identification terminal 10 and the My Number card 60 (see FIG. 3) to identify the identity of a customer who newly opens an account and to associate various information of the customer with the newly opened account. Hereinafter, the customer may sometimes be referred to as a user.

[0022] Note that the My Number card 60 is an example of an identity document, and the present embodiment is not limited to the My Number card 60. For example, a smartphone equipped with an application corresponding to the My Number card 60 is also an example of an identity document, and the content of the present embodiment is also applicable to such a smartphone.

[0023] The identity verification system 1 includes an identity verification terminal 10, a business terminal 20, a bank server 30, a signature verification server 40, a public certification server 50, and a customer operation terminal 70. The identity verification terminal 10 and the business terminal 20 are connected via an electrical cable such as a Local Area Network (hereinafter referred to as "LAN") cable and / or a Universal Serial Bus (hereinafter referred to as "USB") cable, for example, and can transmit and receive information to and from each other. Alternatively, the identity verification terminal 10 and the business terminal 20 may be connected via wireless communication such as a wireless LAN or Bluetooth (registered trademark). The same applies to the connections between the identity verification terminal 10 and the customer operation terminal 70, the business terminal 20 and the bank server 30, the business terminal 20 and the signature verification server 40, and the signature verification server 40 and the public certification server 50.

[0024] The identity verification terminal 10 performs the identity verification process of the user 2 using the My Number card 60. In the identity verification system 1 introduced in the bank, the identity verification terminal 10 is used, for example, when the user 2 newly opens a bank account.

[0025] The identity verification terminal 10 includes a processor 11, a memory 12, a mounting unit 13, an Integrated Circuit (hereinafter referred to as "IC") card reader 14, a document photographing camera 15, a face photographing camera 16, a display device 17, an operating device 18, and a communication device 19.

[0026] The processor 11 realizes the functions of the personal identification terminal 10 by executing a computer program stored in the memory 12. Note that the processor 11 may be read as other terms such as a controller, a Central Processing Unit (hereinafter referred to as "CPU"), and a control unit.

[0027] The memory 12 is a storage area for storing and holding a computer program for realizing the functions of the personal identification terminal 10 and various types of data and the like. The memory 12 is composed of, for example, a non-volatile storage area, Read Only Memory (hereinafter referred to as "ROM"), a Hard Disk Drive (hereinafter referred to as "HDD"), and a volatile storage area, Random Access Memory (hereinafter referred to as "RAM"). In this specification, the expressions "store" and "save" are used as being synonymous with each other. However, in this specification, the expression "save" may be used to emphasize that when data or information or the like is saved (that is, stored), the data or information or the like is read out in later processing.

[0028] The placement unit 13 is a part where the My Number card 60 is placed.

[0029] The IC card reader 14 reads the data stored in the IC chip 61 of the My Number card 60 placed on the placement unit 13 in a non-contact manner. For example, the IC card reader 14 reads the data stored in the IC chip 61 by a Near Field Communication (hereinafter referred to as "NFC") method.

[0030] The document photographing camera 15 photographs the face of the My Number card 60 placed on the placement unit 13 and generates a "document photographed image".

[0031] The face photographing camera 16 photographs the face of the user 2 and generates a "face photographed image".

[0032] The display device 17 displays information related to the authentication process by the user authentication terminal 10. Examples of the display device 17 include a liquid crystal display, an organic Electro Luminescence (hereinafter referred to as "EL") display, and the like.

[0033] The operation device 18 receives operations from the user 2. Note that the display device 17 and the operation device 18 may be an integrated device such as a touch panel display.

[0034] The communication device 19 controls the transmission and reception of various data with the business terminal 20 and the customer operation terminal 70.

[0035] The business terminal 20 transmits an instruction to the user authentication terminal 10 to perform user authentication of the user 2. The business terminal 20 is operated by, for example, a bank clerk and executes linking a newly opened account with the personal information of the user 2.

[0036] The business terminal 20 includes a processor 21, a memory 22, a display device 23, an operation device 24, and a communication device 25. Examples of the business terminal 20 include a personal computer and the like.

[0037] The processor 21 realizes the functions of the business terminal 20 by executing a program in cooperation with the memory 22. Note that the processor 21 may be read as other terms such as a controller, a CPU, and a control unit.

[0038] The memory 22 is a storage area for storing and holding a computer program and various data for realizing the functions of the business terminal 20. The memory 22 is composed of, for example, a non-volatile storage area such as a ROM and an HDD, and a volatile storage area such as a RAM.

[0039] The display device 23 displays information related to account opening processing and user authentication processing. Examples of the display device 23 include a liquid crystal display, an organic EL display, and the like.

[0040] The operation device 24 receives operations from, for example, bank staff. Note that the display device 23 and the operation device 24 may be an integrated device such as a touch panel display.

[0041] The communication device 25 controls the transmission and reception of various data with the personal identification terminal 10, the bank server 30, and the signature verification server 40.

[0042] The bank server 30 stores and manages the information of the created account. Examples of the bank server 30 include a server computer.

[0043] The bank server 30 includes a processor 31, a memory 32, and a communication device 33.

[0044] The processor 31 realizes the functions of the bank server 30 by executing a program in cooperation with the memory 32. Note that the processor 31 may be read as other terms such as a controller, a CPU, or a control unit.

[0045] The memory 32 is a storage area for storing and holding a computer program for realizing the functions of the bank server 30 and various types of data. The memory 32 is composed of, for example, a non-volatile storage area such as a ROM, an HDD, and a volatile storage area such as a RAM.

[0046] The communication device 33 controls the transmission and reception of various data with the business terminal 20.

[0047] The signature verification server 40 and the public certification server 50 acquire the signature electronic certificate of the My Number card 60 and determine the validity of the My Number card 60. Note that in this embodiment, the signature verification server 40 and the public certification server 50 may be omitted.

[0048] The customer operation terminal 70 is a terminal for User 2 to communicate with bank staff or the like. Examples of the customer operation terminal 70 include a personal computer or the like. Note that in the present embodiment, the customer operation terminal 70 may be omitted.

[0049] [My Number Card] FIG. 2 is a table diagram showing the main information of the My Number Card 60. FIG. 3 is a schematic diagram showing an example of the front and back sides of the My Number Card 60. Hereinafter, the front and back sides of the My Number Card 60 may be referred to as the first side and the second side, respectively.

[0050] On the front surface of the My Number Card 60, as shown in FIG. 3, at least the name, address, date of birth, gender, security code, and expiration date are printed as character information 63 (see FIG. 3). The information including the name, address, date of birth, and gender is also called the four-information. In the present embodiment, the four-information and the personal number described later may be referred to as personal information. Further, hereinafter, the information including the four-information may be referred to as the first personal information. Also, the information including the personal number may be referred to as the second personal information. Further, a face photo 62 is printed on the front surface of the My Number Card 60.

[0051] The My Number Card 60 is non-contact readable and has a secure IC chip 61. The personal information of the owner of the My Number Card 60 is stored in the IC chip 61.

[0052] At least the name, address, date of birth, gender, face image data, and personal number are stored in the IC chip 61 of the My Number Card 60. The face image data is image data generated by photographing the face of the owner of the My Number Card 60.

[0053] The My Number Card 60 has at least a verification number A, a verification number B, an electronic certificate PIN for signature, a PIN for user certificate, a PIN for assisting in inputting the face value items, and a PIN for the basic resident register as information used for access control to the IC chip 61. "PIN" is an abbreviation for Personal Identification Number. Hereinafter, the verification number B may be referred to as the first number. Also, the verification number A may be referred to as the second number.

[0054] The verification number A is obtained when the two-dimensional barcode 64 printed on the back of the My Number Card 60 is read. By using the verification number A, access can be made to the personal number and face image data stored in the IC chip 61 of the My Number Card 60. That is, by reading the two-dimensional barcode 64 printed on the back of the My Number Card 60, access can be made to the personal number and face image data stored in the IC chip 61 of the My Number Card 60.

[0055] The verification number B is a number obtained by combining 6 digits of the date of birth, 4 digits of the Gregorian calendar part of the expiration date, and 4 digits of the security code, which are printed on the front surface of the My Number Card 60. By using the verification number B, access can be made to the four pieces of information and face image data stored in the IC chip 61 of the My Number Card 60. That is, by obtaining the verification number B printed on the front surface of the My Number Card 60, access can be made to the four pieces of information and face image data stored in the IC chip 61 of the My Number Card 60.

[0056] Note that the above-mentioned My Number Card 60 is just an example. If the specifications of the My Number Card 60 are changed, various information possessed by the My Number Card 60 will be read based on the changed specifications. For example, the gender may not be described on the face of the My Number Card 60. In this case, by using the collation number B, the three pieces of information excluding the gender and the face image data may be obtained from the IC chip 61. Further, the collation number B may be a number with a predetermined number of digits different from the 14-digit number obtained by combining the above six digits of the date of birth, the four digits of the Gregorian calendar part of the expiration date, and the four digits of the security code. In this case, the number with the predetermined number of digits read based on the specifications of the My Number Card 60 may be used as the collation number B.

[0057] Hereinafter, the information printed on the face of the My Number Card 60 may be referred to as face information.

[0058] [Application of My Number Card] FIG. 4 is a table diagram for explaining the outline of the application of the My Number Card 60. Hereinafter, the application may be referred to as AP.

[0059] As shown in FIG. 4, four applications shown in the following (B1) to (B4) are registered in the IC chip 61 of the My Number Card 60 in general.

[0060] (B1) Face Application (Face AP) In the Face AP, image data of surface information (four pieces of information (address, name, date of birth, gender) + face photo) and back surface information (personal number) are recorded.

[0061] (B2) Electronic Certificate Application by Public Personal Authentication Service (JPKI-AP) In the JPKI-AP, information on the "electronic certificate for signature" and the "electronic certificate for user" is recorded.

[0062] (B3) Face Item Input Assistance Application (Face Item Input Assistance AP) In the voucher details input assistance AP, when conducting transactions using the personal number and the four pieces of information, information for using the personal number and the four pieces of information as text data is recorded. The information to be recorded or used is as follows. (1) Personal number and the four pieces of information (as well as their electronic signature data) (2) Personal number (as well as its electronic signature data) (3) The four pieces of information (as well as their electronic data)

[0063] (B4) Resident basic application (Resident basic AP) In the Resident basic AP, information for using the resident register code as text data is recorded during resident basic network-related transactions.

[0064] When using (2) or (3) in the voucher AP or the voucher details input assistance AP, it is available based on the verification number based on the information described on the voucher. However, for the two electronic certificates of JPKI-AP, (1) of the voucher details input assistance AP, and when using the Resident basic AP, the password set at the time of issuing the My Number Card 60 is used. That is, by using the voucher details input assistance PIN, it is possible to access the four pieces of information and the personal number stored in the IC chip 61 of the My Number Card 60. Hereinafter, the voucher details input assistance PIN may be referred to as the PIN code or the password.

[0065] [Operation] With reference to Fig. 5, the process of newly opening the bank account of user 2 using the personal verification system 1 will be described. Fig. 5 is a conceptual diagram for opening an account using the personal verification system 1 according to Embodiment 1.

[0066] User 2 applies to the bank for opening a new account. Then, regarding whether to associate the newly opened account with the personal number of user 2, the intention of user 2 is confirmed. Thereafter, the personal verification process of user 2 using the My Number Card 60 is performed.

[0067] When linking an account with a personal number is necessary, the identity verification process is carried out in two stages: Phase 1 and Phase 2. The identity verification terminal 10 obtains the personal number in the Phase 2 process. Also, when the identity verification process is carried out in two stages, that is, even when the front and back surfaces of the My Number Card 60 are read, the replacement of the My Number Card 60 can be detected, so strict identity verification is realized. The details of the process will be described later with reference to FIGS. 7 and 8.

[0068] Even when linking an account with a personal number is not necessary, the identity verification process is still carried out. In this case, the identity verification process corresponds to the Phase 1 process of the identity verification process when linking an account with a personal number is necessary.

[0069] After that, the signature verification server 40 and the public authentication server 50 perform the determination of the validity of the My Number Card 60, in other words, the public authentication process. When it is confirmed that the My Number Card 60 is valid, an account is opened. Note that the public authentication process may be omitted.

[0070] After that, the opened account is stored and managed by the bank server 30.

[0071] In the following description, attention is paid to the case where linking an account with a personal number is necessary.

[0072] Next, with reference to FIG. 6, an operation example of the identity verification terminal 10, the business terminal 20, and the bank server 30 related to the opening of a new account will be described. FIG. 6 is a sequence diagram showing an operation example of the identity verification system 1 according to Embodiment 1.

[0073] The business terminal 20 receives an application for opening a new account by the user 2 and a request for linking an account with a personal number (step St80). Specifically, for example, a bank clerk who has confirmed the application for opening a new account by the user 2 and the intention to link an account with a personal number operates the business terminal 20.

[0074] When the business terminal 20 receives a request for opening a new account and associating an account with a personal number in step St80, it sends a personal information acquisition request and an identity verification request to the identity verification terminal 10 (step St81). The personal information acquisition request is a request to acquire the personal information of user 2 who newly opens an account. The identity verification request is a request to perform an identity verification process for user 2 who newly opens an account.

[0075] When the identity verification terminal 10 receives the personal information acquisition request and the identity verification request sent from the business terminal 20 in step St81, it accepts the selection of an authentication method (step St82). The details of this process will be described in steps St100 to St101 of FIG. 7.

[0076] The identity verification terminal 10 executes an identity verification process using the authentication method accepted in step St82 (step St83). The details of this process will be described in steps St102 to St113 of FIG. 7 and steps St114 to St132 of FIG. 8.

[0077] When the identity verification terminal 10 succeeds in the identity verification process in step St83, it sends the personal information to the business terminal 20 (step St84).

[0078] When the business terminal 20 receives the personal information of user 2 sent from the identity verification terminal 10, it creates a new account number and sends an account number creation completion notification to the identity verification terminal 10 (step St85). The account number creation completion notification notifies that the creation of the account number is completed. Although not shown in FIG. 6, when the identity verification process fails, the business terminal 20 may, for example, display a message indicating that the identity verification process has failed on the display device 23.

[0079] Also, when the public authentication process is performed, the business terminal 20 may, for example, send a request to obtain an electronic certificate for signature to the personal confirmation terminal 10 before the process of step St85. In this case, the personal confirmation terminal 10 obtains the electronic certificate for signature from the My Number card 60 and sends it to the business terminal 20. The business terminal 20 sends the electronic certificate for signature required for signature to the public authentication server 50 via the signature verification server 40. The public authentication server 50 determines the validity of the My Number card 60 and sends the determination result to the business terminal 20 via the signature verification server 40. Then, when the business terminal 20 receives the result that the My Number card 60 is valid, it proceeds to the process of step St85.

[0080] When the personal confirmation terminal 10 receives the account number creation completion notice sent from the business terminal 20, it deletes various personal information obtained during the personal confirmation process (step St86).

[0081] The business terminal 20 associates the newly created account number with the personal information of User 2 (step St87).

[0082] The business terminal 20 newly registers the account and sends the information of the account to the bank server 30 (step St88). Here, registering an account means finalizing the opening of the account.

[0083] The bank server 30 receives and stores the account information sent from the business terminal 20 (step St89).

[0084] Next, with reference to FIGS. 7 and 8, the authentication process of user 2 by the personal authentication terminal 10 will be described. FIG. 7 is a flowchart showing an operation example of the personal authentication terminal 10 according to Embodiment 1. FIG. 8 is a flowchart showing an operation example of the personal authentication terminal 10 following FIG. 7. "A" and "B" shown in the respective flowcharts of FIGS. 7 and 8 represent the connection of the respective flowcharts of FIGS. 7 and 8. Also, at the start of the flowchart shown in FIG. 7, the personal authentication terminal 10 has received a personal information acquisition request and an authentication request transmitted from the business terminal 20. Note that the personal authentication document in the figure refers to the My Number card 60.

[0085] The processor 11 of the personal authentication terminal 10 displays an instruction to place the My Number card 60 for user 2 on the display device 17 (step St100). An example of the display screen will be described later with reference to FIG. 9. For convenience of explanation, it is assumed that user 2 has placed the My Number card 60 on the placement unit 13. Also, at this time, it is assumed that the document photographing camera 15 can photograph the surface of the My Number card 60.

[0086] The processor 11 receives a selection of an authentication method by user 2 (step St101). Note that a screen for user 2 to select an authentication method may be displayed on the display device 17 (see FIG. 9).

[0087] The processor 11 determines whether the authentication method selected by user 2 is either face authentication or password input (step St102).

[0088] When the authentication method selected by user 2 is password input (step St102; password input), the process of the personal authentication terminal 10 proceeds to step St128, and the personal authentication process by password input is performed.

[0089] First, the case where the authentication method selected by user 2 is face authentication (step St102; face authentication) will be described.

[0090] The document photographing camera 15 of the personal identification terminal 10 photographs the face of the personal identification document and generates a document photographed image (step St103).

[0091] The processor 11 performs Optical Character Recognition (hereinafter referred to as "OCR") on the document photographed image, and acquires the collation number B using the character information 63 detected by OCR (step St104).

[0092] The processor 11 determines whether or not the collation number B could be acquired in the process of step St104 (step St105).

[0093] If the processor 11 could not acquire the collation number B in the process of step St104 (step St105; NO), the process proceeds to step St128, and the personal identification process by input of the PIN is executed. At this time, for example, a screen instructing the user 2 to input the PIN may be displayed on the display device 17.

[0094] If the processor 11 could acquire the collation number B (step St105; YES), the processor 11 accesses the IC chip 61 of the My Number card 60 using the collation number B as an access key (step St106).

[0095] If the processor 11 could not access the IC chip 61 (step St107; NO), the process proceeds to step St128, and the personal identification process by input of the PIN is executed. At this time, for example, a screen instructing the user 2 to input the PIN may be displayed on the display device 17.

[0096] If the processor 11 could access the IC chip 61 (step St107; YES), the processor 11 reads out and acquires the 4 information and the face image data from the IC chip 61 (step St108).

[0097] When the processor 11 fails to acquire the four pieces of information and the face image data (step St109; NO), the process proceeds to step St128, and the identity verification process by inputting the password is executed. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0098] When the processor 11 has acquired the four pieces of information and the face image data (step St109; YES), the face camera 16 captures the face of the user 2 and generates a face captured image (step St110).

[0099] The processor 11 collates the face captured image of the user 2 generated in step St110 with the face image data acquired in step St108 (step St111). The collation between the face captured image and the face image data may be performed, for example, by comparing face feature amounts.

[0100] When the processor 11 fails in the collation between the face captured image of the user 2 and the face image data (step St112; NO), the process proceeds to step St128, and the identity verification process by inputting the password is executed. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0101] When the processor 11 succeeds in the collation between the face captured image of the user 2 and the face image data (step St112; YES), the processor 11 causes the display device 17 to display the collation result (step St113).

[0102] The processes from step St103 to step St113, that is, the series of processes surrounded by the broken line shown in FIG. 7, correspond to Phase 1 of the identity verification process shown in FIG. 5. In Phase 1, the identity verification terminal 10 verifies the identity of the user 2 by collating the face image data acquired from the IC chip 61 of the My Number card 60 using the collation number B as an access key with the face captured image generated by photographing the face of the user 2.

[0103] Subsequently, the processes after step St114 will be described.

[0104] The processor 11 stores the face capture image of user 2 generated in step St110 (step St114). The face capture image may be stored in, for example, the memory 12.

[0105] The processor 11 causes the display device 17 to display an instruction to turn over the my number card 60 (step St115). An example of the display screen will be described later with reference to FIG. 9. For convenience of explanation, it is assumed that user 2 turns over the my number card 60 and places it on the placement unit 13. At this time, the document capture camera 15 is in a state where it can capture the back surface of the my number card 60.

[0106] The document capture camera 15 reads the two-dimensional barcode 64 of the my number card 60 (step St116).

[0107] The processor 11 acquires the collation number A from the two-dimensional barcode 64 read by the document capture camera 15 in step St116 (step St117).

[0108] When the processor 11 cannot acquire the collation number A (step St117; NO), the process proceeds to step St128, and the identity verification process by input of the password is executed. At this time, for example, a screen instructing user 2 to input the password may be displayed on the display device 17.

[0109] When the processor 11 can acquire the collation number A (step St117; YES), the processor 11 accesses the IC chip 61 of the my number card 60 using the collation number A as an access key (step St118).

[0110] When the processor 11 cannot access the IC chip 61 (step St120; NO), the process proceeds to step St128, and the identity verification process by input of the password is executed. At this time, for example, a screen instructing user 2 to input the password may be displayed on the display device 17.

[0111] When the processor 11 can access the IC chip 61 (step St120; YES), the processor 11 reads and obtains the personal number and the face image data from the IC chip 61 (step St121).

[0112] When the processor 11 cannot obtain the personal number and the face image data (step St122; NO), the processor 11 advances the process to step St128 and executes the authentication process by inputting the password. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0113] When the processor 11 can obtain the personal number and the face image data (step St122; YES), the processor 11 reads the face captured image saved in step St114 (step St123).

[0114] The processor 11 collates the face captured image of the user 2 read in step St123 with the face image data obtained in step St121 (step St124).

[0115] When the collation between the face captured image of the user and the face image data fails (step St125; NO), the processor 11 advances the process to step St128 and executes the authentication process by inputting the password. At this time, for example, a screen instructing the user 2 to input the password may be displayed on the display device 17.

[0116] When the collation between the face captured image of the user and the face image data succeeds (step St125; YES), the processor 11 causes the display device 17 to display the collation result (step St126).

[0117] The processing from step St114 to step St126, that is, the series of processing enclosed by the dashed line shown in FIG. 8, corresponds to Phase 2 of the identity verification processing shown in FIG. 5. In Phase 2, the identity verification terminal 10 verifies the identity of user 2 by collating the face image data acquired from the IC chip 61 of the My Number card 60 using the collation number A as an access key and the face captured image generated by capturing the face of user 2 in Phase 1.

[0118] After step St126, the processor 11 causes the display device 17 to display that the identity verification has been successful and completed (step St127). Then, this processing flow ends.

[0119] Next, the identity verification processing by inputting a PIN will be described.

[0120] The processor 11 causes the display device 17 to display a PIN input screen (step St128). An example of the display screen will be described later with reference to FIG. 9.

[0121] The processor 11 accepts the input of the PIN by user 2 (step St129). For the sake of convenience of explanation, it is assumed that the PIN input in step St129 is the correct PIN.

[0122] The processor 11 accesses the IC chip 61 of the My Number card 60 using the PIN input in step St129 as an access key (step St130).

[0123] The processor 11 reads and acquires four pieces of information and the personal number from the IC chip 61 (step St131). For the sake of convenience of explanation, it is assumed that the processor 11 has acquired four pieces of information and the personal number.

[0124] The processor 11 causes the display device 17 to display that the reading has been successful (step St132). Then, the processor 11 advances the processing to step St127.

[0125] In this way, when the identity verification terminal 10 collates the face image data obtained based on the collation number B with the face photographed image of the user 2 and succeeds in the collation, the face photographed image is saved. Then, after the My Number Card 60 is turned over, the identity verification terminal 10 collates the face image data obtained based on the collation number A with the saved face photographed image, and if the collation is successful, it determines that the identity verification of the user 2 has succeeded. When the My Number Card 60 is turned over, if the My Number Card 60 is replaced with another My Number Card, the collation between the face image data obtained based on the collation number A and the saved face photographed image fails. Therefore, by performing the identity verification process with two-step authentication in this way, if the replacement of the My Number Card 60 occurs, the replacement can be detected, so strict identity verification is realized.

[0126] In addition, the various types of information that the identity verification terminal 10 deletes in step St86 shown in FIG. 6 are the face photographed image, four types of information, face image data, and personal number obtained during the identity verification process.

[0127] Note that when the identity verification terminal 10 cannot obtain the collation number B or the collation number A, when it cannot access the IC chip 61, when it cannot obtain various types of information (four types of information, face image data, and personal number) from the IC chip 61, or when the face collation fails, it may determine that the identity verification process has failed. In this case, the identity verification terminal 10 may notify the business terminal 20 of the failure of the identity verification process together with the content of the step of the failed process. Further, when the identity verification terminal 10 determines that the identity verification process has failed, it may display the determination result on the display device 17.

[0128] In addition, in the personal identification process using face authentication, for example, when face matching fails, an example of shifting to the personal identification process by entering a password was described. However, in the personal identification process by entering a password, there may be a case where User 2 fails to authenticate because they have forgotten the PIN code, that is, the password, and cannot access the IC chip 61 of the My Number card 60. In this case, a bank clerk may perform corresponding operations such as personal identification of User 2 in person or via the customer operation terminal 70. Also, in this case, it may be displayed on the display device 17 of the personal identification terminal 10 and the display device 23 of the business terminal 20 that individual corresponding operations by the bank clerk are being performed.

[0129] In addition, in order to explain the personal identification process in two phases, Phase 1 and Phase 2, the display of the matching result in step St113 and the display of the instruction to turn over the My Number card 60 in step St115 were explained in separate steps, but these displays may be performed at the same timing.

[0130] Also, when the association of the personal number is not required, Phase 2 of the personal identification process is not performed. In this case, the process of the personal identification terminal 10 proceeds from step St113 to step St127.

[0131] [Display Screen] FIG. 9 is a schematic diagram for explaining an example of the display screen of the personal identification terminal 10 according to Embodiment 1. In step St100 shown in FIG. 7, an instruction prompting to place the My Number card 60 on the placement unit 13 may be displayed, as in the example of the screen 140.

[0132] In step St101 shown in FIG. 7, a screen for User 2 to select either face authentication or password input as the authentication method may be displayed, as in the example of the screen 141.

[0133] When the authentication method is face authentication, a screen indicating that various information is being read from the IC chip 61 of the My Number Card 60 may be displayed as in the example of screen 142. For example, screen 142 may be displayed during the processes from step St103 to step St109 shown in FIG. 7.

[0134] When the face photographing camera 16 photographs the face of the user 2 in step St110 shown in FIG. 7, a screen during photographing may be displayed as in the example of screen 143.

[0135] For the sake of convenience of explanation, it is assumed that face verification has succeeded (step St112 shown in FIG. 7; YES). Also, in the process of step St113 shown in FIG. 7, the verification result is displayed on the display device 17, but is omitted in FIG. 9.

[0136] When it is necessary to link the account and the personal number, the identity verification process proceeds from Phase 1 shown in FIGS. 5 and 7 to Phase 2 shown in FIGS. 5 and 8. That is, the back surface of the My Number Card 60 is read. In step St115 shown in FIG. 8, an instruction prompting the user to turn over the My Number Card 60 may be displayed as in the example of screen 144.

[0137] A screen indicating that reading is in progress, such as screen 145, may be displayed, for example, during the processes from step St116 to step St125 shown in FIG. 8.

[0138] For the sake of convenience of explanation, it is assumed that face verification has succeeded (step St125 shown in FIG. 8; YES). Also, in the process of step St126 shown in FIG. 8, the verification result is displayed on the display device 17, but is omitted in FIG. 9.

[0139] In step St127 shown in FIG. 8, a screen indicating that the identity verification has been completed may be displayed as in the example of screen 146.

[0140] Note that when it is not necessary to link the account and the personal number, the back surface of the My Number Card 60 is not read.

[0141] When the authentication method is the input of a password, a screen for the user 2 to input the password may be displayed as in the example of screen 147. This corresponds to step St128 shown in FIG. 8.

[0142] For example, while various information is being read from the IC chip 61 in steps St130 and St131 shown in FIG. 8, a screen indicating that reading is in progress, such as screen 148, may be displayed.

[0143] (Modification Example of Embodiment 1) In the above-described Embodiment 1, when the personal identification terminal 10 successfully matched the face image data acquired based on the collation number B with the face photographed image of the user 2, the face photographed image was saved. Then, the personal identification terminal 10 collated the face image data acquired based on the collation number A with the saved face photographed image. However, the present invention is not limited to this. When the personal identification terminal 10 successfully matches the face image data acquired based on the collation number B with the face photographed image of the user 2, the face image data may be saved. In this case, the personal identification terminal 10 may collate the face image data acquired based on the collation number A with the saved face image data. This is because as long as the my number card 60 placed on the placement unit 13 is not replaced with another my number card during the personal identification process, the face image data acquired based on the collation number B and the face image data acquired based on the collation number A should be the same face image data.

[0144] Also, the identity verification terminal (e.g., identity verification terminal 10) may obtain a first number (e.g., verification number B) based on the face value information on the first side (e.g., the front surface of the My Number Card 60) of the identity verification document (e.g., My Number Card 60). Then, the identity verification terminal may obtain first face image data and first personal information (e.g., name) based on the first number. Then, the identity verification terminal may compare the first face image data with a face captured image generated by photographing the face of the target person (e.g., User 2). Then, if the comparison is successful, the identity verification terminal may save the first personal information and the first number. Then, the identity verification terminal may use the saved first number to obtain the first personal information from the identity verification document in a state where the camera (e.g., document photographing camera 15) can photograph the second side (e.g., the back surface of the My Number Card 60) of the identity verification document. Then, the identity verification terminal may compare the saved first personal information with the first personal information obtained in a state where the camera can photograph the second side of the identity verification document. Then, if the comparison is successful, the identity verification terminal may determine that the identity verification document has not been replaced. Then, the identity verification terminal may determine that the identity verification has been successful.

[0145] For example, when the identity verification terminal 10 successfully matches the face image data obtained based on the verification number B with the face captured image of the user 2, the verification number B and the name among the four pieces of information obtained based on the verification number B may be saved. In this case, the identity verification terminal 10 is in a state where the My Number Card 60 is turned over, in other words, in a state where the document imaging camera 15 can image the back surface of the My Number Card 60. Using the saved verification number B as an access key, it may access the IC chip 61 of the My Number Card 60 and obtain the name among the four pieces of information from the IC chip 61. The identity verification terminal 10 may determine whether the name obtained using the verification number B in a state where the My Number Card 60 is not turned over, that is, in a state where the document imaging camera 15 can image the front surface of the My Number Card 60, matches the name obtained using the verification number B in a state where the My Number Card 60 is turned over, that is, in a state where the document imaging camera 15 can image the back surface of the My Number Card 60. Then, when the two obtained names match, the identity verification terminal 10 may determine that the My Number Card 60 has not been replaced and that the identity verification has been successful. Although the name among the four pieces of information has been used as an example for explanation, the address, date of birth, or gender among the four pieces of information may be obtained by the identity verification terminal 10 in a state where the document imaging camera 15 can image the front surface of the My Number Card 60 and in a state where it can image the back surface, and may be used for verification for identity confirmation.

[0146] In addition, the identity verification terminal (for example, identity verification terminal 10) may obtain a first number (for example, verification number B) based on the coupon surface information on the first side (for example, the front surface of the My Number Card 60) of the identity verification document (for example, My Number Card 60). Then, the identity verification terminal may obtain first face image data based on the first number. Then, the identity verification terminal may compare the first face image data with a face captured image generated by photographing the face of the target person (for example, user 2). Then, when the comparison is successful, the identity verification terminal may save the first face image data and the first number. Then, with the camera (for example, document photographing camera 15) being able to photograph the second side (for example, the back surface of the My Number Card 60) of the identity verification document, the identity verification terminal may obtain second face image data from the identity verification document using the saved first number. Then, the identity verification terminal may compare the saved first face image data with the second face image data. Then, when the comparison is successful, the identity verification terminal may determine that the identity verification document has not been replaced. Then, the identity verification terminal may determine that the identity verification has been successful.

[0147] For example, when the comparison between the face image data obtained based on verification number B and the face captured image of user 2 is successful, the identity verification terminal 10 may save verification number B and the face image data. In this case, with the My Number Card 60 turned over, that is, with the document photographing camera 15 being able to photograph the back surface of the My Number Card 60, the identity verification terminal 10 may access the IC chip 61 of the My Number Card 60 using the saved verification number B as an access key and obtain face image data from the IC chip 61. The identity verification terminal 10 may compare the face image data obtained using verification number B in a state where the My Number Card 60 is not turned over, that is, in a state where the document photographing camera 15 can photograph the front surface of the My Number Card 60, with the face image data obtained using verification number B in a state where the My Number Card 60 is turned over, that is, in a state where the document photographing camera 15 can photograph the back surface of the My Number Card 60. Then, when the face comparison is successful, the identity verification terminal 10 may determine that the My Number Card 60 has not been replaced and that the identity verification has been successful.

[0148] Further, the personal identification terminal (e.g., the personal identification terminal 10) may obtain a first number (e.g., the collation number B) based on the face value information on the first side (e.g., the front surface of the My Number card 60) of the personal identification document (e.g., the My Number card 60). Then, the personal identification terminal may obtain first face image data based on the first number of the personal identification document. Then, the personal identification terminal may collate the first face image data with a face captured image generated by photographing the face of the target person (e.g., the user 2). Then, when the collation is successful, the personal identification terminal may save the first number. Then, the personal identification terminal may access the IC chip (e.g., the IC chip 61) of the personal identification document using the saved first number in a state where the camera (e.g., the document photographing camera 15) can photograph the second side (e.g., the back surface of the My Number card 60) of the personal identification document. Then, when the access is successful, the personal identification terminal may determine that the personal identification document has not been replaced.

[0149] For example, if the My Number Card 60 is replaced with another My Number Card at the timing when the My Number Card 60 is turned over, even if the personal identification terminal 10 has stored the collation number B, it cannot access the IC chip of the other My Number Card using the collation number B as an access key. Therefore, the personal identification terminal 10 may determine whether the My Number Card 60 has not been replaced with another My Number Card as follows. That is, the personal identification terminal 10 accesses the IC chip 61 of the My Number Card 60 to obtain the collation number B, and if the collation of the face image data obtained based on the collation number B and the face photographed image of the user 2 is successful, the personal identification terminal 10 may store the collation number B. Then, when the document photographing camera 15 can photograph the back surface of the My Number Card 60 and can access the IC chip 61 of the My Number Card 60 using the collation number B obtained when the document photographing camera 15 can photograph the front surface of the My Number Card 60 as an access key, the personal identification terminal 10 may determine that the My Number Card 60 has not been replaced. When the document photographing camera 15 can photograph the back surface of the My Number Card 60 and can access the IC chip 61 of the My Number Card 60 using the collation number B obtained when the document photographing camera 15 can photograph the front surface of the My Number Card 60 as an access key, the personal identification terminal 10 may determine that the My Number Card 60 has been replaced.

[0150] Also, in the identity verification process, the order of reading the front and back surfaces of the My Number Card 60 may be reversed. In this case, when the identity verification terminal 10 successfully matches the face image data obtained based on the verification number A with the face photographed image of the user 2, the face photographed image may be saved. Then, the identity verification terminal 10 may match the face image data obtained based on the verification number B with the saved face photographed image. Further, when the back surface of the My Number Card 60 is read before the front surface in this way, the verification number A may be saved. In this case, the identity verification terminal 10 accesses the IC chip 61 of the My Number Card 60 using the saved verification number A as an access key in a state where the My Number Card 60 is turned over, in other words, in a state where the document photographing camera 15 can photograph the front surface of the My Number Card 60, and obtains the personal number from the IC chip 61. The identity verification terminal 10 determines whether the personal number obtained before the My Number Card 60 is turned over matches the personal number obtained after the My Number Card 60 is turned over, and if they match, it may be determined that the identity verification has succeeded.

[0151] (Summary of Embodiment 1) According to the description of the above Embodiment 1, at least the following technologies are disclosed. Although the corresponding components etc. in Embodiment 1 are exemplified in parentheses, it is not limited thereto.

[0152] (Technology 1) A method for verifying the identity of a target person (for example, user 2) based on an identity verification document (for example, My Number Card 60) is to obtain first face image data based on the face value information on the first side of the identity verification document (for example, the front surface of the My Number Card 60), match the first face image data with the face photographed image generated by photographing the face of the target person, and if the match is successful, save the face photographed image or the first face image data, obtain second face image data based on the face value information on the second side of the identity verification document (for example, the back surface of the My Number Card 60), and match the second face image data with the saved face photographed image or the first face image data.

[0153] Thus, when the collation between the first face image data obtained from the identity document and the face photographed image of the target person is successful, the first face image data or the face photographed image is saved. Then, the saved first face image data or face photographed image is collated with the second face image data obtained from the identity document. Thereby, for example, when the identity document is replaced after the collation between the first face image data and the face photographed image of the target person, the collation between the saved first face image data or face photographed image and the second face image data obtained from the identity document fails. In this way, by performing the collation twice, when each of the first side and the second side of the identity document is read, it is guaranteed that the identity document at the time of reading the first side and the identity document at the time of reading the second side are the same, so strict identity verification is realized.

[0154] (Technology 2) In the identity verification method described in Technology 1, the identity document is a My Number card (for example, My Number card 60), the face value information on the first side is the date of birth, the Western calendar of the expiration date, and the security code described on the first side, and the identity verification method accesses the IC chip (for example, IC chip 61) of the My Number card with the collation number B obtained based on the face value information on the first side, and acquires the first face image data stored in the IC chip.

[0155] Thereby, identity verification using a My Number card becomes possible. Also, the identity verification method enables access to the IC chip using the collation number B as an access key and acquisition of the face image data stored in the IC chip.

[0156] (Technology 3) In the identity verification method described in Technology 1 or 2, the identity document is a My Number card, the face value information on the second side is the two-dimensional barcode described on the second side, and the identity verification method accesses the IC chip of the My Number card with the collation number A obtained based on the two-dimensional barcode, and acquires the second face image data stored in the IC chip.

[0157] This enables the personal identification method to access the IC chip using the collation number A as an access key and obtain the face image data stored in the IC chip.

[0158] (Technology 4) In the personal identification method described in Technology 2, the personal identification method obtains the first personal information stored in the IC chip simultaneously with the acquisition of the first face image data.

[0159] This enables the personal identification method to simultaneously obtain face image data and personal information from the IC chip.

[0160] (Technology 5) In the personal identification method described in Technology 4, the first personal information includes name, gender, address, and date of birth.

[0161] This enables the personal identification method to simultaneously obtain face image data and personal information including name, gender, address, and date of birth from the IC chip.

[0162] (Technology 6) In the personal identification method described in Technology 3, the personal identification method obtains the second personal information stored in the IC chip simultaneously with the acquisition of the second face image data.

[0163] This enables the personal identification method to simultaneously obtain face image data and personal information from the IC chip.

[0164] (Technology 7) In the personal identification method described in Technology 6, the second personal information includes a personal number.

[0165] This enables the personal identification method to simultaneously obtain face image data and personal information including a personal number from the IC chip.

[0166] (Technology 8) In the personal identification method according to any one of Technologies 1 to 7, the personal identification document consists of a front side and a back side, the first side is the front side of the personal identification document, and the second side is the back side of the personal identification document.

[0167] Thereby, the personal identification method enables the acquisition of face image data based on the respective face sheet information on the front side and the back side of the personal identification document.

[0168] (Technology 9) In the personal identification method according to any one of Technologies 1 to 8, when the personal identification document when the first face image data is acquired and the personal identification document when the second face image data is acquired are the same, the first face image data and the second face image data are the same data.

[0169] When the personal identification document when the first face image data is acquired and the personal identification document when the second face image data is acquired are the same, the first face image data and the second face image data are the same data. In this case, if the collation between the first face image data and the face photographed image is successful, the collation between the second face image data and the face photographed image will also be successful.

[0170] (Technology 10) In the personal identification method according to any one of Technologies 1 to 9, when the personal identification method saves the face photographed image, after collating the second face image data with the saved face photographed image, the saved face photographed image is deleted.

[0171] Thereby, since the saved face photographed image is deleted, the privacy protection of the target person is achieved.

[0172] (Technology 11) In the personal identification method according to any one of Technologies 1 to 10, when the personal identification method succeeds in collating the second face image data with the saved face photographed image or the first face image data, it is determined that the personal identification of the target person is successful, and the determination result is displayed on the display device.

[0173] As a result, for example, the target person can confirm the result of the identity verification on the display device.

[0174] (Technology 12) In the identity verification method described in any one of Technologies 1 to 11, when the collation between the second face image data and the stored face photographed image or the first face image data fails, it is determined that the identity verification of the target person has failed, and the determination result is displayed on the display device.

[0175] As a result, for example, the target person can confirm the result of the identity verification on the display device.

[0176] (Technology 13) An identity verification terminal (for example, identity verification terminal 10) that performs identity verification of a target person based on an identity verification document includes a face photographing camera (for example, face photographing camera 16) that photographs the face of the target person to generate a face photographed image, a document photographing camera (for example, document photographing camera 15) that photographs the face of the identity verification document to generate a document photographed image, a processor (for example, processor 11), and a memory (for example, memory 12). The processor acquires first face image data based on the face information obtained from the document photographed image of the first side of the identity verification document, collates the first face image data with the face photographed image, and if the collation is successful, stores the face photographed image or the first face image data in the memory. Then, the processor acquires second face image data based on the face information obtained from the document photographed image of the second side of the identity verification document, and collates the second face image data with the face photographed image or the first face image data stored in the memory.

[0177] As a result, the identity verification terminal can obtain the same effect as Technology 1.

[0178] (Technology 14) The personal verification system (for example, personal verification system 1) includes a personal verification terminal that performs personal verification of a target person based on a personal verification document, and a business terminal (for example, business terminal 20) communicably connected to the personal verification terminal. The personal verification terminal includes a face capture camera that captures the face of the target person to generate a face capture image, and a document capture camera that captures the face of the personal verification document to generate a document capture image. The personal verification terminal, in response to an instruction from the business terminal, acquires first face image data based on the face information obtained from the document capture image of the first side of the personal verification document, collates the first face image data with the face capture image, and if the collation is successful, saves the face capture image or the first face image data in the memory, acquires second face image data based on the face information obtained from the document capture image of the second side of the personal verification document, and collates the second face image data with the face capture image or the first face image data saved in the memory.

[0179] Thereby, the personal verification system can obtain the same effect as that of Technology 1.

[0180] (Technology 15) The program causes the personal verification terminal that performs personal verification of a target person based on a personal verification document to acquire first face image data based on the face information of the first side of the personal verification document, collate the first face image data with the face capture image generated by capturing the face of the target person, and if the collation is successful, save the face capture image or the first face image data, acquire second face image data based on the face information of the second side of the personal verification document, and collate the second face image data with the saved face capture image or the first face image data.

[0181] Thereby, the program can obtain the same effect as that of Technology 1.

[0182] (Technology 16) The personal identification method acquires a first number (e.g., collation number B) based on the front - side document information obtained by photographing the first side of a personal identification document with a camera (e.g., document photographing camera 15), acquires face image data and personal information of the target person who owns the personal identification document based on the first number, collates the face image data with a face - photographed image generated by photographing the face of the target person, and if the collation is successful, saves the first number. With the camera in a state where it can photograph the second side of the personal identification document, it acquires the personal information of the target person who owns the personal identification document using the saved first number, and collates the personal information of the target person obtained by the camera photographing the first side of the personal identification document with the personal information of the target person obtained with the camera in a state where it can photograph the second side of the personal identification document.

[0183] Thereby, for example, based on the collation number B obtained by photographing the front surface of the My Number Card, personal information and face image data are acquired. And if the collation between the face - photographed image generated by photographing the face of the target person and the face image data is successful, the collation number B is saved. Then, with the camera in a state where it can photograph the back surface of the My Number Card, the personal information of the target person is acquired using the saved collation number B. And the personal information obtained based on the collation number B obtained by photographing the front surface of the My Number Card is collated with the personal information obtained based on the collation number B with the camera in a state where it can photograph the back surface of the My Number Card. As a result of the collation, if each personal information matches, it is determined that the My Number Card has not been replaced and the personal identification of the target person has been successful.

[0184] (Technology 17) The personal identification method acquires a second number (for example, two-dimensional barcode 64) based on the face information of the second side obtained by photographing the second side of the personal identification document with a camera, and based on the second number, acquires face image data and the personal number of the target person who owns the personal identification document, collates the face image data with a face photographed image generated by photographing the face of the target person, and if the collation is successful, saves the second number. With the camera in a state where it can photograph the first side of the personal identification document, the personal number of the target person who owns the personal identification document is acquired using the saved second number, and the personal number of the target person acquired by the camera photographing the second side of the personal identification document is collated with the personal number of the target person acquired with the camera in a state where it can photograph the first side of the personal identification document.

[0185] Thereby, for example, based on the collation number A obtained by reading the two-dimensional barcode printed on the back of the My Number card, the personal number and the face image data are acquired. And when the collation between the face photographed image generated by photographing the face of the target person and the face image data is successful, the collation number A is saved. And with the camera in a state where it can photograph the front surface of the My Number card, the personal number of the target person is acquired using the saved collation number A. And the personal number acquired based on the collation number A obtained by photographing the back of the My Number card is collated with the personal number acquired based on the collation number A with the camera in a state where it can photograph the front surface of the My Number card. As a result of the collation, if the respective personal numbers match, it is determined that the My Number card has not been replaced and the personal identification of the target person has been successful.

[0186] (Embodiment 2) In the description of the above-described Embodiment 1, an example in which the personal authentication terminal 10 performs the personal authentication of the user 2 has been described. In the description of Embodiment 2, an example in which the user terminal 150 (see FIG. 10) and the collation server 160 (see FIG. 10) cooperate to perform the personal authentication of the user 2 will be described. It was premised that the personal authentication terminal 10 according to Embodiment 1 was installed inside the bank. However, the user terminal 150 is a terminal that can be personally owned by the user 2, such as a smartphone. That is, the personal authentication system 1A (see FIG. 10) according to Embodiment 2 is not premised on being introduced into the bank.

[0187] In the description of the personal authentication system 1A according to Embodiment 2, the description of the same content as that of the personal system 1 according to Embodiment 1 will be simplified or omitted, and the description will focus on the differences.

[0188] [System Configuration] FIG. 10 is a block diagram showing a configuration example of the personal authentication system 1A according to Embodiment 2. The personal authentication system 1A includes a user terminal 150, a collation server 160, a bank server 30, a signature verification server 40, and a public authentication server 50. The user terminal 150 and the collation server 160 are connected via wireless communication such as a wireless LAN, for example, and can transmit and receive information to and from each other. The same applies to the connections between the user terminal 150 and the bank server 30, and the user terminal 150 and the signature verification server 40, respectively.

[0189] The user terminal 150 uses the My Number card 60 and cooperates with the collation server 160 to perform the personal authentication process of the user 2. An example of the user terminal 150 is a smartphone.

[0190] The user terminal 150 includes a processor 151, a memory 152, an operating device 153, a camera 154, a display device 155, and a communication device 156.

[0191] In addition, the user terminal 150 has a function of non-contact reading of the data stored in the IC chip 61 of the My Number card 60. For example, the user terminal 150 supports the NFC method. In the following description, it is assumed that when the user terminal 150 accesses the IC chip 61 of the My Number card 60, communication is performed between the user terminal 150 and the IC chip 61 of the My Number card 60 by the NFC method or the like.

[0192] The processor 151 realizes the functions of the user terminal 150 by executing a computer program stored in the memory 152. For example, the processor 151 performs the authentication process of the user 2 by executing the authentication application 157 stored in the memory 152. Note that the processor 151 may be read as other terms such as a controller, a CPU, and a control unit.

[0193] The memory 152 is a storage area for storing and holding a computer program for realizing the functions of the user terminal 150 and various types of data and the like. The memory 152 is composed of, for example, a non-volatile storage area such as a ROM, an HDD, and a volatile storage area such as a RAM. The memory 152 stores the authentication application 157. The authentication application 157 is an application for performing identity verification and the like required for opening a bank account. The authentication application 157 may be installed on the user terminal 150 by the user 2.

[0194] The operation device 153 receives operations from the user 2.

[0195] The camera 154 captures the face of the My Number card 60 to generate a document capture image. In addition, the camera 154 captures the face of the user 2 to generate a face capture image.

[0196] The display device 155 displays various images and information and the like. The display device 155 and the operation device 153 may be an integrated device such as a touch panel display.

[0197] The communication device 156 controls the transmission and reception of various data with the verification server 160 and the bank server 30.

[0198] The verification server 160 performs face verification using the face captured image and face image data transmitted from the user terminal 150. Examples of the verification server 160 include a server computer and the like.

[0199] The verification server 160 includes a processor 161, a memory 162, and a communication device 163.

[0200] The processor 161 realizes the functions of the verification server 160 by executing a program in cooperation with the memory 162. Note that the processor 161 may be read as other terms such as a controller, a CPU, or a control unit.

[0201] The memory 162 is a storage area for storing and holding a computer program and various data for realizing the functions of the verification server 160. The memory 162 is composed of, for example, a ROM which is a non-volatile storage area, an HDD, and a RAM which is a volatile storage area.

[0202] The communication device 163 controls the transmission and reception of various data with the user terminal 150.

[0203] The description of the bank server 30, the signature verification server 40, and the public certification server 50 is omitted. Note that in this embodiment, the signature verification server 40 and the public certification server 50 may be omitted.

[0204] [Operation] Referring to FIG. 11, the process of newly opening a bank account of user 2 using the identity verification system 1A will be described. FIG. 11 is a conceptual diagram for opening an account using the identity verification system 1A according to Embodiment 2.

[0205] User 2 obtains the authentication app 157 and operates the user terminal 150 to apply for opening a new account. The authentication app 157 may be provided online, for example, by the bank to which User 2 applies for opening an account. User 2 may obtain the authentication app 157 from, for example, an online store that provides various applications, or from the bank's homepage or the like. In the following description, it is assumed that the application for opening an account is made on the authentication app 157, but it is not limited to this.

[0206] Then, User 2 decides whether to associate the newly opened account with User 2's personal number. Here, for example, the decision may be input to the authentication app 157. Thereafter, the identity verification process of User 2 using the My Number card 60 is performed.

[0207] If it is necessary to associate the account with the personal number, the identity verification process is performed in two stages, Phase 1 and Phase 2. The user terminal 150 obtains the personal number in the Phase 2 process. Also, even when the identity verification process is performed in two stages, that is, when the front and back surfaces of the My Number card 60 are read, the replacement of the My Number card 60 can be detected, so strict identity verification is realized. The details of the process will be described later with reference to FIGS. 13 and 14.

[0208] Even when it is not necessary to associate the account with the personal number, the identity verification process is still performed. In this case, the identity verification process corresponds to the Phase 1 process of the identity verification process when it is necessary to associate the account with the personal number.

[0209] Thereafter, the validity of the My Number card 60, in other words, the public authentication process, is determined by the signature verification server 40 and the public authentication server 50. When it is confirmed that the My Number card 60 is valid, the bank server 30 opens an account. Note that the public authentication process may be omitted.

[0210] Thereafter, the bank server 30 manages the newly opened account.

[0211] In the following description, attention is paid to the case where it is necessary to associate an account with a personal number.

[0212] FIG. 12 is a sequence diagram showing an operation example of the personal identification system 1A according to the second embodiment.

[0213] The user terminal 150 activates the authentication application 157 based on the operation of the user 2 (step St170).

[0214] The user terminal 150 receives a request for opening a new account by the user 2 and associating the account with a personal number (step St171). Specifically, for example, the user 2 makes a request for opening a new account and associating the account with a personal number using the authentication application 157.

[0215] When the user terminal 150 receives a request for opening an account and associating the account with a personal number in step St171, it receives a selection of an authentication method (step St172). The authentication methods are two types: face authentication and password input. For the sake of convenience of explanation, it is assumed that face authentication is selected as the authentication method.

[0216] When the user terminal 150 receives the selection of face authentication as the authentication method in step St172, it performs the personal identification process of the user 2 in cooperation with the collation server 160 (step St173). The details of this process will be described later with reference to FIGS. 13 and 14. When password input is selected as the authentication method in step St172, the user terminal 150 performs the personal identification process alone without cooperating with the collation server 160 (see FIG. 15).

[0217] When the personal identification process in step St173 is successful, the user terminal 150 transmits personal information to the bank server 30 (step St174).

[0218] When the bank server 30 receives the personal information of user 2 transmitted from the user terminal 150, it creates a new account number and transmits an account number creation completion notice to the user terminal 150 (step St175). Although not shown in FIG. 12, when the identity verification process fails, the user terminal 150 may, for example, display a message indicating the failure of the identity verification process on the display device 155, or transmit the message to the bank server 30.

[0219] Also, when the public authentication process is performed, the user terminal 150 may, for example, acquire a digital signature certificate from the My Number card 60 before the process of step St174. The user terminal 150 transmits the electronic certificate for signature request to the public authentication server 50 via the signature verification server 40. The public authentication server 50 determines the validity of the My Number card 60 and transmits the determination result to the user terminal 150 via the signature verification server 40. Then, when the user terminal 150 receives the result that the My Number card 60 is valid, it executes the process of step St174.

[0220] When the user terminal 150 receives the account number creation completion notice transmitted from the bank server 30, it displays a message indicating that the account number has been created on the display device 155 (step St176).

[0221] The user terminal 150 deletes various personal information acquired during the identity verification process (step St177).

[0222] The bank server 30 associates the newly created account number with the personal information of user 2 (step St178). The bank server 30 completes the new account opening and stores the information of the opened account (step St179).

[0223] Next, with reference to FIGS. 13 and 14, the authentication process of User 2 by the user terminal 150 and the collation server 160 will be described. FIG. 13 is a sequence diagram showing an operation example of the authentication system 1A according to the second embodiment. FIG. 14 is a sequence diagram showing an operation example of the authentication system 1A following FIG. 13. "C" and "D" shown in each of the sequence diagrams of FIGS. 13 and 14 represent the connection of each of the sequence diagrams of FIGS. 7 and 8.

[0224] At the start point of the sequence diagram shown in FIG. 13, the user terminal 150 is displaying a screen for receiving a selection of an authentication method from User 2. As an example of a screen for receiving a selection of an authentication method, the screen 141 shown in FIG. 9 can be cited.

[0225] Also, in the following description, the entity that executes the process may be described as the authentication app 157. More precisely, each process of the user terminal 150 in the authentication process is performed by the processor 151 of the user terminal 150 executing the authentication app 157. Note that the authentication document in the figure refers to the My Number Card 60.

[0226] The authentication app 157 receives the selection of the authentication method by User 2 (step St180). For the sake of convenience of explanation, it is assumed that face authentication is selected as the authentication method by User 2.

[0227] The camera 154 of the user terminal 150 photographs the surface of the My Number Card 60, and the authentication app 157 obtains the collation number B based on the generated document photographing image (step St181). More specifically, the authentication app 157 activates the camera 154, and User 2 photographs the surface of the My Number Card 60. Thereby, a document photographing image is generated. The collation number B is obtained based on the character information 63 detected by performing OCR on the document photographing image. Note that the authentication app 157 may display, on the display device 155, a screen for instructing User 2 to photograph the surface of the My Number Card 60.

[0228] The authentication app 157 accesses the IC chip 61 of the My Number Card 60 using the collation number B obtained in step St181 as an access key (step St182).

[0229] The authentication app 157 reads and acquires four pieces of information and face image data from the IC chip 61 (step St183).

[0230] The camera 154 captures the face of user 2 and generates a face-captured image (step St184). At this time, the camera 154 is activated by the authentication app 157. Also, at this time, for example, user 2 may capture their own face by operating the user terminal 150. Further, the authentication app 157 may cause the display device 155 to display a screen instructing user 2 to capture their own face.

[0231] The authentication app 157 transmits the face-captured image of user 2 generated in step St184 and the face image data acquired in step St183 to the collation server 160 (step St185).

[0232] The collation server 160 receives the face-captured image and the face image data transmitted from the user terminal 150 and collates them (step St186). The collation of the face-captured image and the face image data may be performed, for example, by comparing face feature amounts. For the sake of explanation, it is assumed that the collation server 160 succeeds in face collation in step St186.

[0233] The collation server 160 transmits the collation result to the user terminal 150 (step St187).

[0234] When the authentication app 157 receives the collation result transmitted from the collation server 160, it causes the display device 155 to display the collation result (step St188).

[0235] The processes from step St180 to step St188, that is, the series of processes enclosed by the dashed line shown in FIG. 13, correspond to Phase 1 of the identity verification process shown in FIG. 11. In Phase 1, the user terminal 150 transmits to the verification server 160 the face image data obtained from the IC chip 61 of the My Number card 60 using the verification number B as the access key and the face captured image generated by photographing the face of User 2, and the verification server 160 verifies them to verify the identity of User 2.

[0236] Subsequently, the processes after step St189 will be described.

[0237] After the face verification in step St186 is successful and the verification server 160 transmits the verification result to the user terminal 150 in step St187, the verification server 160 saves the face captured image of User 2 (step St189). The face captured image is saved in, for example, the memory 162.

[0238] After the authentication application 157 displays the verification result on the display device 155 in step St188, it then causes the display device 155 to display an instruction to turn over the My Number card 60 (step St190). Alternatively, the user terminal 150 may display a screen instructing to read the two-dimensional barcode 64 of the My Number card 60.

[0239] The camera 154 of the user terminal 150 reads the two-dimensional barcode 64 of the My Number card 60, and the authentication application 157 obtains the verification number A based on the two-dimensional barcode 64 (step St191). More specifically, the authentication application 157 activates the camera 154 and causes User 2 to read the two-dimensional barcode 64 on the back of the My Number card 60 with the camera 154. Thereby, the authentication application 157 can obtain the verification number A based on the two-dimensional barcode 64.

[0240] The authentication application 157 accesses the IC chip 61 of the My Number card 60 using the verification number A obtained in step St191 as the access key (step St192).

[0241] The authentication app 157 reads and acquires the personal number and face image data from the IC chip 61 (step St193).

[0242] The authentication app 157 transmits the face image data acquired in step St193, that is, the face image data acquired based on the collation number A, to the collation server 160 (step St194).

[0243] When the collation server 160 receives the face image data transmitted from the user terminal 150 in step St194, it reads out the face photographed image saved in step St189 (step St195).

[0244] The collation server 160 collates the face image data transmitted from the user terminal 150 in step St194 with the face photographed image saved in step St189 and read out in St195 (step St196). For the sake of convenience of explanation, it is assumed that the face collation is successful in step St196 by the collation server 160.

[0245] The collation server 160 transmits the collation result to the user terminal 150 (step St197).

[0246] When the authentication app 157 receives the collation result transmitted from the collation server 160, it causes the display device 155 to display the collation result (step St198).

[0247] The processes from step St189 to step St198, that is, the series of processes enclosed by the broken line shown in FIG. 14, correspond to Phase 2 of the identity verification process shown in FIG. 11. In Phase 2, the collation server 160 collates the face image data acquired from the IC chip 61 of the My Number card 60 by the user terminal 150 using the collation number A as an access key with the face photographed image generated by photographing the face of user 2 in Phase 1, thereby performing the identity verification of user 2.

[0248] After step St198, the authentication app 157 causes the display device 155 to display that the identity verification process has been completed (step St199).

[0249] After step St197, the matching server 160 deletes the face image data and the face captured image that were acquired during the identity verification process (step St200).

[0250] In this way, the matching server 160 matches the face image data acquired by the user terminal 150 based on the matching number B with the face captured image of user 2, and if the match is successful, saves the face captured image. Then, the matching server 160 matches the face image data acquired by the user terminal 150 based on the matching number A with the saved face captured image. If the match is successful, the user terminal 150 determines that the identity verification of user 2 has been successful. For example, if the face matching in Phase 1 is successful and then the My Number card 60 is replaced with another My Number card before the two-dimensional barcode 64 of the My Number card 60 is read, the face matching in Phase 2 will fail. Therefore, by performing the identity verification process with two-stage authentication in this way, if the My Number card 60 is replaced, the replacement can be detected, and strict identity verification is realized.

[0251] Also, in step St177 shown in FIG. 12, the various personal information deleted by the user terminal 150 is the face captured image, four-information, face image data, and personal number acquired during the identity verification process.

[0252] Also, when the association of the personal number is not required, Phase 2 of the identity verification process is not performed. In this case, the processing of the user terminal 150 proceeds from step St188 to step St199, and the processing of the matching server 160 proceeds from step St187 to step 200.

[0253] FIG. 13 and FIG. 14 are sequence diagrams on the premise that user 2 selects face authentication as an authentication method. The case where user 2 selects password input as an authentication method will be described with reference to FIG. 15. FIG. 15 is a flowchart showing an operation example of user terminal 150 according to Embodiment 2.

[0254] The authentication app 157 receives a selection by user 2 to use password input as the authentication method (step St210).

[0255] The authentication app 157 causes the display device 155 to display a PIN code input screen (step St211). As an example of the input screen, screen 147 shown in FIG. 9 can be mentioned.

[0256] The authentication app 157 receives the PIN code input by user 2 (step St212). For convenience of explanation, it is assumed that the PIN code input in step St212 is the correct PIN code.

[0257] The authentication app 157 accesses the IC chip 61 of the My Number card 60 using the PIN code input in step St212 as an access key (step St213).

[0258] The authentication app 157 reads and acquires four pieces of information and the personal number from the IC chip 61 (step St214). For convenience of explanation, it is assumed that the authentication app 157 has acquired four pieces of information and the personal number.

[0259] The authentication app 157 causes the display device 155 to display a message indicating that the reading was successful (step St215).

[0260] The authentication app 157 causes the display device 155 to display a message indicating that the identity confirmation has been completed (step St216). Then, this processing flow ends.

[0261] Even when face authentication is selected as the authentication method, the user terminal 150 may determine that the identity verification process by face authentication has failed and shift the process to step St211 shown in FIG. 15 in the following cases. The following cases are, namely, when the collation number B or the collation number A cannot be obtained, when the IC chip 61 cannot be accessed, when various types of information (four types of information, face image data, and personal number) cannot be obtained from the IC chip 61, or when the face collation fails. Further, when the user terminal 150 determines that the identity verification process has failed, the user terminal 150 may cause the display device 155 to display the determination result. Note that even if the identity verification process by face authentication fails and the process shifts to the identity verification process by input of a password, there may be a case where the user 2 cannot access the IC chip 61 of the My Number card 60 and fails in identity verification for reasons such as forgetting the password. In this case, for example, a message recommending that the user make an inquiry to a bank clerk may be displayed on the display device 155.

[0262] In addition, in order to separately explain the identity verification process in Phase 1 and Phase 2, the display of the collation result in step St188 and the display of the instruction to turn over the My Number card 60 in step St190 are explained in separate steps, but these displays may be performed at the same timing.

[0263] (Modification Example of Embodiment 2) In the above-described Embodiment 2, when the collation server 160 succeeded in collating the face image data acquired by the user terminal 150 based on the collation number B with the face photographed image of User 2, the face photographed image was saved. Then, the collation server 160 collated the face image data acquired by the user terminal 150 based on the collation number A with the saved face photographed image. However, the present invention is not limited to this. When the collation server 160 succeeds in collating the face image data acquired by the user terminal 150 based on the collation number B with the face photographed image of User 2, the face image data may be saved. In this case, the collation server 160 may collate the face image data acquired by the user terminal 150 based on the collation number A with the saved face image data. This is because as long as the My Number card 60 used for the identity verification process is not replaced with another My Number card during the identity verification process, the face image data acquired based on the collation number B and the face image data acquired based on the collation number A should be the same face image data.

[0264] Also, the user terminal (e.g., user terminal 150) may obtain a first number (e.g., verification number B) based on the document surface information obtained from the photographed image of the first side (e.g., the front surface of the My Number card 60) of the identity document (e.g., My Number card 60). Then, the user terminal 150 may obtain first face image data and first personal information (e.g., name) based on the first number. Then, the user terminal 150 may transmit the face photographed image of the target person (e.g., user 2) and the first face image data to a verification server (e.g., verification server 160). Then, the verification server may verify the first face image data and the face photographed image. Then, if the verification is successful, the verification server may transmit the verification result to the user terminal. Then, the user terminal may save the first number and the first personal information in response to obtaining the verification result from the verification server. Then, the user terminal may obtain the first personal information from the identity document using the saved first number in a state where the camera (e.g., camera 154) can photograph the second side of the identity document (e.g., the back surface of the My Number card 60). Then, the user terminal 150 may verify the saved first personal information and the first personal information obtained in a state where the camera can photograph the second side of the identity document. Then, if the verification is successful, the user terminal 150 may determine that the identity document has not been replaced. Then, the user terminal 150 may determine that the identity verification has been successful.

[0265] For example, when the user terminal 150 receives, at step St187, the result of successful verification transmitted from the verification server 160, it may save the verification number B and the name among the four pieces of information obtained based on the verification number B. In this case, the user terminal 150 uses the saved verification number B as an access key to access the IC chip 61 of the My Number card 60 in a state where the My Number card 60 is turned over, in other words, in a state where the camera 154 can photograph the back surface of the My Number card 60, and may obtain the name among the four pieces of information from the IC chip 61. The user terminal 150 may determine whether or not the name obtained using the verification number B in a state where the My Number card 60 is not turned over, that is, in a state where the camera 154 can photograph the front surface of the My Number card 60, matches the name obtained using the verification number B in a state where the My Number card 60 is turned over, that is, in a state where the camera 154 can photograph the back surface of the My Number card 60. Then, when the two obtained names match, the user terminal 150 may determine that the My Number card 60 has not been replaced and that the identity verification has been successful. Although the name among the four pieces of information has been described as an example, the address, date of birth, or gender among the four pieces of information may be obtained by the user terminal 150 in a state where the camera 154 can photograph the front surface of the My Number card 60 and in a state where it can photograph the back surface of the My Number card 60, respectively, and may be used for verification for identity confirmation. Also, the verification using any one of the above four pieces of information may be performed by the verification server 160.

[0266] Also, the user terminal (e.g., user terminal 150) may obtain a first number (e.g., verification number B) based on the document surface information obtained from the photographed image of the first side (e.g., the front surface of the My Number Card 60) of the identity document (e.g., My Number Card 60). Then, the user terminal may obtain first face image data based on the first number. Then, the user terminal may transmit the face photographed image of the target person (e.g., user 2) and the first face image data to a verification server (e.g., verification server 160). Then, the verification server may verify the first face image data and the face photographed image. Then, if the verification is successful, the verification server may transmit the verification result to the user terminal and save the first face image data. Then, the user terminal may save the first number in response to obtaining the verification result from the verification server. Then, with the camera (e.g., camera 154) able to photograph the second side (e.g., the back surface of the My Number Card 60) of the identity document, the user terminal may obtain second face image data from the identity document using the saved first number. Then, the user terminal may transmit the second face image data to the verification server. Then, the verification server may verify the saved first face image data and the second face image data. Then, if the verification is successful, the verification server may transmit the verification result to the user terminal. Then, the user terminal may determine that the identity document has not been replaced in response to obtaining the verification result. Then, the user terminal may determine that the identity verification has been successful.

[0267] For example, when the user terminal 150 receives the result of successful verification transmitted from the verification server 160 in step St187, it may save the verification number B. Also, at this time, the verification server 160 may save the face image data. In this case, the user terminal 150 accesses the IC chip 61 of the my number card 60 using the saved verification number B as an access key in a state where the my number card 60 is turned over, that is, in a state where the camera 154 can capture the back surface of the my number card 60, and may acquire the face image data from the IC chip 61. Then, after the my number card 60 is turned over, that is, in a state where the camera 154 can capture the back surface of the my number card 60, the user terminal 150 may transmit the face image data acquired using the verification number B to the verification server 160. The verification server 160 may verify the face image data acquired using the verification number B in a state where the camera 154 can capture the back surface of the my number card 60 and the saved face image data, and transmit the verification result to the user terminal 150. Then, when the user terminal 150 receives the result of successful verification, it may determine that the my number card 60 has not been replaced and that the identity verification has been successful.

[0268] Further, the user terminal (e.g., user terminal 150) may obtain a first number (e.g., verification number B) based on the document surface information obtained from the photographed image of the first side (e.g., the front surface of the My Number Card 60) of the identity document (e.g., My Number Card 60). Then, the user terminal may obtain first face image data based on the first number. Then, the user terminal may transmit the face photographed image of the target person (e.g., user 2) and the first face image data to a verification server (e.g., verification server 160). Then, the verification server may verify the first face image data and the face photographed image. Then, when the verification is successful, the verification server may transmit the verification result to the user terminal. Then, the user terminal may save the first number in response to obtaining the verification result from the verification server. Then, with the camera (e.g., camera 154) being able to photograph the second side (e.g., the back surface of the My Number Card 60) of the identity document, the user terminal may access the IC chip (e.g., IC chip 61) of the identity document using the saved first number. Then, when the access is successful, the user terminal may determine that the identity document has not been replaced.

[0269] For example, if the My Number Card 60 is replaced with another My Number Card at the timing when the My Number Card 60 is turned over, even if the user terminal 150 has saved the collation number B, it cannot access the IC chip of the other My Number Card using the collation number B as an access key. Therefore, the user terminal 150 may determine whether the My Number Card 60 has been replaced with another My Number Card as follows. That is, when the personal identification terminal 10 accesses the IC chip 61 of the My Number Card 60 to obtain the collation number B and receives a collation result indicating that the collation between the face image data obtained based on the collation number B and transmitted from the collation server 160 and the face photographed image of User 2 has been successful, the user terminal 150 may save the collation number B. Then, when the camera 154 can photograph the back surface of the My Number Card 60 and the user terminal 150 can access the IC chip 61 of the My Number Card 60 using the collation number B obtained when the camera 154 can photograph the front surface of the My Number Card 60 as an access key, the user terminal 150 may determine that the My Number Card 60 has not been replaced. When the camera 154 can photograph the back surface of the My Number Card 60 and the user terminal 150 can access the IC chip 61 of the My Number Card 60 using the collation number B obtained when the camera 154 can photograph the front surface of the My Number Card 60 as an access key, the user terminal 150 may determine that the My Number Card 60 has been replaced.

[0270] Also, in the personal identification process, the order of reading the front surface and the back surface of the My Number Card 60 may be reversed. In this case, when the collation server 160 has successfully collated the face image data obtained by the user terminal 150 based on the collation number A and the face photographed image of User 2, the collation server 160 may save the face photographed image. Then, the collation server 160 may collate the face image data obtained by the user terminal 150 based on the collation number B and the saved face photographed image.

[0271] Also, in the description of step St189, an example was described in which the collation server 160 stores the face photographed image in the memory 152. However, the present invention is not limited to this, and the face photographed image may be stored in the authentication application 157 or may be stored in an external server (not shown) or the like.

[0272] (Summary of Embodiment 2) From the description of the above Embodiment 2, at least the following techniques are disclosed. Although the corresponding components and the like in Embodiment 2 are exemplified in parentheses, the present invention is not limited thereto.

[0273] (Technology 18) A collation server (for example, the collation server 160) that collates a person's face includes a processor (for example, the processor 161) and a memory (for example, the memory 162). The processor receives first face image data acquired based on the face value information on the first side (for example, the front surface of the my number card 60) of the identity document (for example, the my number card 60) and a face photographed image generated by photographing the face of the target person (for example, the user 2), collates the first face image data with the face photographed image, and if the collation is successful, stores the face photographed image or the first face image data in the memory, receives second face image data acquired based on the face value information on the second side of the identity document, and collates the second face image data with the face photographed image or the first face image data stored in the memory.

[0274] As a result, when the collation between the first face image data obtained from the identity document and the face captured image of the target person is successful, the first face image data or the face captured image is saved. Then, the saved first face image data or face captured image is collated with the second face image data obtained from the identity document. Thus, for example, when the identity document is replaced after the collation between the first face image data and the face captured image of the target person, the collation between the saved first face image data or face captured image and the second face image data obtained from the identity document fails. In this way, by performing the collation twice, when each of the first side and the second side of the identity document is read, it is guaranteed that the identity document at the time of reading the first side and the identity document at the time of reading the second side are the same, so strict identity verification is realized.

[0275] (Technology 19) The identity verification system (for example, identity verification system 1A) includes a user terminal (for example, user terminal 150) and a collation server communicably connected to the user terminal. The user terminal includes a camera (for example, camera 154) that captures the face of the target person to generate a face captured image and captures the face value of the identity document to generate a document captured image, obtains first face image data based on the face value information obtained from the document captured image of the first side of the identity document, transmits the face captured image of the target person and the first face image data to the collation server, the collation server collates the first face image data and the face captured image, and when the collation is successful, transmits the collation result to the user terminal, saves the face captured image or the first face image data, and the user terminal, in response to obtaining the collation result from the collation server, transmits the second face image data obtained based on the face value information obtained from the document captured image of the second side of the identity document to the collation server, and the collation server collates the second face image data with the saved face captured image or the first face image data.

[0276] As a result, the identity verification system obtains the same effect as that of Technology 18.

[0277] The functions of the various embodiments described above can also be realized by supplying a program and an application for realizing the functions of the various embodiments described above to a system or device using a network or a storage medium or the like, and having one or more processors in the computer of the system or device read and execute the program.

[0278] Also, the functions of the various embodiments described above may be realized by a circuit (for example, an Application Specific Integrated Circuit (hereinafter referred to as "ASIC") or an FPGA) that realizes one or more functions.

[0279] As described above, the various embodiments according to the present disclosure have been described with reference to the drawings. Needless to say, the present disclosure is not limited to such examples. It is obvious that a person skilled in the art can conceive of various modification examples, correction examples, substitution examples, addition examples, deletion examples, and equivalent examples within the scope described in the claims, and it is naturally understood that those also belong to the technical scope of the present disclosure. Further, within the scope not departing from the gist of the invention, the components in the various embodiments described above may be arbitrarily combined.

[0280] For example, in the various embodiments described above, identity verification is performed during the process of newly opening a bank account, and the personal number of the my number card is obtained for linking the bank account with the personal number. However, in addition to newly opening a bank account, there may be a situation where strict identity verification for detecting the replacement of the my number card and obtaining the personal number are required when the my number card is replaced. For example, the present disclosure is applicable to various bank operations and procedures other than newly opening a bank account. Also, the present disclosure is similarly applicable not only to bank operations and procedures but also to, for example, administrative operations and procedures.

[0281] In addition, when linking personal identification documents other than the My Number card with the personal number of the My Number card, the present disclosure is similarly applicable. For example, when a terminal such as a smartphone is equipped with the function of a My Number card and the function of a personal identification document other than the My Number card such as a driver's license is installed on the terminal, the owner of the terminal can execute the linking of the personal identification document and the personal number by applying the present disclosure.

Industrial Applicability

[0282] The present disclosure is useful as a personal identification method, a personal identification system, a personal identification terminal, a collation server, and a program.

Description of Signs

[0283] 1, 1A Personal identification system 2 User 10 Personal identification terminal 11, 21, 31, 151, 161 Processor 12, 22, 32, 152, 162 Memory 13 Mounting part 14 IC card reader 15 Document photographing camera 16 Face photographing camera 17, 23, 155 Display device 18, 24, 153 Operating device 19, 25, 33, 156, 163 Communication device 20 Business terminal 30 Bank server 40 Signature verification server 50 Public authentication server 60 My Number card 61 IC chip 64 Two-dimensional barcode 70 Customer operation terminal 150 User terminal 154 Camera 157 Authentication application

Claims

1. A method for verifying the identity of a target person based on identity verification documents, acquiring first face image data based on the document information on the first side of the identity verification document, comparing the first face image data with a face captured image generated by photographing the face of the target person, if the comparison is successful, saving the face captured image or the first face image data, acquiring second face image data based on the document information on the second side of the identity verification document, comparing the second face image data with the saved face captured image or the first face image data, Identity verification method.

2. The identity verification document is a My Number card, the document information on the first side is the date of birth, the Gregorian calendar of the expiration date, and the security code described on the first side, accessing the IC chip of the My Number card with the verification number B obtained based on the document information on the first side, acquiring the first face image data stored in the IC chip, The identity verification method according to Claim 1.

3. The identity verification document is a My Number card, the document information on the second side is the two-dimensional barcode described on the second side, accessing the IC chip of the My Number card with the verification number A obtained based on the two-dimensional barcode, acquiring the second face image data stored in the IC chip, The identity verification method according to Claim 1.

4. acquiring first personal information stored in the IC chip simultaneously with the acquisition of the first face image data, The identity verification method according to Claim 2.

5. The first personal information includes name, gender, address, and date of birth, The identity verification method according to Claim 4.

6. acquiring second personal information stored in the IC chip simultaneously with the acquisition of the second face image data, The identity verification method according to Claim 3.

7. The second personal information includes a personal number, The identity verification method according to Claim 6.

8. The identity verification document consists of a front side and a back side, the first side is the front side of the identity verification document, and the second side is the back side of the identity verification document, The identity verification method according to Claim 1.

9. When the identity verification document when the first face image data is acquired and the identity verification document when the second face image data is acquired are the same, the first face image data and the second face image data are the same data, The personal identification method according to claim 1.

10. When the face photographed image is saved, after comparing the second face image data with the saved face photographed image, the saved face photographed image is deleted. The personal identification method according to claim 1.

11. When the comparison between the second face image data and the saved face photographed image or the first face image data is successful, it is determined that the personal identification of the target person is successful. The determination result is displayed on a display device. The personal identification method according to claim 1.

12. When the comparison between the second face image data and the saved face photographed image or the first face image data fails, it is determined that the personal identification of the target person fails. The determination result is displayed on a display device. The personal identification method according to claim 11.

13. A personal identification terminal for performing personal identification of a target person based on personal identification documents, A face photographing camera that photographs the face of the target person to generate a face photographed image, A document photographing camera that photographs the face of the personal identification document to generate a document photographed image, A processor, A memory, and is provided with, The processor is, First face image data is obtained based on the face information of the first side of the personal identification document obtained from the document photographed image, The first face image data and the face photographed image are compared, When the comparison is successful, the face photographed image or the first face image data is saved in the memory, Second face image data is obtained based on the face information of the second side of the personal identification document obtained from the document photographed image, The second face image data is compared with the face photographed image or the first face image data saved in the memory. Personal identification terminal.

14. A verification server for performing face verification of a person, A processor, A memory, and is provided with, The processor is, The first face image data obtained based on the face information of the first side of the personal identification document and the face photographed image generated by photographing the face of the target person are received, The first face image data and the face photographed image are compared, When the comparison is successful, the face photographed image or the first face image data is saved in the memory, The second face image data obtained based on the face information of the second side of the personal identification document is received, The second face image data is compared with the face photographed image or the first face image data saved in the memory. Verification server.

15. An identity verification system comprising an identity verification terminal for verifying the identity of a target person based on identity verification documents, and a business terminal communicably connected to the identity verification terminal, wherein the identity verification terminal includes a face capture camera for capturing an image of the face of the target person to generate a face capture image, and a document capture camera for capturing an image of the document surface of the identity verification documents to generate a document capture image, the identity verification terminal, in response to an instruction from the business terminal, obtains first face image data based on the document surface information obtained from the document capture image of the first side of the identity verification documents, compares the first face image data with the face capture image, if the comparison is successful, stores the face capture image or the first face image data in the memory, obtains second face image data based on the document surface information obtained from the document capture image of the second side of the identity verification documents, and compares the second face image data with the face capture image or the first face image data stored in the memory. Identity verification system.

16. An identity verification system comprising a user terminal and a verification server communicably connected to the user terminal, wherein the user terminal is provided with a camera for capturing an image of the face of the target person to generate a face capture image and for capturing an image of the document surface of the identity verification documents to generate a document capture image, obtains first face image data based on the document surface information obtained from the document capture image of the first side of the identity verification documents, sends the face capture image of the target person and the first face image data to the verification server, the verification server compares the first face image data with the face capture image, if the comparison is successful, sends the comparison result to the user terminal and stores the face capture image or the first face image data, the user terminal in response to obtaining the comparison result from the verification server, sends second face image data obtained based on the document surface information obtained from the document capture image of the second side of the identity verification documents to the verification server, the verification server compares the second face image data with the stored face capture image or the first face image data. Identity verification system.

17. On an identity verification terminal for verifying the identity of a target person based on identity verification documents, causes first face image data to be obtained based on the document surface information of the first side of the identity verification documents, and causes the first face image data to be compared with a face capture image generated by capturing an image of the face of the target person. When the verification is successful, save the face captured image or the first face image data, obtain second face image data based on the face value information on the second side of the identity document, and verify the second face image data with the saved face captured image or the first face image data, Program.

18. Obtain a first number based on the face value information of the first side obtained by photographing the first side of the identity document with a camera, obtain face image data and personal information of the target person who owns the identity document based on the first number, verify the face image data with a face captured image generated by photographing the face of the target person, when the verification is successful, save the first number, with the camera in a state where it can photograph the second side of the identity document, obtain the personal information of the target person who owns the identity document using the saved first number, verify the personal information of the target person obtained by the camera photographing the first side of the identity document with the personal information of the target person obtained with the camera in a state where it can photograph the second side of the identity document, Identity verification method.

19. Obtain a second number based on the face value information of the second side obtained by photographing the second side of the identity document with a camera, obtain face image data and the personal number of the target person who owns the identity document based on the second number, verify the face image data with a face captured image generated by photographing the face of the target person, when the verification is successful, save the second number, with the camera in a state where it can photograph the first side of the identity document, obtain the personal number of the target person who owns the identity document using the saved second number, verify the personal number of the target person obtained by the camera photographing the second side of the identity document with the personal number of the target person obtained with the camera in a state where it can photograph the first side of the identity document, Identity verification method.

Images