Identity verification method, identity verification system, identity verification terminal, matching server, and program

Abstract

To detect replacement of an identification document when the front and back sides of the identification document are read. [Solution] A method for verifying the identity of a target person based on an identification document, which acquires first facial image data based on face information on the first side of the identification document, compares the first facial image data with a facial image generated by photographing the target person's face, and if the comparison is successful, saves the facial image or the first facial image data, acquires second facial image data based on face information on the second side of the identification document, and compares the second facial image data with the saved facial image or the first facial image data.

Description

[Technical field]

[0001] The present disclosure relates to an identity verification method, an identity verification system, an identity verification terminal, a matching server, and a program. [Background technology]

[0002] Patent Document 1 discloses an information display system in which a terminal and a server are connected. In the information display system of Patent Document 1, the terminal transmits first information read from a user's card and a photographed face image of the user to the server. The server executes face authentication processing of the user based on the face image included in the first information transmitted from the terminal and the photographed face image of the user. If the user's face authentication is successful, the server further acquires second information of the user and transmits the acquired second information to the terminal. Then, the terminal displays the second information transmitted from the server. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-125547 Summary of the Invention [Problem to be solved by the invention]

[0004] However, there are cases where information read from an identification document is linked to other information. In this case, in order to prevent information of a person other than the person who owns the identification document from being linked, it is necessary to confirm whether the information read from the identification document belongs to the person who owns the identification document.

[0005] For example, there is an increasing need to link account numbers with personal numbers read from My Number cards in various procedures at financial institutions. However, the linking is currently performed by manually entering account numbers and personal numbers into a terminal, which means there is a risk of human error, such as linking with someone else's personal number or inputting a wrong number.

[0006] Therefore, for example, in order to verify a person's identity and obtain information (e.g., personal number) using a My Number card, it may be necessary to read the front and back of the My Number card by something other than a human hand. When the front and back of an identification document (e.g., My Number card) are read in this way, it is necessary to prevent the identification document from being replaced and to prevent information of a person other than the person who owns the identification document from being used, for example, to link information.

[0007] The present disclosure has been devised in consideration of the above-mentioned conventional situation, and aims to detect replacement of an identification document when the front and back of the identification document are read. [Means for solving the problem]

[0008] The present disclosure provides a method for verifying the identity of a target person based on an identification document, which includes obtaining first facial image data based on face information on a first side of the identification document, comparing the first facial image data with a facial image generated by photographing the face of the target person, and, if the comparison is successful, storing the facial image or the first facial image data, obtaining second facial image data based on face information on a second side of the identification document, and comparing the second facial image data with the stored facial image or the first facial image data.

[0009] The present disclosure also provides an identity verification terminal for verifying the identity of a target person based on an identity verification document, the identity verification terminal comprising: a face camera that photographs the face of the target person to generate a face image; a document camera that photographs the face of the identity verification document to generate a document image; a processor; and a memory, wherein the processor acquires first face image data based on face information acquired from the document image of a first side of the identity verification document, compares the first face image data with the face image, and if the comparison is successful, stores the face image or the first face image data in the memory, acquires second face image data based on face information acquired from the document image of a second side of the identity verification document, and compares the second face image data with the face image or the first face image data stored in the memory.

[0010] The present disclosure also provides a matching server for matching a person's face, comprising a processor and a memory, wherein the processor receives first facial image data acquired based on face information on a first side of an identification document and a facial image generated by photographing the face of the target person, matches the first facial image data with the facial image, and if the matching is successful, stores the facial image or the first facial image data in the memory, receives second facial image data acquired based on face information on a second side of the identification document, and matches the second facial image data with the facial image or the first facial image data stored in the memory.

[0011] The present disclosure also provides an identity verification system comprising an identity verification terminal that performs identity verification of a target person based on an identity verification document, and a business terminal communicatively connected to the identity verification terminal, wherein the identity verification terminal comprises a face camera that photographs the face of the target person to generate a face image, and a document camera that photographs the face of the identity verification document to generate a document image, and the identity verification terminal, in response to an instruction from the business terminal, acquires first face image data based on face information acquired from the document image of a first side of the identity verification document, compares the first face image data with the face image, and if the comparison is successful, stores the face image or the first face image data in the memory, acquires second face image data based on face information acquired from the document image of a second side of the identity verification document, and compares the second face image data with the face image or the first face image data stored in the memory.

[0012] The present disclosure also provides an identity verification system including a user terminal and a matching server communicatively connected to the user terminal, wherein the user terminal includes a camera that photographs a face of a target person to generate a facial image and photographs a face of an identification document to generate a document image, and obtains first facial image data based on face information obtained from the document image of a first side of the identification document, and transmits the facial image of the target person and the first facial image data to the matching server, and the matching server compares the first facial image data with the facial image, and if the comparison is successful, transmits the comparison result to the user terminal and stores the facial image or the first facial image data, and the user terminal transmits second facial image data obtained based on face information obtained from the document image of a second side of the identification document to the matching server in response to obtaining the comparison result from the matching server, and the matching server compares the second facial image data with the stored facial image or the first facial image data.

[0013] The present disclosure also provides a program for causing an identification terminal, which performs identity verification of a target person based on an identification document, to acquire first facial image data based on face information on a first side of the identification document, compare the first facial image data with a facial image generated by photographing the face of the target person, and, if the comparison is successful, store the facial image or the first facial image data, acquire second facial image data based on face information on a second side of the identification document, and compare the second facial image data with the stored facial image or the first facial image data.

[0014] The present disclosure also provides a method for identity verification, which includes acquiring a first number based on face information of the first side of an identity verification document obtained by photographing the first side of the identity verification document with a camera, acquiring facial image data and personal information of a target person who owns the identity verification document based on the first number, comparing the facial image data with a facial image generated by photographing the face of the target person, and if the comparison is successful, storing the first number, acquiring personal information of the target person who owns the identity verification document using the stored first number while the camera is in a state where it is able to photograph the second side of the identity verification document, and comparing the personal information of the target person acquired by the camera photographing the first side of the identity verification document with the personal information of the target person acquired while the camera is in a state where it is able to photograph the second side of the identity verification document.

[0015] The present disclosure also provides a method for identity verification, which includes obtaining a second number based on face information of the second side of an identity verification document obtained by photographing the second side with a camera, obtaining facial image data and a personal number of a target person who owns the identity verification document based on the second number, comparing the facial image data with a facial image generated by photographing the face of the target person, and if the comparison is successful, storing the second number, obtaining the personal number of the target person who owns the identity verification document using the stored second number while the camera is in a state where it is able to photograph the first side of the identity verification document, and comparing the personal number of the target person obtained by photographing the second side of the identity verification document with the personal number of the target person obtained while the camera is in a state where it is able to photograph the first side of the identity verification document.

[0016] Any combination of the above components, and conversion of the present disclosure into a method, device, system, storage medium, computer program, etc. are also valid aspects of the present disclosure. Effect of the Invention

[0017] According to the present disclosure, when the front and back of an identification document are read, replacement of the identification document can be detected. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a block diagram showing a configuration example of an identity verification system according to a first embodiment. [Diagram 2] Table diagram showing information contained in the My Number card [Diagram 3] A schematic diagram showing an example of the My Number Card (front and back) [Figure 4] A table diagram to explain the outline of the My Number Card application [Diagram 5] Conceptual diagram of account opening using the identity verification system according to the first embodiment [Figure 6] A sequence diagram showing an example of the operation of the identity verification system according to the first embodiment. [Figure 7] A flowchart showing an example of the operation of the personal identification terminal according to the first embodiment. [Figure 8] Flowchart showing an example of the operation of the personal identification terminal following FIG. 7 [Figure 9] FIG. 1 is a schematic diagram for explaining an example of a display screen of a personal identification terminal according to the first embodiment; [Figure 10] A block diagram showing a configuration example of an identity verification system according to a second embodiment. [Figure 11] Conceptual diagram of account opening using the identity verification system according to the second embodiment [Figure 12] A sequence diagram showing an example of the operation of the identity verification system according to the second embodiment. [Figure 13]A sequence diagram showing an example of the operation of the identity verification system according to the second embodiment. [Figure 14] A sequence diagram showing an example of the operation of the identity verification system, following Figure 13. [Figure 15] Flowchart showing an example of the operation of a user terminal according to the second embodiment DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, various embodiments that specifically disclose the identity verification method, identity verification system, identity verification terminal, matching server, and program according to the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters and duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following explanation are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0020] (Embodiment 1) [System Configuration] FIG. 1 is a block diagram showing an example of the configuration of an identity verification system 1 according to the first embodiment.

[0021] The identity verification system 1 according to the first embodiment is assumed to be introduced in a bank. The identity verification system 1 is a system that uses an identity verification terminal 10 and a My Number card 60 (see FIG. 3) to verify the identity of a customer who opens a new account and to link various information about the customer with the newly opened account. Hereinafter, a customer may be referred to as a user.

[0022] The My Number Card 60 is an example of an identity verification document, and the present embodiment is not limited to the My Number Card 60. For example, a smartphone equipped with an application equivalent to the My Number Card 60 is also an example of an identity verification document, and the contents of the present embodiment are also applied to such a smartphone.

[0023] The personal identification system 1 includes a personal identification terminal 10, a business terminal 20, a bank server 30, a signature verification server 40, a public authentication server 50, and a customer operation terminal 70. The personal identification terminal 10 and the business terminal 20 are connected via an electrical cable such as a Local Area Network (hereinafter referred to as "LAN") cable and / or a Universal Serial Bus (hereinafter referred to as "USB") cable, and can transmit and receive information to and from each other. Alternatively, the personal identification terminal 10 and the business terminal 20 may be connected via wireless communication such as wireless LAN or Bluetooth (registered trademark). The same applies to the connections between the personal identification terminal 10 and the customer operation terminal 70, the business terminal 20 and the bank server 30, the business terminal 20 and the signature verification server 40, and the signature verification server 40 and the public authentication server 50.

[0024] The personal identification terminal 10 performs a personal identification process for the user 2 using the My Number card 60. In the personal identification system 1 introduced in a bank, the personal identification terminal 10 is used, for example, when the user 2 opens a new bank account.

[0025] The identity verification terminal 10 comprises a processor 11, a memory 12, a placement unit 13, an integrated circuit (hereinafter referred to as "IC") card reader 14, a document photographing camera 15, a face photographing camera 16, a display device 17, an operating device 18, and a communication device 19.

[0026] The processor 11 executes a computer program stored in the memory 12 to realize the functions of the personal identification terminal 10. The processor 11 may be interpreted as other terms such as a controller, a Central Processing Unit (hereinafter referred to as "CPU"), or a control unit.

[0027] The memory 12 is a storage area for storing and holding computer programs that realize the functions of the personal identification terminal 10, various data, and the like. The memory 12 is composed of, for example, a non-volatile storage area such as a Read Only Memory (hereinafter referred to as "ROM"), a Hard Disk Drive (hereinafter referred to as "HDD"), and a volatile storage area such as a Random Access Memory (hereinafter referred to as "RAM"). In this specification, the expressions "storing" and "saving" are used as synonyms. However, in this specification, the expression "saving" may be used to emphasize that when data or information is saved (i.e., stored), the data or information is read out in a later process.

[0028] The placement section 13 is a portion on which the My Number card 60 is placed.

[0029] The IC card reader 14 contactlessly reads data stored in the IC chip 61 of the My Number card 60 placed on the placement unit 13. For example, the IC card reader 14 reads the data stored in the IC chip 61 by using a Near Field Communication (hereinafter referred to as "NFC") method.

[0030] The document photographing camera 15 photographs the face of the My Number card 60 placed on the placement section 13, and generates a "document photographed image."

[0031] The face photographing camera 16 photographs the face of the user 2 and generates a "face photographed image."

[0032] The display device 17 displays information and the like related to the identity verification process performed by the identity verification terminal 10. Examples of the display device 17 include a liquid crystal display, an organic electroluminescence (hereinafter referred to as "EL") display, and the like.

[0033] The operation device 18 receives operations from the user 2. Note that the display device 17 and the operation device 18 may be an integrated device such as a touch panel display, for example.

[0034] The communication device 19 controls the transmission and reception of various data to and from the business terminal 20 and the customer operation terminal 70 .

[0035] The business terminal 20 transmits an instruction to the identity verification terminal 10 to verify the identity of the user 2. The business terminal 20 is operated, for example, by a bank employee, and performs tasks such as linking a newly opened account with the personal information of the user 2.

[0036] The business terminal 20 includes a processor 21, a memory 22, a display device 23, an operation device 24, and a communication device 25. An example of the business terminal 20 is a personal computer.

[0037] The processor 21 executes a program in cooperation with the memory 22 to realize the functions of the business terminal 20. The processor 21 may be interpreted as other terms such as a controller, a CPU, or a control unit.

[0038] The memory 22 is a storage area for storing and holding computer programs and various data that realize the functions of the business terminal 20. The memory 22 is composed of, for example, a ROM, which is a non-volatile storage area, a HDD, and a RAM, which is a volatile storage area.

[0039] The display device 23 displays information related to the account opening process and the identity verification process, etc. Examples of the display device 23 include a liquid crystal display, an organic EL display, etc.

[0040] The operation device 24 receives operations from, for example, a bank employee, etc. The display device 23 and the operation device 24 may be an integrated device such as a touch panel display, for example.

[0041] The communication device 25 controls the transmission and reception of various data between the personal identification terminal 10, the bank server 30, and the signature verification server 40.

[0042] The bank server 30 stores and manages information on the created accounts. An example of the bank server 30 is a server computer.

[0043] The bank server 30 comprises a processor 31 , a memory 32 , and a communication device 33 .

[0044] The processor 31 executes a program in cooperation with the memory 32 to realize the functions of the bank server 30. Note that the processor 31 may be interpreted as other terms such as a controller, a CPU, or a control unit.

[0045] The memory 32 is a storage area for storing and holding computer programs and various data that realize the functions of the bank server 30. The memory 32 is composed of, for example, a ROM, a HDD, which are non-volatile storage areas, and a RAM, which is a volatile storage area.

[0046] The communication device 33 controls the transmission and reception of various data to and from the business terminal 20 .

[0047] The signature verification server 40 and the public authentication server 50 obtain a signature electronic certificate for the My Number card 60 and determine the validity of the My Number card 60. In this embodiment, the signature verification server 40 and the public authentication server 50 may be omitted.

[0048] The customer operation terminal 70 is a terminal through which the user 2 communicates with bank staff and the like. An example of the customer operation terminal 70 is a personal computer. In this embodiment, the customer operation terminal 70 may be omitted.

[0049] [My Number Card] Fig. 2 is a table diagram showing main information held by My Number Card 60. Fig. 3 is a schematic diagram showing an example of the card faces (front and back) of My Number Card 60. Hereinafter, the front and back of My Number Card 60 may be referred to as the first side and the second side, respectively.

[0050] As shown in FIG. 3, at least the name, address, date of birth, gender, security code, and expiration date are printed as text information 63 (see FIG. 3) on the front side of the My Number card 60. Information including the name, address, date of birth, and gender is also called the four pieces of information. In this embodiment, the four pieces of information and a personal number described later may be referred to as personal information. Furthermore, hereinafter, information including the four pieces of information may be referred to as first personal information. Furthermore, information including the personal number may be referred to as second personal information. Furthermore, a face photograph 62 is printed on the front side of the My Number card 60.

[0051] The My Number card 60 can be read without contact and has a secure IC chip 61. The IC chip 61 stores personal information of the owner of the My Number card 60.

[0052] At least the name, address, date of birth, sex, facial image data, and personal number are stored in the IC chip 61 of the My Number Card 60. The facial image data is image data generated by photographing the face of the owner of the My Number Card 60.

[0053] The My Number Card 60 has at least a verification number A, a verification number B, a signature electronic certificate PIN, a user certificate PIN, a card information input assistance PIN, and a resident basic register PIN as information used for access control to the IC chip 61. "PIN" is an abbreviation for Personal Identification Number. Hereinafter, verification number B may be referred to as the first number. Also, verification number A may be referred to as the second number.

[0054] The verification number A is acquired when the two-dimensional barcode 64 printed on the back of the My Number card 60 is read. By using the verification number A, it is possible to access the personal number and face image data stored in the IC chip 61 of the My Number card 60. In other words, by reading the two-dimensional barcode 64 printed on the back of the My Number card 60, it is possible to access the personal number and face image data stored in the IC chip 61 of the My Number card 60.

[0055] The verification number B is a combination of a six-digit date of birth, a four-digit year portion of the expiration date, and a four-digit security code, which are printed on the surface of the My Number card 60. By using the verification number B, it is possible to access the four pieces of information and face image data stored in the IC chip 61 of the My Number card 60. In other words, by acquiring the verification number B printed on the surface of the My Number card 60, it is possible to access the four pieces of information and face image data stored in the IC chip 61 of the My Number card 60.

[0056] The above-mentioned My Number card 60 is an example, and when the specifications of the My Number card 60 are changed, various information held by the My Number card 60 is read based on the changed specifications. For example, gender does not need to be written on the face of the My Number card 60, and in this case, the three pieces of information other than gender and face image data may be acquired from the IC chip 61 by using the verification number B. Also, the verification number B may be a number of a predetermined number of digits different from the 14-digit number combining the above-mentioned 6-digit date of birth, 4-digit year portion of the expiration date, and 4-digit security code. In this case, the number of the predetermined number of digits read based on the specifications of the My Number card 60 may be the verification number B.

[0057] Hereinafter, the information printed on the face of the My Number Card 60 may be referred to as face information.

[0058] [My Number Card Application] 4 is a table diagram for explaining an overview of an application of the My Number card 60. Hereinafter, an application may be referred to as AP.

[0059] As shown in FIG. 4, the IC chip 61 of the My Number card 60 has registered therein the following four applications, broadly divided into (B1) to (B4).

[0060] (B1) Card Application (Card AP) The card AP stores image data of the front information (four pieces of information (address, name, date of birth, gender) + face photo) and the back information (personal number).

[0061] (B2) Electronic Certificate Application by Public Personal Identification Service (JPKI-AP) JPKI-AP records information on "signature electronic certificates" and "user electronic certificates."

[0062] (B3) Application for assisting input of information on cards (AP for assisting input of information on cards) The card information input assistance AP records information for using the personal number and the four pieces of information as text data when carrying out administrative tasks that utilize the personal number and the four pieces of information. The information to be recorded or used is as follows: (1) Personal number and four pieces of information (and their electronic signature data) (2) Personal number (and its electronic signature data) (3) 4 Information (and its electronic data)

[0063] (B4) Resident Registration Application (Resident Registration AP) The Resident Registration AP records information for using resident registration codes as text data when handling Resident Registration Network-related affairs.

[0064] When using the face-of-card AP or (2) or (3) of the face-of-card information input assistance AP, it can be used with a verification number based on the information printed on the face of the card, but when using the two electronic certificates of the JPKI-AP, (1) of the face-of-card information input assistance AP, or the Resident Registration AP, a PIN number set when the Individual Number Card 60 is issued is used. In other words, by using the face-of-card information input assistance PIN, it is possible to access the four pieces of information and the individual number stored in the IC chip 61 of the Individual Number Card 60. Hereinafter, the face-of-card information input assistance PIN may be referred to as the PIN code or personal identification number.

[0065] [Operation] A flow of opening a new bank account for user 2 using personal identification system 1 will be described with reference to Fig. 5. Fig. 5 is a conceptual diagram of opening an account using personal identification system 1 according to the first embodiment.

[0066] User 2 applies to open a new account at a bank. Then, the bank confirms the intention of User 2 as to whether or not to link the newly opened account with User 2's personal number. After that, the bank performs identity verification processing of User 2 using My Number card 60.

[0067] When it is necessary to link an account with a personal number, the identity verification process is performed in two stages, Phase 1 and Phase 2. The identity verification terminal 10 acquires the personal number in the Phase 2 process. Furthermore, when the identity verification process is performed in two stages, that is, even when the front and back of the My Number card 60 are read, replacement of the My Number card 60 can be detected, so strict identity verification is realized. Details of the process will be described later with reference to Figs. 7 and 8.

[0068] Although identity verification processing is performed even when linking an account with a personal identification number is not required, the identity verification processing in this case corresponds to Phase 1 processing of identity verification processing when linking an account with a personal identification number is required.

[0069] Thereafter, the signature verification server 40 and the public authentication server 50 determine the validity of the My Number card 60, in other words, perform public authentication processing. If it is confirmed that the My Number card 60 is valid, an account is opened. Note that the public authentication processing may be omitted.

[0070] The opened account is then stored and managed by the bank server 30.

[0071] In the following explanation, we will focus on cases where it is necessary to link an account with a personal identification number.

[0072] Next, an example of the operation of the identity verification terminal 10, the business terminal 20, and the bank server 30 in relation to opening a new account will be described with reference to Fig. 6. Fig. 6 is a sequence diagram showing an example of the operation of the identity verification system 1 according to the first embodiment.

[0073] The business terminal 20 accepts the application for opening a new account from the user 2 and a request to link the account with a personal number (step St80). Specifically, for example, a bank employee who has confirmed the application for opening a new account from the user 2 and the intention to link the account with a personal number operates the business terminal 20.

[0074] When the business terminal 20 receives an application for opening a new account and a request to link the account with a personal number in step St80, it transmits a personal information acquisition request and an identity verification request to the identity verification terminal 10 (step St81). The personal information acquisition request is a request to acquire personal information of the user 2 who is opening a new account. The identity verification request is a request to perform identity verification processing for the user 2 who is opening a new account.

[0075] When the personal information acquisition request and the personal identification request transmitted from the business terminal 20 in step St81 are received, the personal identification terminal 10 accepts the selection of the authentication method (step St82). The details of this process will be described in steps St100 to St101 in FIG.

[0076] The personal identification terminal 10 executes personal identification processing by the authentication method accepted in step St82 (step St83). Details of this processing will be described in steps St102 to St113 in FIG. 7 and steps St114 to St132 in FIG.

[0077] If the personal identification process in step St83 is successful, the personal identification terminal 10 transmits the personal information to the business terminal 20 (step St84).

[0078] When the business terminal 20 receives the personal information of user 2 sent from the personal identification terminal 10, it creates a new account number and sends an account number creation completion notice to the personal identification terminal 10 (step St85). The account number creation completion notice notifies the fact that the creation of the account number has been completed. Although not shown in Fig. 6, if the personal identification process fails, the business terminal 20 may, for example, display on the display device 23 a message to the effect that the personal identification process has failed.

[0079] Furthermore, when public authentication processing is performed, the business terminal 20 may transmit a request to acquire a signature electronic certificate to the personal identification terminal 10 before processing of step St85, for example. In this case, the personal identification terminal 10 acquires a signature electronic certificate from the My Number card 60 and transmits it to the business terminal 20. The business terminal 20 transmits the signature-required electronic certificate to the public authentication server 50 via the signature verification server 40. The public authentication server 50 determines the validity of the My Number card 60 and transmits the determination result to the business terminal 20 via the signature verification server 40. Then, when the business terminal 20 receives a result that the My Number card 60 is valid, it proceeds to processing of step St85.

[0080] When the personal identification terminal 10 receives the account number creation completion notification transmitted from the business terminal 20, it deletes various personal information acquired during the personal identification process (step St86).

[0081] The business terminal 20 associates the newly created account number with the personal information of the user 2 (step St87).

[0082] The business terminal 20 registers a new account and transmits information about the account to the bank server 30 (step St88). Here, registering an account means confirming the opening of the account.

[0083] The bank server 30 receives and stores the account information transmitted from the business terminal 20 (step St89).

[0084] Next, the identity verification process of the user 2 by the identity verification terminal 10 will be described with reference to Figs. 7 and 8. Fig. 7 is a flowchart showing an example of the operation of the identity verification terminal 10 according to the first embodiment. Fig. 8 is a flowchart showing an example of the operation of the identity verification terminal 10 following Fig. 7. "A" and "B" shown in the respective flowcharts of Figs. 7 and 8 indicate the connection between the respective flowcharts of Figs. 7 and 8. At the start of the flowchart shown in Fig. 7, the identity verification terminal 10 has received a personal information acquisition request and an identity verification request transmitted from the business terminal 20. The identity verification document in the figure refers to the My Number card 60.

[0085] The processor 11 of the personal identification terminal 10 displays an instruction to the user 2 to place the My Number card 60 on the display device 17 (step St100). An example of the display screen will be described later with reference to FIG. 9. For ease of explanation, it is assumed that the user 2 places the My Number card 60 on the placement unit 13. It is also assumed that at this time, the document photographing camera 15 is in a state in which it can photograph the front side of the My Number card 60.

[0086] The processor 11 accepts the selection of an authentication method by the user 2 (step St101). Note that a screen for the user 2 to select an authentication method may be displayed on the display device 17 (see FIG. 9).

[0087] The processor 11 determines whether the authentication method selected by the user 2 is face authentication or password input (step St102).

[0088] If the authentication method selected by the user 2 is PIN input (step St102; PIN input), the process of the personal identification terminal 10 proceeds to step St128, where personal identification processing is performed by inputting a PIN.

[0089] First, a case where the authentication method selected by the user 2 is face authentication (step St102; face authentication) will be described.

[0090] The document photographing camera 15 of the personal identification terminal 10 photographs the face of the personal identification document and generates a photographed document image (step St103).

[0091] The processor 11 performs Optical Character Recognition (hereinafter, referred to as "OCR") on the photographed document image, and obtains a collation number B using character information 63 detected by the OCR (step St104).

[0092] The processor 11 determines whether or not the verification number B has been acquired in the process of step St104 (step St105).

[0093] When the processor 11 cannot obtain the verification number B in the process of step St104 (step St105; NO), the processor 11 advances the process to step St128 and executes the identity verification process by inputting a personal identification number. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input a personal identification number.

[0094] When the processor 11 has acquired the verification number B (step St105; YES), the processor 11 accesses the IC chip 61 of the My Number card 60 using the verification number B as an access key (step St106).

[0095] When the processor 11 cannot access the IC chip 61 (step St107; NO), the processor 11 advances the process to step St128 and executes the identity verification process by inputting the PIN. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input the PIN.

[0096] If the processor 11 can access the IC chip 61 (step St107; YES), the processor 11 reads and acquires the four information and the face image data from the IC chip 61 (step St108).

[0097] When the processor 11 cannot acquire the four information and the face image data (step St109; NO), the process proceeds to step St128, and executes the identity verification process by inputting a PIN. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input a PIN.

[0098] When the processor 11 has acquired the four information and the face image data (step St109; YES), the face photographing camera 16 photographs the face of the user 2 and generates a photographed face image (step St110).

[0099] The processor 11 compares the face image of the user 2 generated in step St110 with the face image data acquired in step St108 (step St111). The face image and the face image data may be compared, for example, by comparing face features.

[0100] When the processor 11 fails to match the photographed face image of the user 2 with the face image data (step St112; NO), the processor 11 advances the process to step St128 and executes the identity verification process by inputting a PIN. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input the PIN.

[0101] When the processor 11 has succeeded in matching the photographed face image of the user 2 with the face image data (step St112; YES), the processor 11 causes the display device 17 to display the matching result (step St113).

[0102] The process from step St103 to step St113, i.e., the series of processes surrounded by the dashed line in Fig. 7, corresponds to Phase 1 of the identity verification process shown in Fig. 5. In Phase 1, the identity verification terminal 10 verifies the identity of the user 2 by comparing face image data acquired from the IC chip 61 of the My Number card 60 using the verification number B as an access key with a face image generated by photographing the face of the user 2.

[0103] Next, the process from step St114 onwards will be described.

[0104] The processor 11 stores the photographed face image of the user 2 generated in step St110 (step St114). The photographed face image may be stored in the memory 12, for example.

[0105] The processor 11 causes the display device 17 to display an instruction to turn over the My Number card 60 (step St115). An example of the display screen will be described later with reference to FIG. 9. For ease of explanation, it is assumed that the user 2 turns over the My Number card 60 and places it on the placement unit 13. At this time, the document photographing camera 15 is in a state in which it can photograph the back side of the My Number card 60.

[0106] The document photographing camera 15 reads the two-dimensional barcode 64 on the My Number card 60 (step St116).

[0107] The processor 11 acquires the verification number A from the two-dimensional barcode 64 read by the document photographing camera 15 in step St116 (step St117).

[0108] When the processor 11 cannot obtain the verification number A (step St117; NO), the processor 11 advances the process to step St128 and executes the identity verification process by inputting a personal identification number. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input a personal identification number.

[0109] When the processor 11 has acquired the verification number A (step St117; YES), the processor 11 accesses the IC chip 61 of the My Number card 60 using the verification number A as an access key (step St118).

[0110] When the processor 11 cannot access the IC chip 61 (step St120; NO), the process proceeds to step St128, and executes identity verification processing by inputting a personal identification number. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input a personal identification number.

[0111] When the processor 11 can access the IC chip 61 (step St120; YES), the processor 11 reads and acquires the personal number and face image data from the IC chip 61 (step St121).

[0112] When the processor 11 cannot acquire the personal number and the face image data (step St122; NO), the processor 11 advances the process to step St128 and executes the identity verification process by inputting the PIN. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input the PIN.

[0113] When the processor 11 has acquired the personal number and the face image data (step St122; YES), the processor 11 reads out the face photographed image stored in step St114 (step St123).

[0114] The processor 11 compares the photographed face image of the user 2 read out in step St123 with the face image data acquired in step St121 (step St124).

[0115] When the processor 11 fails to match the captured face image of the user with the face image data (step St125; NO), the process proceeds to step St128, and executes identity verification processing by inputting a PIN. At this time, for example, a screen may be displayed on the display device 17 to instruct the user 2 to input a PIN.

[0116] When the processor 11 has succeeded in matching the photographed face image of the user with the face image data (step St125; YES), the processor 11 causes the display device 17 to display the matching result (step St126).

[0117] The process from step St114 to step St126, i.e., the series of processes surrounded by the dashed line in Fig. 8, corresponds to Phase 2 of the identity verification process shown in Fig. 5. In Phase 2, the identity verification terminal 10 verifies the identity of the user 2 by comparing face image data acquired from the IC chip 61 of the My Number card 60 using the verification number A as an access key with the face image generated by photographing the face of the user 2 in Phase 1.

[0118] After step St126, the processor 11 causes the display device 17 to display a message indicating that the identity verification has been successful and completed (step St127), and then this processing flow ends.

[0119] Next, the personal identification process based on the input of a personal identification number will be described.

[0120] The processor 11 causes the display device 17 to display a PIN code input screen (step St128). An example of the display screen will be described later with reference to FIG.

[0121] The processor 11 accepts the input of a PIN code by the user 2 (step St129). For convenience of explanation, it is assumed that the PIN code input in step St129 is a correct PIN code.

[0122] The processor 11 accesses the IC chip 61 of the My Number card 60 using the PIN code input in step St129 as an access key (step St130).

[0123] The processor 11 reads and acquires the four pieces of information and the personal number from the IC chip 61 (step St131). For the sake of convenience, it is assumed that the processor 11 has acquired the four pieces of information and the personal number.

[0124] The processor 11 causes the display device 17 to display a message indicating that the reading has been successful (step St132). Then, the processor 11 advances the process to step St127.

[0125] In this way, the identity verification terminal 10 collates the facial image data acquired based on the verification number B with the facial photographed image of the user 2, and if the collation is successful, stores the facial photographed image. Then, after the My Number card 60 is turned over, the identity verification terminal 10 collates the facial image data acquired based on the verification number A with the stored facial photographed image, and if the collation is successful, determines that the identity verification of the user 2 has been successful. If the My Number card 60 is replaced with another My Number card at the time the My Number card 60 is turned over, the collation between the facial image data acquired based on the verification number A and the stored facial photographed image will fail. Therefore, by performing identity verification processing by two-step authentication in this way, if the My Number card 60 is replaced, the replacement can be detected, and strict identity verification is realized.

[0126] Moreover, the various pieces of information deleted by the personal identification terminal 10 in step St86 shown in FIG. 6 are the photographed face image, the four pieces of information, the face image data, and the personal number, which were acquired in the process of personal identification processing.

[0127] The personal identification terminal 10 may determine that the personal identification process has failed if it is unable to acquire the verification number B or the verification number A, if it is unable to access the IC chip 61, if it is unable to acquire various information (the four pieces of information, the face image data, and the personal number) from the IC chip 61, or if face matching has failed. In this case, the personal identification terminal 10 may notify the business terminal 20 that the personal identification process has failed together with the contents of the step of the process that has failed. Furthermore, if it is determined that the personal identification process has failed, the personal identification terminal 10 may cause the display device 17 to display the determination result.

[0128] Also, in the case of identity verification processing by face authentication, for example, when face matching fails, an example has been described in which the process proceeds to identity verification processing by inputting a PIN number. However, in identity verification processing by inputting a PIN number, it is possible that identity verification fails because the user 2 cannot access the IC chip 61 of the My Number card 60 due to reasons such as forgetting the PIN code, i.e., the PIN number. In this case, a bank employee may handle identity verification of the user 2 in person or via the customer operation terminal 70. In this case, a message may be displayed on the display device 17 of the identity verification terminal 10 and the display device 23 of the business terminal 20 to the effect that individual assistance will be provided by a bank employee.

[0129] In addition, in order to explain the identity verification process separately into Phase 1 and Phase 2, the display of the matching result in step St113 and the display of the instruction to turn over the My Number Card 60 in step St115 are explained as separate steps, but these displays may be performed at the same time.

[0130] In addition, if linking with the personal number is not required, Phase 2 of the personal identification process is not performed. In this case, the process of the personal identification terminal 10 proceeds from step St113 to step St127.

[0131] [Display screen] Fig. 9 is a schematic diagram for explaining an example of a display screen of the identity verification terminal 10 according to the embodiment 1. In step St100 shown in Fig. 7, an instruction to prompt the user to place the My Number card 60 on the placement unit 13 may be displayed, as in the example of a screen 140.

[0132] In step St101 shown in FIG. 7, a screen may be displayed, as in the example of a screen 141, for the user 2 to select either face recognition or PIN entry as the authentication method.

[0133] When the authentication method is face authentication, a screen indicating that various information is being read from the IC chip 61 of the My Number card 60 may be displayed, as in the example of screen 142. For example, screen 142 may be displayed during the processing from step St103 to step St109 shown in FIG.

[0134] When the face photographing camera 16 photographs the face of the user 2 in step St110 shown in FIG. 7, a screen during photographing may be displayed, as in the example of a screen 143.

[0135] For convenience of explanation, it is assumed that face matching is successful (step St112 shown in FIG. 7; YES). In addition, in the process of step St113 shown in FIG. 7, the matching result is displayed on the display device 17, but this is omitted in FIG.

[0136] When it is necessary to link the account with the personal number, the identity verification process proceeds from Phase 1 shown in Fig. 5 and Fig. 7 to Phase 2 shown in Fig. 5 and Fig. 8. That is, the back side of the My Number card 60 is read. In step St115 shown in Fig. 8, an instruction to turn over the My Number card 60 may be displayed, as in the example of a screen 144.

[0137] A screen indicating that loading is in progress, such as screen 145, may be displayed during the processing from step St116 to step St125 shown in FIG.

[0138] For convenience of explanation, it is assumed that face matching is successful (step St125 shown in FIG. 8; YES). In addition, in the process of step St126 shown in FIG. 8, the matching result is displayed on the display device 17, but this is omitted in FIG.

[0139] In step St127 shown in FIG. 8, a screen indicating that identity verification has been completed may be displayed, as in the example of screen 146.

[0140] In addition, if there is no need to link an account with a personal number, the back of the My Number card 60 will not be read.

[0141] When the authentication method is input of a PIN, a screen for the user 2 to input the PIN may be displayed, as in the example of screen 147. This corresponds to step St128 shown in FIG.

[0142] For example, while various pieces of information are being read from the IC chip 61 in steps St130 and St131 shown in FIG. 8, a screen indicating that reading is in progress, such as screen 148, may be displayed.

[0143] (Modification of the first embodiment) In the above-mentioned embodiment 1, when the face image data acquired based on the verification number B is successfully matched with the face image of the user 2, the personal identification terminal 10 stores the face image. Then, the personal identification terminal 10 matches the face image data acquired based on the verification number A with the stored face image. However, this is not limited to this, and when the personal identification terminal 10 succeeds in matching the face image data acquired based on the verification number B with the face image of the user 2, the personal identification terminal 10 may store the face image data. In this case, the personal identification terminal 10 may match the face image data acquired based on the verification number A with the stored face image data. This is because the face image data acquired based on the verification number B and the face image data acquired based on the verification number A should be the same face image data unless the My Number card 60 placed on the placement unit 13 is replaced with another My Number card during the personal identification process.

[0144] Furthermore, the personal identification terminal (e.g., the personal identification terminal 10) may acquire a first number (e.g., a verification number B) based on face information of a first side (e.g., the front side of the My Number card 60) of the personal identification document (e.g., the My Number card 60). The personal identification terminal may then acquire first face image data and first personal information (e.g., a name) based on the first number. The personal identification terminal may then compare the first face image data with a face image generated by photographing the face of a target person (e.g., the user 2). If the comparison is successful, the personal identification terminal may store the first personal information and the first number. The personal identification terminal may then acquire the first personal information from the personal identification document using the stored first number in a state in which a camera (e.g., the document photographing camera 15) can photograph the second side (e.g., the back side of the My Number card 60) of the personal identification document. The personal identification terminal may then compare the stored first personal information with the first personal information acquired when the camera is capable of photographing the second side of the personal identification document. If the comparison is successful, the personal identification terminal may determine that the personal identification document has not been replaced. The personal identification terminal may then determine that the personal identification has been successful.

[0145] For example, when the personal identification terminal 10 has successfully collated the face image data acquired based on the verification number B with the photographed face image of the user 2, the personal identification terminal 10 may store the verification number B and the name among the four pieces of information acquired based on the verification number B. In this case, the personal identification terminal 10 may access the IC chip 61 of the My Number card 60 using the stored verification number B as an access key when the My Number card 60 is turned over, in other words, when the document photographing camera 15 can photograph the back side of the My Number card 60, and acquire the name among the four pieces of information from the IC chip 61. The personal identification terminal 10 may compare the name acquired using the verification number B before the My Number card 60 is turned over, i.e., when the document photographing camera 15 can photograph the front side of the My Number card 60, with the name acquired using the verification number B after the My Number card 60 is turned over, i.e., when the document photographing camera 15 can photograph the back side of the My Number card 60, to determine whether they match. If the two acquired names match, the identity verification terminal 10 may determine that the My Number card 60 has not been replaced and determine that identity verification has been successful. Note that, although the name has been described as an example of the four pieces of information, the address, date of birth, or gender may be acquired by the identity verification terminal 10 when the document photographing camera 15 is in a state where it can photograph the front side of the My Number card 60 and when it is in a state where it can photograph the back side of the card, and may be used for matching for identity verification.

[0146] Furthermore, the personal identification terminal (e.g., the personal identification terminal 10) may acquire a first number (e.g., a verification number B) based on face information of a first side (e.g., the front side of the My Number card 60) of the personal identification document (e.g., the My Number card 60). The personal identification terminal may then acquire first face image data based on the first number. The personal identification terminal may then compare the first face image data with a face image generated by photographing the face of the target person (e.g., the user 2). If the comparison is successful, the personal identification terminal may store the first face image data and the first number. The personal identification terminal may then acquire second face image data from the personal identification document using the stored first number in a state in which a camera (e.g., the document photographing camera 15) can photograph the second side (e.g., the back side of the My Number card 60) of the personal identification document. The personal identification terminal may then compare the stored first face image data with the second face image data. If the matching is successful, the personal identification terminal may determine that the personal identification document has not been replaced and may determine that the personal identification has been successful.

[0147] For example, when the identity verification terminal 10 has successfully collated the facial image data acquired based on the verification number B with the facial image of the user 2, the identity verification terminal 10 may store the verification number B and the facial image data. In this case, the identity verification terminal 10 may access the IC chip 61 of the My Number card 60 using the stored verification number B as an access key when the My Number card 60 is turned over, in other words, when the document photographing camera 15 can photograph the back side of the My Number card 60, and acquire the facial image data from the IC chip 61. The identity verification terminal 10 may collate the facial image data acquired using the verification number B before the My Number card 60 is turned over, i.e., when the document photographing camera 15 can photograph the front side of the My Number card 60, with the facial image data acquired using the verification number B after the My Number card 60 is turned over, i.e., when the document photographing camera 15 can photograph the back side of the My Number card 60. Then, when the identity verification terminal 10 has successfully collated the facial image data, the identity verification terminal 10 may determine that the My Number card 60 has not been replaced and determine that identity verification has been successful.

[0148] Furthermore, the personal identification terminal (e.g., the personal identification terminal 10) may acquire a first number (e.g., a verification number B) based on the face information of the first side (e.g., the front side of the My Number card 60) of the personal identification document (e.g., the My Number card 60). The personal identification terminal may then acquire first face image data based on the first number of the personal identification document. The personal identification terminal may then compare the first face image data with a face image generated by photographing the face of the target person (e.g., the user 2). If the comparison is successful, the personal identification terminal may store the first number. The personal identification terminal may then access the IC chip (e.g., the IC chip 61) of the personal identification document using the stored first number while the camera (e.g., the document photographing camera 15) is capable of photographing the second side (e.g., the back side of the My Number card 60) of the personal identification document. If the access is successful, the personal identification terminal may determine that the personal identification document has not been replaced.

[0149] For example, when the My Number card 60 is replaced with another My Number card at the time when the My Number card 60 is turned over, even if the personal identification terminal 10 has stored the verification number B, the personal identification terminal 10 cannot access the IC chip of the other My Number card using the verification number B as an access key. Therefore, the personal identification terminal 10 may determine that the My Number card 60 has not been replaced with another My Number card as follows. That is, the personal identification terminal 10 may access the IC chip 61 of the My Number card 60 to obtain the verification number B, and may store the verification number B when the face image data obtained based on the verification number B is successfully matched with the face photographed image of the user 2. Then, the personal identification terminal 10 may determine that the My Number card 60 has not been replaced when the personal identification terminal 10 can access the IC chip 61 of the My Number card 60 using the verification number B obtained when the document photographing camera 15 is capable of photographing the back side of the My Number card 60 and the document photographing camera 15 is capable of photographing the front side of the My Number card 60 as an access key. The identity verification terminal 10 may determine that the My Number card 60 has been replaced if it is able to access the IC chip 61 of the My Number card 60 using the acquired matching number B as an access key while the document photographing camera 15 is able to photograph the back side of the My Number card 60 and while the document photographing camera 15 is able to photograph the front side of the My Number card 60.

[0150] In addition, in the identity verification process, the order of reading the front side and the back side of the My Number card 60 may be reversed. In this case, when the identity verification terminal 10 successfully collates the facial image data acquired based on the verification number A with the facial image of the user 2, the identity verification terminal 10 may store the facial image. Then, the identity verification terminal 10 may collate the facial image data acquired based on the verification number B with the stored facial image. In addition, when the back side of the My Number card 60 is read before the front side is read in this manner, the verification number A may be stored. In this case, the identity verification terminal 10 may access the IC chip 61 of the My Number card 60 using the stored verification number A as an access key when the My Number card 60 is turned over, in other words, when the document photographing camera 15 can photograph the front side of the My Number card 60, and obtain the personal number from the IC chip 61. The identity verification terminal 10 may compare the personal number acquired before the My Number card 60 was turned over with the personal number acquired after the My Number card 60 was turned over to determine whether they match, and if they match, determine that identity verification was successful.

[0151] (Summary of the first embodiment) At least the following techniques are disclosed by the above description of the first embodiment. Note that, in parentheses, examples of components corresponding to the first embodiment are shown, but the present invention is not limited to these.

[0152] (Technology 1) A method for verifying the identity of a target person (e.g., user 2) based on an identification document (e.g., My Number card 60) includes obtaining first facial image data based on face information on a first side of the identification document (e.g., the front side of My Number card 60), comparing the first facial image data with a facial image generated by photographing the target person's face, and if the comparison is successful, storing the facial image or the first facial image data, obtaining second facial image data based on face information on a second side of the identification document (e.g., the back side of My Number card 60), and comparing the second facial image data with the stored facial image or first facial image data.

[0153] As a result, if the first face image data acquired from the identification document is successfully matched with the face image of the target person, the first face image data or the face image is stored. Then, the stored first face image data or the face image is matched with the second face image data acquired from the identification document. As a result, for example, if the identification document is replaced after matching the first face image data with the face image of the target person, matching between the stored first face image data or the face image and the second face image data acquired from the identification document fails. In this way, by performing matching twice, when the first and second sides of the identification document are read, it is guaranteed that the identification document when the first side is read is the same as the identification document when the second side is read, thereby realizing strict identity confirmation.

[0154] (Technology 2) In the identity verification method described in Technology 1, the identity verification document is a My Number card (e.g., My Number card 60), the face information on the first side is the date of birth, the expiration date in Gregorian calendar year, and the security code written on the first side, and the identity verification method accesses the IC chip (e.g., IC chip 61) of the My Number card using a matching number B obtained based on the face information on the first side, and obtains the first facial image data stored in the IC chip.

[0155] This enables identity verification using the My Number card. In addition, the identity verification method uses the verification number B as an access key to access the IC chip and obtain face image data stored in the IC chip.

[0156] (Technology 3) In the identity verification method described in Technology 1 or 2, the identity verification document is a My Number card, the face information on the second side is a two-dimensional barcode printed on the second side, and the identity verification method accesses the IC chip of the My Number card using a matching number A obtained based on the two-dimensional barcode and obtains the second facial image data stored in the IC chip.

[0157] This makes it possible for the personal identification method to access the IC chip using the verification number A as an access key and obtain face image data stored in the IC chip.

[0158] (Technology 4) In the personal identification method described in Technique 2, the personal identification method acquires first personal information stored in an IC chip at the same time as acquiring first face image data.

[0159] This enables the identity verification method to simultaneously obtain facial image data and personal information from the IC chip.

[0160] (Technology 5) In the identity verification method described in Technique 4, the first personal information includes name, gender, address, and date of birth.

[0161] This enables the identity verification method to simultaneously obtain facial image data and personal information including name, sex, address, and date of birth from the IC chip.

[0162] (Technology 6) In the personal identification method described in Technique 3, the personal identification method acquires second personal information stored in an IC chip at the same time as acquiring the second face image data.

[0163] This enables the identity verification method to simultaneously obtain facial image data and personal information from the IC chip.

[0164] (Technology 7) In the identity verification method described in Technique 6, the second personal information includes a personal identification number.

[0165] This makes it possible for the identity verification method to simultaneously obtain facial image data and personal information including a personal number from the IC chip.

[0166] (Technology 8) In the identity verification method according to any one of techniques 1 to 7, the identity verification document has a front side and a back side, the first side being the front side of the identity verification document and the second side being the back side of the identity verification document.

[0167] This makes it possible for the identity verification method to obtain facial image data based on the face information on both the front and back of the identity verification document.

[0168] (Technology 9) In the identity verification method described in any one of Techniques 1 to 8, if the identity verification document when the first facial image data was acquired is the same as the identity verification document when the second facial image data was acquired, the first facial image data and the second facial image data are the same data.

[0169] If the identification document when the first face image data was acquired is the same as the identification document when the second face image data was acquired, the first face image data and the second face image data are the same data. In this case, if the matching between the first face image data and the face image is successful, the matching between the second face image data and the face image is also successful.

[0170] (Technology 10) In the identity verification method described in any one of Techniques 1 to 9, if a facial photographed image is stored, the identity verification method deletes the stored facial photographed image after comparing the second facial image data with the stored facial photographed image.

[0171] This allows the stored photographed face image to be deleted, thereby protecting the privacy of the target person.

[0172] (Technology 11) In the identity verification method described in any one of Techniques 1 to 10, if the second face image data is successfully matched with the stored face image or the first face image data, the identity verification method determines that the identity of the target person has been successful, and displays the determination result on a display device.

[0173] This allows, for example, the target person to check the result of identity verification on a display device.

[0174] (Technology 12) In the identity verification method described in any one of Techniques 1 to 11, if the second face image data fails to be matched with the stored face image or the first face image data, the identity verification method determines that identity verification of the target person has failed, and displays the determination result on a display device.

[0175] This allows, for example, the target person to check the result of identity verification on a display device.

[0176] (Technology 13) An identification terminal (e.g., identification terminal 10) that performs identity verification of a target person based on an identification document includes a face camera (e.g., face camera 16) that photographs the face of the target person to generate a face image, a document camera (e.g., document camera 15) that photographs the face of the identification document to generate a document image, a processor (e.g., processor 11), and a memory (e.g., memory 12). The processor acquires first face image data based on face information acquired from the document image of the first side of the identification document, compares the first face image data with the face image, and if the comparison is successful, stores the face image or the first face image data in memory, acquires second face image data based on face information acquired from the document image of the second side of the identification document, and compares the second face image data with the face image or the first face image data stored in memory.

[0177] This allows the personal identification terminal to obtain the same effect as technique 1.

[0178] (Technology 14) An identity verification system (e.g., identity verification system 1) includes an identity verification terminal that performs identity verification of a target person based on an identity verification document, and a business terminal (e.g., business terminal 20) communicably connected to the identity verification terminal. The identity verification terminal includes a face photographing camera that photographs the face of the target person to generate a face photographed image, and a document photographing camera that photographs the face of the identity verification document to generate a document photographed image, and the identity verification terminal acquires first face image data based on face information acquired from the document photographed image of the first side of the identity verification document in response to an instruction from the business terminal, compares the first face image data with the face photographed image, and if the comparison is successful, stores the face photographed image or the first face image data in a memory, acquires second face image data based on face information acquired from the document photographed image of the second side of the identity verification document, and compares the second face image data with the face photographed image or the first face image data stored in the memory.

[0179] This allows the identity verification system to achieve the same effect as Technology 1.

[0180] (Technology 15) The program causes an identification terminal, which performs identity verification of a target person based on an identification document, to acquire first facial image data based on face information on a first side of the identification document, compare the first facial image data with a facial image generated by photographing the target person's face, and, if the comparison is successful, store the facial image or the first facial image data, acquire second facial image data based on face information on a second side of the identification document, and compare the second facial image data with the stored facial image or the first facial image data.

[0181] This allows the program to achieve the same effect as Technology 1.

[0182] (Technology 16) The identity verification method includes acquiring a first number (e.g., matching number B) based on face information of the first side of the identity verification document obtained by photographing the first side with a camera (e.g., document photography camera 15), acquiring facial image data and personal information of the target person who owns the identity verification document based on the first number, comparing the facial image data with a facial image generated by photographing the face of the target person, and if the comparison is successful, storing the first number, acquiring personal information of the target person who owns the identity verification document using the stored first number while the camera is in a state where it can photograph the second side of the identity verification document, and comparing the personal information of the target person acquired by the camera photographing the first side of the identity verification document with the personal information of the target person acquired while the camera is in a state where it can photograph the second side of the identity verification document.

[0183] Thereby, for example, personal information and face image data are acquired based on the verification number B acquired by photographing the front side of the My Number card. Then, if the face image generated by photographing the face of the target person is successfully matched with the face image data, the verification number B is stored. Then, with the back side of the My Number card being able to be photographed, the personal information of the target person is acquired using the stored verification number B. Then, the personal information acquired based on the verification number B acquired by photographing the front side of the My Number card is compared with the personal information acquired based on the verification number B with the back side of the My Number card being able to be photographed. If the result of the comparison shows that the respective personal information matches, it is determined that the My Number card has not been replaced and the identity of the target person has been successfully verified.

[0184] (Technology 17) The identity verification method includes obtaining a second number (e.g., a two-dimensional barcode 64) based on face information of the second side of the identity verification document obtained by photographing the second side with a camera, obtaining facial image data and the personal number of the target person who owns the identity verification document based on the second number, comparing the facial image data with a facial image generated by photographing the face of the target person, and if the comparison is successful, storing the second number, obtaining the personal number of the target person who owns the identity verification document using the stored second number while the camera is in a state where it can photograph the first side of the identity verification document, and comparing the personal number of the target person obtained by the camera photographing the second side of the identity verification document with the personal number of the target person obtained while the camera is in a state where it can photograph the first side of the identity verification document.

[0185] As a result, for example, a personal number and face image data are acquired based on the verification number A acquired by reading a two-dimensional barcode printed on the back side of the My Number card. Then, if the verification of the face image generated by photographing the face of the target person with the face image data is successful, the verification number A is stored. Then, the target person's personal number is acquired using the stored verification number A in a state in which the front side of the My Number card can be photographed. Then, the personal number acquired based on the verification number A acquired by photographing the back side of the My Number card is verified with the personal number acquired based on the verification number A in a state in which the front side of the My Number card can be photographed. If the verification results in a match between the respective personal numbers, it is determined that the My Number card has not been replaced and the target person's identity verification has been successful.

[0186] (Embodiment 2) In the above description of the first embodiment, an example has been described in which the identity verification terminal 10 performs identity verification of the user 2. In the description of the second embodiment, an example will be described in which the identity verification of the user 2 is performed by cooperation between the user terminal 150 (see FIG. 10) and the matching server 160 (see FIG. 10). The identity verification terminal 10 according to the first embodiment is assumed to be installed in a bank. However, the user terminal 150 is a terminal that can be personally owned by the user 2, such as a smartphone. In other words, the identity verification system 1A according to the second embodiment (see FIG. 10) is not assumed to be introduced in a bank.

[0187] In the description of the identity verification system 1A according to the second embodiment, the description of the same contents as those of the identity verification system 1 according to the first embodiment will be simplified or omitted, and the description will focus on the differences.

[0188] [System Configuration] 10 is a block diagram showing a configuration example of an identity verification system 1A according to the second embodiment. The identity verification system 1A includes a user terminal 150, a matching server 160, a bank server 30, a signature verification server 40, and a public authentication server 50. The user terminal 150 and the matching server 160 are connected to each other via wireless communication such as a wireless LAN, for example, and can transmit and receive information to and from each other. This also applies to the connections between the user terminal 150 and the bank server 30, and between the user terminal 150 and the signature verification server 40.

[0189] The user terminal 150 uses the My Number card 60 and cooperates with the verification server 160 to perform identity verification processing of the user 2. An example of the user terminal 150 is a smartphone.

[0190] The user terminal 150 includes a processor 151 , a memory 152 , an operation device 153 , a camera 154 , a display device 155 , and a communication device 156 .

[0191] The user terminal 150 also has a function of contactlessly reading data stored in the IC chip 61 of the My Number card 60. For example, the user terminal 150 supports the NFC system. In the following description, it is assumed that when the user terminal 150 accesses the IC chip 61 of the My Number card 60, communication is performed between the user terminal 150 and the IC chip 61 of the My Number card 60 using the NFC system or the like.

[0192] The processor 151 executes a computer program stored in the memory 152 to realize the functions of the user terminal 150. For example, the processor 151 executes an authentication application 157 stored in the memory 152 to perform identity verification processing of the user 2. Note that the processor 151 may be interpreted as other terms such as a controller, a CPU, or a control unit.

[0193] The memory 152 is a storage area for storing and holding computer programs that realize the functions of the user terminal 150, various data, and the like. The memory 152 is composed of, for example, a ROM, which is a non-volatile storage area, an HDD, and a RAM, which is a volatile storage area. The memory 152 stores an authentication application 157. The authentication application 157 is an application for performing identity verification, etc., required for opening a bank account. The authentication application 157 may be installed in the user terminal 150 by the user 2.

[0194] The operation device 153 receives an operation from the user 2 .

[0195] The camera 154 captures an image of the face of the My Number card 60 and generates a document image. The camera 154 also captures an image of the face of the user 2 and generates a face image.

[0196] The display device 155 displays various images, information, etc. The display device 155 and the operation device 153 may be an integrated device such as a touch panel display, for example.

[0197] The communication device 156 controls the transmission and reception of various data between the verification server 160 and the bank server 30 .

[0198] The matching server 160 performs face matching using the captured face image and face image data transmitted from the user terminal 150. An example of the matching server 160 is a server computer.

[0199] The matching server 160 includes a processor 161 , a memory 162 , and a communication device 163 .

[0200] The processor 161 executes a program in cooperation with the memory 162 to realize the functions of the matching server 160. The processor 161 may be interpreted as other terms such as a controller, a CPU, or a control unit.

[0201] The memory 162 is a storage area for storing and holding computer programs and various data that realize the functions of the matching server 160. The memory 162 is composed of, for example, a ROM, a HDD, which are non-volatile storage areas, and a RAM, which is a volatile storage area.

[0202] The communication device 163 controls the transmission and reception of various data to and from the user terminal 150 .

[0203] Description will be omitted for the bank server 30, the signature verification server 40, and the public authentication server 50. Note that in this embodiment, the signature verification server 40 and the public authentication server 50 may be omitted.

[0204] [Operation] A flow of opening a new bank account for user 2 using personal identification system 1A will be described with reference to Fig. 11. Fig. 11 is a conceptual diagram of opening an account using personal identification system 1A according to the second embodiment.

[0205] User 2 obtains authentication application 157 and applies for opening a new account by operating user terminal 150. Authentication application 157 may be provided online by the bank where user 2 applies to open an account. User 2 may obtain authentication application 157, for example, from an online store that provides various applications, or from the bank's website, etc. In the following description, it is assumed that the application for opening an account is made on authentication application 157, but this is not limiting.

[0206] Then, User 2 decides whether or not to link the newly opened account with the personal number of User 2. Here, for example, the decision may be input to authentication application 157. Thereafter, identity verification processing of User 2 using My Number card 60 is performed.

[0207] When it is necessary to link an account with a personal number, the identity verification process is performed in two stages, Phase 1 and Phase 2. The user terminal 150 acquires the personal number in the Phase 2 process. Furthermore, when the identity verification process is performed in two stages, that is, even when the front and back of the My Number card 60 are read, replacement of the My Number card 60 can be detected, so strict identity verification is realized. Details of the process will be described later with reference to Figs. 13 and 14.

[0208] Although identity verification processing is performed even when linking an account with a personal identification number is not required, the identity verification processing in this case corresponds to Phase 1 processing of identity verification processing when linking an account with a personal identification number is required.

[0209] Thereafter, the signature verification server 40 and the public authentication server 50 determine the validity of the My Number card 60, in other words, perform a public authentication process. If it is confirmed that the My Number card 60 is valid, an account is opened by the bank server 30. The public authentication process may be omitted.

[0210] Thereafter, the bank server 30 manages the newly opened account.

[0211] In the following explanation, we will focus on cases where it is necessary to link an account with a personal identification number.

[0212] FIG. 12 is a sequence diagram showing an example of the operation of the personal identification system 1A according to the second embodiment.

[0213] The user terminal 150 starts the authentication application 157 based on the operation of the user 2 (step St170).

[0214] User terminal 150 accepts an application for opening a new account from user 2 and a request for linking the account with a personal number (step St171). Specifically, for example, user 2 applies for opening a new account and applies for linking the account with a personal number through authentication application 157.

[0215] When the user terminal 150 receives an account opening application and a request to link the account with a personal number in step St171, the user terminal 150 receives a selection of an authentication method (step St172). There are two authentication methods: face authentication and PIN entry. For the sake of convenience, it is assumed that face authentication is selected as the authentication method.

[0216] When the user terminal 150 accepts the selection of face authentication as the authentication method in step St172, it performs identity verification processing of the user 2 in cooperation with the matching server 160 (step St173). Details of this processing will be described later with reference to Fig. 13 and Fig. 14. Note that, when PIN input is selected as the authentication method in step St172, the user terminal 150 performs identity verification processing independently without cooperating with the matching server 160 (see Fig. 15).

[0217] If the user terminal 150 is successful in the identity verification process in step St173, the user terminal 150 transmits the personal information to the bank server 30 (step St174).

[0218] When the bank server 30 receives the personal information of user 2 transmitted from the user terminal 150, it creates a new account number and transmits a notification of completion of account number creation to the user terminal 150 (step St175). Although not shown in Fig. 12, if the identity verification process fails, the user terminal 150 may, for example, display a message to the effect that the identity verification process has failed on the display device 155, or may transmit a message to that effect to the bank server 30.

[0219] Furthermore, when public authentication processing is performed, the user terminal 150 may obtain a signature electronic certificate from the My Number card 60, for example, before processing step St174. The user terminal 150 transmits the signature-required electronic certificate to the public authentication server 50 via the signature verification server 40. The public authentication server 50 determines the validity of the My Number card 60, and transmits the determination result to the user terminal 150 via the signature verification server 40. Then, when the user terminal 150 receives the result that the My Number card 60 is valid, it executes the processing of step St174.

[0220] When the user terminal 150 receives the account number creation completion notification transmitted from the bank server 30, it displays on the display device 155 a message indicating that the account number has been created (step St176).

[0221] The user terminal 150 deletes the various personal information acquired during the identity verification process (step St177).

[0222] The bank server 30 associates the newly created account number with the personal information of the user 2 (step St178). The bank server 30 completes the opening of the new account and stores information about the opened account (step St179).

[0223] Next, the identity verification process of user 2 by user terminal 150 and matching server 160 will be described with reference to Fig. 13 and Fig. 14. Fig. 13 is a sequence diagram showing an example of the operation of identity verification system 1A according to embodiment 2. Fig. 14 is a sequence diagram showing an example of the operation of identity verification system 1A following Fig. 13. "C" and "D" shown in the sequence diagrams of Fig. 13 and Fig. 14 respectively indicate the connection between the sequence diagrams of Fig. 7 and Fig. 8 respectively.

[0224] 13 starts, the user terminal 150 displays a screen for accepting the selection of an authentication method from the user 2. An example of the screen for accepting the selection of an authentication method is the screen 141 shown in FIG.

[0225] In the following description, the entity that executes the process may be described as the authentication application 157, but more accurately, each process of the user terminal 150 in the identity verification process is performed by the processor 151 of the user terminal 150 executing the authentication application 157. Note that the identity verification document in the drawing refers to the My Number card 60.

[0226] The authentication application 157 accepts the selection of the authentication method by the user 2 (step St180). For the sake of convenience, it is assumed that the user 2 selects face authentication as the authentication method.

[0227] The camera 154 of the user terminal 150 photographs the front side of the My Number card 60, and the authentication application 157 acquires the verification number B based on the generated photographed document image (step St181). More specifically, the authentication application 157 starts the camera 154, and the user 2 photographs the front side of the My Number card 60. This generates a photographed document image. The verification number B is acquired based on the character information 63 detected by performing OCR on the photographed document image. The authentication application 157 may cause the display device 155 to display a screen instructing the user 2 to photograph the front side of the My Number card 60.

[0228] The authentication application 157 accesses the IC chip 61 of the My Number card 60 using the verification number B acquired in step St181 as an access key (step St182).

[0229] The authentication application 157 reads and acquires the four information and the face image data from the IC chip 61 (step St183).

[0230] The camera 154 captures an image of the face of the user 2 and generates a captured face image (step St184). At this time, the camera 154 is activated by the authentication application 157. At this time, for example, the user 2 may capture an image of his / her own face by operating the user terminal 150. The authentication application 157 may also cause the display device 155 to display a screen instructing the user 2 to capture an image of his / her own face.

[0231] The authentication application 157 transmits the photographed face image of the user 2 generated in step St184 and the face image data acquired in step St183 to the verification server 160 (step St185).

[0232] The matching server 160 receives the face photographed image and the face image data transmitted from the user terminal 150 and compares them (step St186). The face photographed image and the face image data may be compared, for example, by comparing face features. For convenience of explanation, it is assumed that the matching server 160 succeeds in face matching in step St186.

[0233] The matching server 160 transmits the matching result to the user terminal 150 (step St187).

[0234] When the authentication application 157 receives the matching result transmitted from the matching server 160, The collation result is displayed on the display device 155 (step St188).

[0235] The process from step St180 to step St188, i.e., the series of processes surrounded by the dashed line in Fig. 13, corresponds to Phase 1 of the identity verification process shown in Fig. 11. In Phase 1, the user terminal 150 transmits face image data acquired from the IC chip 61 of the My Number card 60 using the verification number B as an access key and a face image generated by photographing the face of the user 2 to the matching server 160, and the matching server 160 verifies them to verify the identity of the user 2.

[0236] Next, the process from step St189 onwards will be described.

[0237] After the face matching in step St186 is successful and the matching result is transmitted to the user terminal 150 in step St187, the matching server 160 stores the photographed face image of the user 2 (step St189). The photographed face image is stored in the memory 162, for example.

[0238] After displaying the matching result on the display device 155 in step St188, the authentication application 157 subsequently displays an instruction to turn over the My Number card 60 on the display device 155 (step St190). Alternatively, the user terminal 150 may display a screen instructing to read the two-dimensional barcode 64 of the My Number card 60.

[0239] The camera 154 of the user terminal 150 reads the two-dimensional barcode 64 of the My Number card 60, and the authentication application 157 acquires the verification number A based on the two-dimensional barcode 64 (step St191). More specifically, the authentication application 157 starts the camera 154, and the user 2 causes the camera 154 to read the two-dimensional barcode 64 on the back side of the My Number card 60. This allows the authentication application 157 to acquire the verification number A based on the two-dimensional barcode 64.

[0240] The authentication application 157 accesses the IC chip 61 of the My Number card 60 using the verification number A acquired in step St191 as an access key (step St192).

[0241] The authentication application 157 reads and acquires the personal number and face image data from the IC chip 61 (step St193).

[0242] The authentication application 157 transmits the face image data acquired in step St193, that is, acquired based on the verification number A, to the verification server 160 (step St194).

[0243] When the matching server 160 receives the face image data transmitted from the user terminal 150 in step St194, the matching server 160 reads out the photographed face image stored in step St189 (step St195).

[0244] The matching server 160 matches the face image data transmitted from the user terminal 150 in step St194 with the captured face image stored in step St189 and read out in step St195 (step St196). For ease of explanation, it is assumed that the matching server 160 succeeds in face matching in step St196.

[0245] The matching server 160 transmits the matching result to the user terminal 150 (step St197).

[0246] When the authentication application 157 receives the matching result transmitted from the matching server 160, it causes the display device 155 to display the matching result (Step St198).

[0247] The process from step St189 to step St198, i.e., the series of processes surrounded by the dashed line in Fig. 14, corresponds to Phase 2 of the identity verification process shown in Fig. 11. In Phase 2, the verification server 160 verifies the identity of the user 2 by verifying the face image data acquired from the IC chip 61 of the My Number card 60 by the user terminal 150 using the verification number A as an access key with the face image generated by photographing the face of the user 2 in Phase 1.

[0248] After step St198, the authentication application 157 causes the display device 155 to display a message indicating that the identity verification process has been completed (step St199).

[0249] After step St197, the verification server 160 deletes the face image data and the photographed face image acquired in the process of the identity verification process (step St200).

[0250] In this way, the matching server 160 matches the facial image data acquired by the user terminal 150 based on the matching number B with the facial photographed image of the user 2, and if the matching is successful, stores the facial photographed image. Then, the matching server 160 matches the facial image data acquired by the user terminal 150 based on the matching number A with the stored facial photographed image. If the matching is successful, the user terminal 150 determines that the identity verification of the user 2 has been successful. For example, if the facial verification in Phase 1 is successful and the My Number card 60 is subsequently replaced with another My Number card before the two-dimensional barcode 64 of the My Number card 60 is read, the facial verification in Phase 2 fails. Therefore, by performing the identity verification process by two-step authentication in this way, if the My Number card 60 is replaced, the replacement can be detected, and strict identity verification is realized.

[0251] In step St177 shown in FIG. 12, the various personal information deleted by the user terminal 150 includes the photographed face image, the four pieces of information, the face image data, and the personal number acquired in the process of the identity verification process.

[0252] In addition, if linking with the personal number is not required, Phase 2 of the identity verification process is not performed. In this case, the process of the user terminal 150 proceeds from step St188 to step St199, and the process of the verification server 160 proceeds from step St187 to step St200.

[0253] 13 and 14 are sequence diagrams assuming that user 2 selects face authentication as the authentication method. A case in which user 2 selects PIN input as the authentication method will be described with reference to Fig. 15. Fig. 15 is a flowchart showing an example of the operation of user terminal 150 according to the second embodiment.

[0254] The authentication application 157 accepts the selection of the authentication method by the user 2 as the input of a personal identification number (step St210).

[0255] The authentication application 157 displays a PIN code input screen on the display device 155 (step St211). An example of the input screen is the screen 147 shown in FIG.

[0256] The authentication application 157 accepts the input of a PIN code by the user 2 (step St212). For ease of explanation, it is assumed that the PIN code input in step St212 is a correct PIN code.

[0257] The authentication application 157 accesses the IC chip 61 of the My Number card 60 using the PIN code entered in step St212 as an access key (step St213).

[0258] The authentication application 157 reads and acquires the four pieces of information and the personal number from the IC chip 61 (step St214). For the sake of convenience, it is assumed that the authentication application 157 has acquired the four pieces of information and the personal number.

[0259] The authentication application 157 causes the display device 155 to display a message indicating that the reading was successful (step St215).

[0260] The authentication application 157 displays on the display device 155 a message indicating that the identity verification has been completed (step St216), and then ends this processing flow.

[0261] Even if face authentication is selected as the authentication method, the user terminal 150 may determine that the identity verification process by face authentication has failed and may shift the process to step St211 shown in FIG. 15 in the following cases. The following cases are, for example, when the verification number B or verification number A cannot be acquired, when the IC chip 61 cannot be accessed, when various information (four pieces of information, face image data, and personal number) cannot be acquired from the IC chip 61, or when face verification has failed. In addition, when the user terminal 150 determines that the identity verification process has failed, it may display the determination result on the display device 155. Note that even if the identity verification process by face authentication has failed and the process has shifted to identity verification process by inputting a PIN, it is possible that the user 2 has forgotten his / her PIN and therefore cannot access the IC chip 61 of the My Number card 60, resulting in failure of identity verification. In this case, for example, a message recommending that the user inquire with a bank employee may be displayed on the display device 155.

[0262] In addition, in order to explain the identity verification process separately into Phase 1 and Phase 2, the display of the matching result in step St188 and the display of the instruction to turn over the My Number Card 60 in step St190 have been explained as separate steps, but these displays may also be performed at the same time.

[0263] (Modification of the second embodiment) In the above-mentioned second embodiment, when the matching server 160 succeeds in matching the facial image data acquired by the user terminal 150 based on the matching number B with the facial image of the user 2, the matching server 160 stores the facial image. Then, the matching server 160 matches the facial image data acquired by the user terminal 150 based on the matching number A with the stored facial image. However, this is not limited to this, and when the matching server 160 succeeds in matching the facial image data acquired by the user terminal 150 based on the matching number B with the facial image of the user 2, the matching server 160 may store the facial image data. In this case, the matching server 160 may match the facial image data acquired by the user terminal 150 based on the matching number A with the stored facial image data. This is because the facial image data acquired based on the matching number B and the facial image data acquired based on the matching number A should be the same facial image data unless the My Number card 60 used for the identity verification process is replaced with another My Number card during the identity verification process.

[0264] Furthermore, the user terminal (e.g., the user terminal 150) may acquire a first number (e.g., a verification number B) based on face information acquired from a document photographed image of the first face (e.g., the front face of the My Number card 60) of an identification document (e.g., the My Number card 60). The user terminal 150 may then acquire first face image data and first personal information (e.g., a name) based on the first number. The user terminal 150 may then transmit the photographed face image of the target person (e.g., the user 2) and the first face image data to a verification server (e.g., the verification server 160). The verification server may then verify the first face image data and the photographed face image. If the verification is successful, the verification server may transmit the verification result to the user terminal. The user terminal may then store the first number and the first personal information in response to obtaining the verification result from the verification server. The user terminal may then use the stored first number to acquire first personal information from the identification document while a camera (e.g., camera 154) is capable of capturing an image of the second side of the identification document (e.g., the back side of My Number card 60). The user terminal 150 may then compare the stored first personal information with the first personal information acquired while the camera is capable of capturing an image of the second side of the identification document. If the comparison is successful, the user terminal 150 may determine that the identification document has not been replaced. The user terminal 150 may then determine that identity verification has been successful.

[0265] For example, when the user terminal 150 receives a result of successful matching transmitted from the matching server 160 in step St187, the user terminal 150 may store the matching number B and the name among the four pieces of information acquired based on the matching number B. In this case, the user terminal 150 may access the IC chip 61 of the My Number card 60 using the stored matching number B as an access key when the My Number card 60 is turned over, in other words, when the camera 154 can photograph the back side of the My Number card 60, and acquire the name among the four pieces of information from the IC chip 61. The user terminal 150 may compare the name acquired using the matching number B before the My Number card 60 is turned over, i.e., when the camera 154 can photograph the front side of the My Number card 60, with the name acquired using the matching number B after the My Number card 60 is turned over, i.e., when the camera 154 can photograph the back side of the My Number card 60, to determine whether they match. If the two acquired names match, the user terminal 150 may determine that the My Number card 60 has not been replaced and determine that identity verification has been successful. Although the name has been described as an example of the four pieces of information, the address, date of birth, or gender may be acquired by the user terminal 150 in a state in which the camera 154 can photograph the front side of the My Number card 60 and in a state in which the camera 154 can photograph the back side of the My Number card 60, and may be used for verification for identity verification. Furthermore, the verification using any of the above-mentioned four pieces of information may be performed by the verification server 160.

[0266] Furthermore, the user terminal (e.g., user terminal 150) may acquire a first number (e.g., matching number B) based on face information acquired from a document photographed image of the first side (e.g., the front side of the My Number card 60) of an identification document (e.g., My Number card 60). The user terminal may then acquire first face image data based on the first number. The user terminal may then transmit a face photographed image of a target person (e.g., user 2) and the first face image data to a matching server (e.g., matching server 160). The matching server may then match the first face image data with the face photographed image. If the matching is successful, the matching server may then transmit the matching result to the user terminal and store the first face image data. The user terminal may then store the first number in response to acquisition of the matching result from the matching server. The user terminal may then acquire second facial image data from the identification document using the stored first number while a camera (e.g., camera 154) is capable of capturing an image of the second side of the identification document (e.g., the back side of My Number card 60). The user terminal may then transmit the second facial image data to a matching server. The matching server may then compare the stored first facial image data with the second facial image data. If the comparison is successful, the matching server may transmit the comparison result to the user terminal. The user terminal may then determine that the identification document has not been replaced in response to obtaining the comparison result. The user terminal may then determine that identity verification has been successful.

[0267] For example, when the user terminal 150 receives the result of successful matching transmitted from the matching server 160 in step St187, the matching number B may be stored. At this time, the matching server 160 may store the facial image data. In this case, the user terminal 150 may access the IC chip 61 of the My Number card 60 using the stored matching number B as an access key when the My Number card 60 is turned over, in other words, when the camera 154 can photograph the back side of the My Number card 60, and acquire the facial image data from the IC chip 61. Then, the user terminal 150 may transmit the facial image data acquired using the matching number B after the My Number card 60 is turned over, that is, when the camera 154 can photograph the back side of the My Number card 60, to the matching server 160. The matching server 160 may compare the facial image data acquired using the matching number B when the camera 154 can photograph the back side of the My Number card 60 with the stored facial image data, and transmit the matching result to the user terminal 150. Then, when the user terminal 150 receives a result indicating that the matching was successful, it may determine that the My Number card 60 has not been replaced and therefore determine that the identity verification was successful.

[0268] Furthermore, the user terminal (e.g., user terminal 150) may acquire a first number (e.g., matching number B) based on face information acquired from a photographed document image of the first side (e.g., the front side of the My Number card 60) of an identification document (e.g., My Number card 60). The user terminal may then acquire first face image data based on the first number. The user terminal may then transmit the photographed face image of the target person (e.g., user 2) and the first face image data to a matching server (e.g., matching server 160). The matching server may then match the first face image data with the photographed face image. If the matching is successful, the matching server may transmit the matching result to the user terminal. The user terminal may then store the first number in response to acquisition of the matching result from the matching server. Then, the user terminal may access the IC chip (e.g., IC chip 61) of the identification document using the stored first number while the camera (e.g., camera 154) is in a state where the second side of the identification document (e.g., the back side of the My Number card 60) can be photographed. If the access is successful, the user terminal may determine that the identification document has not been replaced.

[0269] For example, when the My Number card 60 is replaced with another My Number card at the time when the My Number card 60 is turned over, even if the user terminal 150 has stored the verification number B, the user terminal 150 cannot access the IC chip of the other My Number card using the verification number B as an access key. Therefore, the user terminal 150 may determine whether the My Number card 60 has been replaced with another My Number card as follows. That is, the personal identification terminal 10 may access the IC chip 61 of the My Number card 60 to acquire the verification number B, and when the user terminal 150 receives a verification result transmitted from the verification server 160 indicating that the facial image data acquired based on the verification number B has been successfully matched with the photographed facial image of the user 2, the user terminal 150 may store the verification number B. Then, when the user terminal 150 can access the IC chip 61 of the My Number card 60 using the verification number B acquired with the camera 154 being able to photograph the back side of the My Number card 60 and the camera 154 being able to photograph the front side of the My Number card 60, the user terminal 150 may determine that the My Number card 60 has not been replaced. The user terminal 150 may determine that the My Number card 60 has been replaced if the user terminal 150 can access the IC chip 61 of the My Number card 60 using the acquired matching number B as an access key while the camera 154 is capable of photographing the back side of the My Number card 60 and the front side of the My Number card 60.

[0270] In addition, in the identity verification process, the order of reading the front side and the back side of the My Number card 60 may be reversed. In this case, when the matching server 160 successfully matches the facial image data acquired by the user terminal 150 based on the matching number A with the photographed facial image of the user 2, the matching server 160 may store the photographed facial image. Then, the matching server 160 may match the facial image data acquired by the user terminal 150 based on the matching number B with the stored photographed facial image.

[0271] In addition, in the explanation of step St189, an example has been described in which the matching server 160 stores the captured face image in the memory 152. However, this is not limited to this, and the captured face image may be stored in the authentication application 157 or may be stored in an external server (not shown) or the like.

[0272] (Summary of the second embodiment) At least the following techniques are disclosed by the above description of the second embodiment. Note that, in parentheses, corresponding components in the second embodiment are illustrated, but the present invention is not limited to these.

[0273] (Technology 18) A matching server (e.g., matching server 160) that performs face matching of a person includes a processor (e.g., processor 161) and a memory (e.g., memory 162). The processor receives first facial image data acquired based on face information of a first side (e.g., the front side of My Number card 60) of an identification document (e.g., My Number card 60) and a facial image generated by photographing the face of a target person (e.g., user 2), matches the first facial image data with the facial image, and if the matching is successful, stores the facial image or the first facial image data in memory, receives second facial image data acquired based on face information of the second side of the identification document, and matches the second facial image data with the facial image or the first facial image data stored in memory.

[0274] As a result, if the first face image data acquired from the identification document is successfully matched with the face image of the target person, the first face image data or the face image is stored. Then, the stored first face image data or the face image is matched with the second face image data acquired from the identification document. As a result, for example, if the identification document is replaced after matching the first face image data with the face image of the target person, matching between the stored first face image data or the face image and the second face image data acquired from the identification document fails. In this way, by performing matching twice, when the first and second sides of the identification document are read, it is guaranteed that the identification document when the first side is read is the same as the identification document when the second side is read, thereby realizing strict identity confirmation.

[0275] (Technology 19) The identity verification system (for example, identity verification system 1A) includes a user terminal (for example, user terminal 150) and a matching server communicably connected to the user terminal. The user terminal includes a camera (for example, camera 154) that captures the face of a target person to generate a face image and captures the face of the identity verification document to generate a document image, acquires first face image data based on face information acquired from the document image of the first side of the identity verification document, transmits the face image of the target person and the first face image data to a matching server, and the matching server compares the first face image data with the face image, and if the comparison is successful, transmits the comparison result to the user terminal and stores the face image or the first face image data, and the user terminal transmits second face image data acquired based on face information acquired from the document image of the second side of the identity verification document to the matching server in response to acquisition of the comparison result from the matching server, and the matching server compares the second face image data with the stored face image or the first face image data.

[0276] This allows the identity verification system to achieve the same effect as technology 18.

[0277] The functions of the various embodiments described above can also be realized by supplying programs and applications for realizing the functions of the various embodiments described above to a system or device via a network or a storage medium, and having one or more processors in a computer of the system or device read and execute the programs.

[0278] Furthermore, the functions of the various embodiments described above may be realized by a circuit that realizes one or more functions (for example, an Application Specific Integrated Circuit (hereinafter, referred to as "ASIC") or an FPGA).

[0279] Although various embodiments according to the present disclosure have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can think of various modifications, corrections, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also naturally belong to the technical scope of the present disclosure. In addition, the components in the various embodiments described above may be arbitrarily combined within the scope of the invention.

[0280] For example, in the various embodiments described above, identity verification is performed during the process of opening a new bank account, and the personal number on the My Number card is obtained to link the bank account with the personal number. However, in addition to opening a new bank account, there are also situations in which strict identity verification is required to detect the replacement of the My Number card when the card is replaced, and the personal number is required to obtain the personal number. For example, the present disclosure is applicable to various bank operations and procedures other than opening a new bank account. Furthermore, the present disclosure is similarly applicable not only to bank operations and procedures, but also to administrative operations and procedures, for example.

[0281] The present disclosure can also be applied when linking an identity verification document other than the My Number Card with the personal number of the My Number Card. For example, if a terminal such as a smartphone is equipped with a My Number Card function and the terminal is equipped with a function of an identity verification document other than the My Number Card, such as a driver's license, the owner of the terminal can apply the present disclosure to link the identity verification document with the personal number. [Industrial Applicability]

[0282] The present disclosure is useful as an identity verification method, an identity verification system, an identity verification terminal, a matching server, and a program. [Explanation of symbols]

[0283] 1. 1A Identity Verification System 2. Users 10. Personal identification terminal 11, 21, 31, 151, 161 processors 12, 22, 32, 152, 162 memory 13 Placement section 14 IC card reader 15 Document Camera 16 Face Camera 17, 23, 155 Display device 18, 24, 153 Operating device 19, 25, 33, 156, 163 Communication equipment 20 Business terminals 30 Bank Server 40 Signature Verification Server 50 Public authentication server 60 My Number Card 61 IC chip 64 2D Barcode 70 Customer operation terminal 150 user terminals 154 Cameras 157 Authentication App

Claims

1. A method for verifying the identity of a person based on an identity document by an identity verification system, comprising: The identity verification system comprises a processor and a memory; The processor in cooperation with the memory obtaining the date of birth, the year of expiration, and a security code written on a first side of the identification document, and accessing an IC chip of the identification document based on the obtained face information of the first side to obtain first face image data stored in the IC chip; Comparing the first face image data with a face image generated by photographing the face of the target person; If the matching is successful, the face photographed image or the first face image data is stored in the memory; acquiring second facial image data based on a two-dimensional barcode printed on a second side of the identification document; comparing the second face image data with the photographed face image or the first face image data stored in the memory; If the face photographed image or the first face image data stored in the memory is successfully matched with the second face image data, it is determined that the personal identification document when the face photographed image or the first face image data stored in the memory was acquired is the same as the personal identification document when the second face image data was acquired, and the personal identification of the target person has been successfully performed. How you verify your identity.

2. The identity verification document is a My Number Card, accessing the IC chip of the My Number card using a verification number B obtained based on the card face information of the first side; acquiring the first face image data stored in the IC chip; The method of claim 1 .

3. The identity verification document is a My Number Card, Access the IC chip of the My Number card using the verification number A obtained based on the two-dimensional barcode, acquiring the second face image data stored in the IC chip; The method of claim 1 .

4. acquiring first personal information stored in the IC chip at the same time as acquiring the first face image data; The method for verifying identity according to claim 2.

5. The first personal information includes name, gender, address, and date of birth; The method for verifying identity according to claim 4.

6. acquiring second personal information stored in the IC chip at the same time as acquiring the second face image data; The method for verifying identity according to claim 3.

7. The second personal information includes a personal number. The method for verifying identity according to claim 6.

8. The identity verification document has a front and a back side, The first side is the front side of the identification document, and the second side is the back side of the identification document. The method of claim 1 .

9. if the face photographed image is stored, after matching the second face image data with the stored face photographed image, the stored face photographed image is deleted. The method of claim 1 .

10. When it is determined that the identity verification of the target person has been successful, the determination result is displayed on a display device. The method of claim 1 .

11. If the second face image data fails to be matched with the stored photographed face image or the first face image data, it is determined that identity verification of the target person has failed; Displaying the determination result on a display device. The method of claim 10.

12. An identity verification terminal for verifying the identity of a person based on an identity verification document, a face photographing camera for photographing the face of the target person to generate a face photographed image; a document photographing camera for photographing the face of the identity verification document to generate a document photographed image; A processor; A memory, The processor, obtaining a date of birth, a year of expiration, and a security code from the photographed image of a first side of the identification document, and accessing an IC chip of the identification document based on the obtained face information of the first side to obtain first face image data stored in the IC chip; Comparing the first face image data with the photographed face image; If the matching is successful, the face photographed image or the first face image data is stored in the memory; acquiring second face image data based on a two-dimensional barcode acquired from the photographed image of a second side of the identification document; comparing the second face image data with the photographed face image or the first face image data stored in the memory; If the face photographed image or the first face image data stored in the memory is successfully matched with the second face image data, it is determined that the personal identification document when the face photographed image or the first face image data stored in the memory was acquired is the same as the personal identification document when the second face image data was acquired, and the personal identification of the target person has been successfully performed. Identity verification terminal.

13. A matching server for matching a person's face, A processor; A memory, The processor, receiving first face image data stored in an IC chip of the identification document, the first face image data being obtained based on the date of birth, the year of expiration, and the security code written on the first face of the identification document as face information of the first face of the identification document, and a face image generated by photographing the face of the target person; Comparing the first face image data with the photographed face image; If the matching is successful, the face photographed image or the first face image data is stored in the memory; receiving second facial image data acquired based on a two-dimensional barcode printed on a second side of the identification document; comparing the second face image data with the photographed face image or the first face image data stored in the memory; a result of the matching is transmitted to a user terminal which, when receiving a result indicating that matching between the face photographed image or the first face image data stored in the memory and the second face image data has been successful, determines that the identity verification document when the face photographed image or the first face image data stored in the memory was acquired is the same as the identity verification document when the second face image data was acquired, and determines that identity verification of the target person has been successful; Matching server.

14. An identity verification system comprising: an identity verification terminal that performs identity verification of a target person based on an identity verification document; and a business terminal that is communicably connected to the identity verification terminal, The personal identification terminal includes a face camera that captures an image of the face of the target person and generates a face image, a document camera that captures an image of the face of the personal identification document and generates a document image, and a memory; The personal identification terminal, in response to an instruction from the business terminal, obtaining a date of birth, a year of expiration, and a security code from the photographed image of a first side of the identification document, and accessing an IC chip of the identification document based on the obtained face information of the first side to obtain first face image data stored in the IC chip; Comparing the first face image data with the photographed face image; If the matching is successful, the face photographed image or the first face image data is stored in the memory; acquiring second face image data based on a two-dimensional barcode acquired from the photographed image of a second side of the identification document; comparing the second face image data with the photographed face image or the first face image data stored in the memory; If the face photographed image or the first face image data stored in the memory is successfully matched with the second face image data, it is determined that the personal identification document when the face photographed image or the first face image data stored in the memory was acquired is the same as the personal identification document when the second face image data was acquired, and the personal identification of the target person has been successfully performed. Identity verification system.

15. An identity verification system comprising a user terminal and a verification server communicably connected to the user terminal, The user terminal, A camera is provided for taking an image of a face of a target person and generating a photographed image of the face, and for taking an image of a face of an identification document and generating a photographed image of the document, obtaining a date of birth, a year of expiration, and a security code from the photographed image of a first side of the identification document, and accessing an IC chip of the identification document based on the obtained face information of the first side to obtain first face image data stored in the IC chip; Transmitting the facial photographed image of the target person and the first facial image data to the matching server; The matching server includes: Comparing the first face image data with the photographed face image; If the matching is successful, the matching result is transmitted to the user terminal, and the photographed face image or the first face image data is stored; The user terminal, In response to obtaining the matching result from the matching server, transmitting second face image data obtained based on the two-dimensional barcode obtained from the photographed image of the second side of the identification document to the matching server; The matching server includes: The second face image data is compared with the stored photographed face image or the first face image data; The user terminal, If the matching server successfully matches the stored face image or the first face image data with the second face image data, it is determined that the personal identification document used when the stored face image or the first face image data was acquired is the same as the personal identification document used when the second face image data was acquired, and the personal identification of the target person has been successfully completed. Identity verification system.

16. An identity verification terminal that verifies the identity of the target person based on the identity verification document. obtaining the date of birth, the year of expiration, and a security code written on a first side of the personal identification document, accessing an IC chip of the personal identification document based on the obtained face information of the first side, and obtaining first facial image data stored in the IC chip; The first face image data is compared with a face image generated by photographing the face of the target person; If the matching is successful, the face photographed image or the first face image data is stored; acquiring second facial image data based on a two-dimensional barcode printed on a second side of the identification document; The second face image data is collated with the stored photographed face image or the first face image data; when the matching between the stored photographed face image or the first face image data and the second face image data is successful, it is determined that the personal identification document when the stored photographed face image or the first face image data was acquired is the same as the personal identification document when the second face image data was acquired, and the personal identification of the target person has been successful. program.

17. A method for verifying the identity of a person based on an identity document by an identity verification system, comprising: The identity verification system includes a camera, a processor, and a memory; The processor in cooperation with the memory acquiring the date of birth, the year of expiration, and a security code written on the first side of the identification document by photographing the first side with the camera, and acquiring a first number based on the face information of the first side; accessing an IC chip of the identification document based on the first number, and acquiring face image data and personal information of the person who possesses the identification document stored in the IC chip; The facial image data is compared with a facial photographed image generated by photographing the face of the target person; If the match is successful, storing the first number in the memory; While the camera is capable of photographing the second side of the identification document, personal information of the person who owns the identification document is acquired using the first number stored in the memory; The personal information of the target person acquired by the camera by photographing the first side of the identification document is compared with the personal information of the target person acquired by the camera in a state in which the second side of the identification document can be photographed; If the personal information of the target person acquired by the camera by photographing the first side of the identification document is successfully matched with the personal information of the target person acquired by the camera in a state in which the second side of the identification document can be photographed, it is determined that the identification document when the personal information of the target person was acquired by the camera by photographing the first side is the same as the identification document when the personal information of the target person was acquired by the camera in a state in which the second side can be photographed, and the identity of the target person has been successfully verified. How you verify your identity.

18. A method for verifying the identity of a person based on an identity document by an identity verification system, comprising: The identity verification system includes a camera, a processor, and a memory; The processor in cooperation with the memory obtaining a second number based on a two-dimensional barcode printed on the second side of the identification document obtained by photographing the second side of the identification document with the camera; accessing an IC chip of the identification document based on the second number, and acquiring face image data stored in the IC chip and a personal identification number of the person who possesses the identification document; The facial image data is compared with a facial photographed image generated by photographing the face of the target person; If the match is successful, storing the second number in the memory; While the camera is capable of photographing the first side of the identification document, the second number stored in the memory is used to obtain the personal identification number of the person who owns the identification document; The personal number of the target person obtained by the camera photographing the second side of the identification document is compared with the personal number of the target person obtained by the camera in a state in which the camera can photograph the first side of the identification document; If the personal information of the target person acquired by the camera by photographing the second side of the identification document is successfully matched with the personal information of the target person acquired by the camera in a state in which the first side of the identification document can be photographed, it is determined that the identification document when the personal information of the target person was acquired by the camera by photographing the second side is the same as the identification document when the personal information of the target person was acquired by the camera in a state in which the first side can be photographed, and the identity of the target person has been successfully verified. How you verify your identity.

Images