Identity verification system

Abstract

To improve efficiency of a task in which an operator remotely performs user identity verification.SOLUTION: In an identity verification system that includes an identity verification device that reads information of an identity verification document of a user and an operator terminal operated by an operator who remotely responds to the user, when the operator indicates identity verification, the operator terminal permits the identity verification device to read the identity verification document. The identity verification device reads the information of the identity verification document if the operator terminal permits the identity verification document to be read, and does not read the information of the identity verification document if the operator terminal does not permit the identity verification document to be read.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] The present disclosure relates to a personal identification system.

Background Art

[0002] In financial institutions, a TV counter is in operation where an operator remotely serves users. When verifying the identity of a user at the TV counter, the user shows a personal identification document such as a My Number card or a driver's license to the camera, and the operator visually confirms the shown personal identification document through the screen.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when an operator visually confirms a personal identification document through the screen, there are problems such as the characters on the personal identification document being difficult to see and having to stare hard to confirm, and there is room for improvement in work efficiency.

[0005] An object of the present disclosure is to provide a technique for improving the work efficiency of personal identification using a personal identification document from a remote location.

Means for Solving the Problems

[0006] The personal identification system according to an embodiment includes a personal identification device that reads information on a user's personal identification document, and an operator terminal operated by an operator who remotely responds to the user. When the operator instructs personal identification, the operator terminal permits the personal identification device to read the personal identification document. When the reading of the personal identification document is permitted by the operator terminal, the personal identification device executes the reading of the information on the personal identification document. When the reading of the personal identification document is not permitted by the operator terminal, the personal identification device does not execute the reading of the information on the personal identification document.

[0007] These general or specific aspects may be implemented in a system, device, method, integrated circuit, computer program, or recording medium, or may be implemented in any combination of a system, device, method, integrated circuit, computer program, and recording medium.

Advantages of the Invention

[0008] According to the present disclosure, the working efficiency of personal identification using a personal identification document from a remote location is improved.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11A

Figure 11B

Figure 12

Figure 13A

Figure 13B

Figure 14A

Figure 14B

Figure 14C

Figure 15A

Figure 15B

Figure 16A

Figure 16B

Figure 16C

Figure 17A

Figure 17B

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, a more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and redundant descriptions of substantially the same configurations may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0011] (Embodiment 1) <Information possessed by the personal identification document> FIG. 1 is a table showing the main information possessed by various types of personal identification documents 20 (see FIG. 8). FIG. 2 is a diagram showing an example of the face (front and back) of the My Number Card 31. FIG. 3 is a diagram for explaining the outline of the application (AP) of the My Number Card 31. FIG. 4 is a diagram showing an example of the identity page of the passport 32. FIG. 5 is a diagram showing an example of the face (front) of the residence card 33. FIG. 6 is a diagram showing an example of the face (front) of the driver's license 34. Next, the information possessed by various types of personal identification documents 20 will be described with reference to FIGS. 1 to 6.

[0012] On the front (face) of the My Number Card 31, as shown in FIGS. 1 and 2, at least the name, address, date of birth, gender, security code, and expiration date are printed as character information 23. The information including the name, address, date of birth, and gender is also called the four-information. In the present embodiment, the four-information may also be referred to as personal information. Further, a face photo 22 is printed on the front of the My Number Card 31.

[0013] At least the name, address, date of birth, gender, face image data, and personal number are stored in the IC chip 21 of the My Number Card 31. The face image data is image data obtained by photographing the face of the owner of the My Number Card 31.

[0014] The My Number Card 31 has at least a collation number A, a collation number B, an electronic certificate PIN for signature, a PIN for user certificate, a PIN for assisting in inputting face information, and a PIN for the basic resident register as information used for access control to the IC chip 21.

[0015] The verification number B is a number formed by combining the 6-digit date of birth, the 4-digit Gregorian calendar part of the expiration date, and the 4-digit security code, which is printed on the surface of the My Number Card 31. By using the verification number B, access can be obtained to the four pieces of information and the face photo data stored in the IC chip 21 of the My Number Card 31. That is, by obtaining the verification number B printed on the surface of the My Number Card 31, access can be obtained to the four pieces of information and the face photo data stored in the IC chip 21 of the My Number Card 31.

[0016] As shown in FIG. 3, four APs shown in the following (B1) to (B4) are registered in the IC chip 21 of the My Number Card 31 in a broad sense. (B1) Face Application (Face AP) The face AP records image data of surface information (four pieces of information (address, name, date of birth, gender) + face photo) and back information (personal number). (B2) Electronic Certificate Application by Public Personal Authentication Service (JPKI-AP) The JPKI-AP records information on "electronic certificate for signature" and "electronic certificate for user". (B3) Face Item Input Assistance Application (Face Item Input Assistance AP) The face item input assistance AP records information for using the personal number and the four pieces of information as text data when performing tasks that use the personal number and the four pieces of information. The information to be recorded or used is as follows. (1) Personal number and four pieces of information (and their electronic signature data) (2) Personal number (and its electronic signature data) (3) Four pieces of information (and their electronic data) (B4) Resident Registration Application (Resident Registration AP) The resident registration AP records information for using the resident register code as text data during resident registration network-related tasks.

[0017] Among the coupon surface AP and the coupon item input assistance AP, when using (2) or (3), it is available by the verification number based on the information described on the coupon surface. However, for the two electronic certificates of JPKI-AP and among the coupon item input assistance AP, when using (B4) the resident basic AP, the password set at the time of issuing the My Number Card 31 is used.

[0018] Note that the above-mentioned My Number Card 31 is an example. In this embodiment, when the specifications of the My Number Card 31 are changed, various information possessed by the My Number Card 31 can be read based on the changed specifications. For example, the gender may not be described on the coupon surface of the My Number Card 31. In this case, this embodiment may acquire three pieces of information excluding gender and the face image data from the IC chip 21. Also, the verification number B may be a predetermined-digit number different from the 14-digit number obtained by combining the above six digits of the date of birth, the four digits of the Gregorian calendar part of the expiration date, and the four digits of the security code. In this case, this embodiment may read the predetermined-digit number based on the specifications of the My Number Card 31 and use it as the verification number B.

[0019] On the identity item page of the passport 32, as shown in FIGS. 1 and 4, at least the name, date of birth, gender, passport number, expiration date, and Machine Readable Zone (MRZ) are printed as character information 23. Also, a face photo 22 is printed on the identity item page of the passport 32.

[0020] In the IC chip 21 of the passport 32, at least the name, date of birth, gender, face image data, and passport number are stored.

[0021] The passport 32 has at least an MRZ as information used for access control to the IC chip 21. By using the MRZ, access can be made to the information 4 and face image data stored in the IC chip 21 of the passport 32. That is, by obtaining the MRZ from the character information 23 printed on the identity page of the passport 32, access can be made to the information 4 and face image data stored in the IC chip 21 of the passport 32.

[0022] On the surface (face) of the residence card 33, as shown in FIGS. 1 and 5, at least the name, place of residence, date of birth, gender, residence card number, and expiration date are printed as character information 23. Also, a face photo 22 (in the case of 16 years old or above) is printed on the surface of the residence card 33.

[0023] In the IC chip 21 of the residence card 33, at least the place of residence, face image data, and face image data are stored. The face image data is an image of the surface of the residence card.

[0024] The residence card 33 has at least a residence card number as information used for access control to the IC chip 21. By using the residence card number, access can be made to the information 4, face image data, and face image data stored in the IC chip 21 of the residence card 33. That is, by obtaining the residence card number printed on the surface of the residence card 33, access can be made to the information 4, face image data, and face image data stored in the IC chip 21 of the residence card 33.

[0025] On the surface (face) of the driver's license 34, as shown in FIGS. 1 and 6, at least the name, address, date of birth, license number, and expiration date are printed as character information 23. Also, a face photo 22 is printed on the surface of the driver's license 34.

[0026] In the IC chip 21 of the driver's license 34, at least the name, address, date of birth, face image data, and license number are stored.

[0027] The driver's license 34 has at least PIN1 and PIN2 as information used for access control to the IC chip 21. PIN1 and PIN2 are four-digit numbers preset by the owner of the driver's license 34. By using PIN1, access can be made to the four pieces of information stored in the IC chip 21. Also, by using PIN1 and PIN2, access can be made to the face image data stored in the IC chip 21 of the driver's license 34.

[0028] Since the IC chip 21 of the identity document 20 has tamper resistance, it is very difficult to physically alter the data stored in the IC chip 21. Also, since the data stored in the IC chip 21 is provided with an electronic signature, if the data stored in the IC chip 21 is altered, the alteration can be detected.

[0029] <System Configuration> FIG. 7 is a schematic diagram showing a configuration example of the identity verification system according to Embodiment 1. The identity verification system is used, for example, for identity verification at the TV window of a financial institution.

[0030] For example, an office is equipped with an operator terminal used by an operator and monitoring equipment for monitoring the operator terminal. The operator terminal includes, for example, a touch panel PC and a video device. The touch panel PC displays an operation screen operated by the operator. The video device includes a camera, a monitor, and a speaker.

[0031] For example, a store is equipped with a store terminal used by a user and a face authentication card reader terminal connected to the store terminal by a USB cable or the like. The store terminal includes, for example, a touch panel PC and a video device. The touch panel PC displays an operation screen operated by the user. The video device includes a camera, a monitor, and a speaker.

[0032] The video device in the office transmits the video of the operator captured by the camera to the video device in the store. The video device of the store terminal transmits the video of the user captured by the camera to the video device in the office. The touch panel PC in the office displays at least the video of the user being captured. The touch panel PC in the store displays at least the video of the operator being captured. Thus, the user and the operator can communicate remotely while seeing each other's appearance through the video device.

[0033] <Configuration of Face Authentication Card Reader Terminal> FIG. 8 is a block diagram showing a configuration example of a face authentication card reader terminal according to Embodiment 1. Note that the face authentication card reader terminal may be interchangeably referred to as an identity verification device.

[0034] The face authentication card reader terminal is a device that reads information (personal information) of an identity verification document. As shown in FIG. 8, the face authentication card reader terminal includes a processor, a memory, an operation unit, a display unit, an IC reader, a placement unit, a document surface photographing camera, and a face photographing camera.

[0035] The face authentication card reader terminal captures the document surface of the identity verification document placed on the placement unit with the document surface photographing camera and generates a document surface photographed image. The face authentication card reader performs OCR on the document surface photographed image to read personal information. Alternatively, the face authentication card reader may access the IC chip of the identity verification document placed on the placement unit to read personal information.

[0036] The face authentication card reader captures the face of the user with the face photographing camera and generates a face photographed image. The face authentication card reader collates the face photographed image with the face image data held in the IC chip of the identity verification document to determine whether the user is the person indicated by the identity verification document.

[0037] <Processing Sequence> FIG. 9 is a diagram for explaining the outline of the operation of the personal identification system according to Embodiment 1. FIG. 10 is a sequence diagram showing an example of the operation performed by the personal identification system according to Embodiment 1. Next, the operation performed by the personal identification system will be described with reference to FIGS. 9 and 10.

[0038] When the operator presses the personal identification start button from the operation screen of the operator terminal (S1), the operator terminal transmits a reading instruction (reading permission) to the face authentication card reader terminal through the store terminal (S2). At this time, the operator terminal transmits an instruction (for example, a message) for the user to place the personal identification document on the placement unit to the store terminal together with the reading instruction.

[0039] The user places the personal identification document on the placement unit of the face authentication card reader terminal (S3).

[0040] Since the face authentication card reader terminal has received the reading instruction (reading permission) from the store terminal (operator terminal) in step S2, it automatically reads the personal information from the placed personal identification document (S4). Note that the face authentication card reader terminal does not read the personal information from the placed personal identification document in a state where it has not received the reading instruction from the store terminal (operator terminal) (that is, in a state where reading is not permitted). That is, even if the user places the personal identification document on the placement unit of the face authentication card reader terminal before step S2, the face authentication card reader terminal does not read the information of the personal identification document.

[0041] Note that when the personal identification document is a My Number card, the face authentication card reader terminal may perform OCR on the coupon surface captured image of the My Number card to obtain personal information (name, address, date of birth, gender, expiration date), or obtain the collation number B from the coupon surface captured image, access the IC chip, and obtain personal information (name, address, date of birth, gender) and face image data from the IC chip.

[0042] When the identity document is a driver's license, the face authentication card reader terminal may perform OCR on the front side captured image of the driver's license to obtain personal information (name, address, date of birth, license number, expiration date), and obtain a face photo from the front side captured image. Alternatively, when the identity document is a driver's license, the face authentication card reader terminal may perform OCR on the front side captured image of the driver's license to obtain personal information (name, address, date of birth, license number, expiration date), and obtain a face photo from the front side captured image. Alternatively, when the identity document is a driver's license, the face authentication card reader terminal may prompt the user to input a PIN and obtain personal information (name, address, date of birth, license number, expiration date) and face image data from the IC chip.

[0043] When the identity document is a residence card, the face authentication card reader terminal may perform OCR on the front side captured image of the residence card to obtain personal information (name, place of residence, date of birth, residence card number, expiration date), and obtain a face photo from the front side captured image. Alternatively, when the identity document is a residence card, the face authentication card reader terminal may perform OCR on the front side captured image to acquire the residence card number, access the IC chip using the residence card number, obtain the front side image data and face image data from the IC chip, and perform OCR on the front side image data to obtain personal information (name, place of residence, date of birth, residence card number, expiration date).

[0044] The face authentication card reader terminal transmits the reading result of step S4 to the operator terminal through the store terminal (S5). If the reading is successful, the reading result may include personal information and face image data.

[0045] The operator terminal displays the received reading result (S6). The operator checks this displayed reading result.

[0046] In addition, the face authentication card reader terminal captures the user's face and generates a face captured image (S7).

[0047] The face authentication card reader terminal compares the face captured image with the face image data obtained from the identity verification document, and determines whether the user is the person indicated by the identity verification document (S8).

[0048] The face authentication card reader terminal transmits the identity verification result, which is the determination result of step S8, to the operator terminal through the store terminal (S9).

[0049] The operator terminal displays the identity verification result received from the face authentication card reader (S10). The operator checks this displayed identity verification result.

[0050] Through the above processing, the user who comes to the store cannot operate the face authentication card reader terminal arbitrarily, so the operator can efficiently perform identity verification of the user remotely.

[0051] <Identity verification with My Number card> <<When identity verification is successful>> FIG. 11A and FIG. 11B are diagrams showing an example of a screen displayed on the PC monitor of the store terminal and the display unit of the face authentication card reader terminal on the store side, and the PC monitor and face monitor of the operator terminal on the office side when performing identity verification using the My Number card according to Embodiment 1, and showing an example when identity verification is successful.

[0052] (Step S101) The PC monitor of the store terminal displays the image of the operator. The face monitor of the operator terminal displays the image of the user. The PC monitor of the operator terminal displays the start screen. When the operator presses the "Identity verification" tab from the start screen, it proceeds to the next step S102.

[0053] (Step S102) The PC monitor of the store terminal displays a message indicating preparation. The PC monitor of the operator terminal displays an authentication operation screen. When the operator presses the "Start identity verification" button from the authentication operation screen, the operator terminal transmits a reading instruction to the face authentication card reader terminal and proceeds to the next step S103.

[0054] (Step S103) The PC monitor of the store terminal displays a message instructing to place the identity verification document (My Number Card or driver's license) on the placement section of the face recognition card reader terminal. Since the face recognition card reader terminal has already received a reading instruction from the operator terminal through the store terminal, it displays a message on the display section to start acceptance. The user places the My Number Card on the placement section of the face recognition card reader terminal.

[0055] (Step S104) The face recognition card reader terminal displays a message "Do not move the card" and reads personal information from the My Number Card. Here, assume that the reading of personal information from the My Number Card is successful. The face recognition card reader terminal transmits the result of successful reading of personal information to the operator terminal through the store terminal.

[0056] (Step S105) The operator terminal receives the result of successful reading of personal information from the face recognition card reader terminal. The PC monitor of the operator terminal displays a message of successful reading of the My Number Card and also displays the read personal information and face image data (face photo). The personal information includes name, address, date of birth, gender, and expiration date. The face image data may be obtained from the IC chip of the My Number Card. The operator can recognize that the reading of the user's My Number Card has been successful by looking at this.

[0057] (Step S106) The PC monitor of the store terminal displays a message such as "Please place your face within the frame of the camera of the face recognition card reader." The display unit of the face recognition card reader terminal displays a message such as "Please place your face within the frame," captures the user's face with the camera, generates and displays a face capture image. The face recognition card reader terminal compares the face capture image with the face image data of the My Number card to determine whether the user is the person indicated by the identification document (i.e., performs identity verification). Here, assume that the identity verification is successful. The face recognition card reader terminal transmits the result of successful identity verification to the operator terminal through the store terminal.

[0058] (Step S107) The PC monitor of the store terminal displays a message such as "The operator is checking the customer information." The display unit of the face recognition card reader terminal displays a message such as "Please take your card." The operator terminal receives the result of successful identity verification from the store terminal and displays a message of successful identity verification on the PC monitor. The operator checks the result displayed on the PC monitor of the operator terminal.

[0059] (Step S108) The PC monitor of the store terminal displays a message such as "The customer's identity verification procedure has been completed." The display unit of the face recognition card reader terminal displays a message such as "The reception has been completed."

[0060] Through the above processing, the operator can efficiently perform identity verification using the user's My Number card remotely.

[0061] <<When the face recognition card reader terminal fails to read the face of the My Number card>> FIG. 12 is a diagram showing an example of the screens displayed on the PC monitor of the store terminal on the store side and the display unit of the face recognition card reader terminal, and the PC monitor of the operator terminal and the face monitor on the office side when performing identity verification using the My Number card according to Embodiment 1, showing an example when the face recognition card reader terminal fails to read the face of the My Number card.

[0062] (Steps S201 - S202) Perform the same processing as Steps S101 - S102.

[0063] (Step S203) The PC monitor of the store terminal displays a message instructing the user to place the identity document (My Number Card or driver's license) on the placement section of the face authentication card reader terminal. Since the face authentication card reader terminal has already received a reading instruction from the operator terminal through the store terminal, it displays a message on the display section indicating the start of reception. The user places the My Number Card on the placement section of the face authentication card reader terminal.

[0064] (Step S204) The display section of the face authentication card reader terminal displays a message "Do not move the card" and reads personal information from the My Number Card. Here, assume that the reading of personal information from the My Number Card fails. The face authentication card reader terminal transmits the result of the failure to read personal information to the operator terminal through the store terminal.

[0065] (Step S205) The PC monitor of the store terminal displays a message indicating that the reading has failed. The display section of the face authentication card reader terminal displays a message such as "Authentication failed". The operator terminal receives the result of the failure to read personal information from the face authentication card reader terminal through the store terminal. The PC monitor of the operator terminal displays a dialog message for the failure to read the My Number Card and a "Close" button. The dialog message may display the procedure for reading the My Number Card again with the face authentication card reader terminal and the procedure for taking a picture of the My Number Card using the built - in camera. The operator checks that the reading of the user's My Number Card has failed and presses the "Close" button.

[0066] (Step S206) The PC monitor of the store terminal displays a message indicating that it is in preparation. The display unit of the face authentication card reader terminal displays a message such as "Please wait a moment". The PC monitor of the operator terminal displays an authentication operation screen.

[0067] <<When face authentication fails at the face authentication card reader terminal>> Figures 13A and 13B are diagrams showing an example of the screens displayed on the PC monitor of the store terminal and the display unit of the face authentication card reader terminal on the store side, and the PC monitor of the operator terminal and the face monitor on the office side when performing identity verification using the My Number card according to Embodiment 1, showing an example when face matching fails at the face authentication card reader terminal.

[0068] (Steps S301 - S305) Perform the same processing as Steps S101 - S105.

[0069] (Step S306) The PC monitor of the store terminal displays a message such as "Please place your face within the frame of the camera of the face authentication card reader". The display unit of the face authentication card reader terminal displays a message such as "Please place your face within the frame", captures the user's face with the camera, generates and displays a face capture image. The face authentication card reader terminal compares the face capture image with the face image data of the My Number card to determine whether the user is the person indicated by the identity verification document (i.e., performs identity verification). Here, assume that identity verification fails. The face authentication card reader terminal transmits the result of identity verification failure to the operator terminal through the store terminal.

[0070] (Step S307) The PC monitor of the store terminal displays a message such as "Face verification failed. Please wait a moment." The display unit of the face recognition card reader terminal displays a message such as "Face could not be recognized successfully." The operator terminal receives the result of failed identity verification from the store terminal and displays on the PC monitor a dialog message of failed identity verification, a "Re-perform face verification" button, and a "Close" button. The dialog message may display the procedure for re-performing face verification using the face recognition card reader terminal and the procedure for the monitor to confirm the user's face. Here, assume that the operator presses the "Re-perform face verification" button.

[0071] (Step S308) The same processing as in Step S306 is performed. Here, assume that identity verification fails again. The face recognition card reader terminal transmits the result of failed identity verification to the operator terminal through the store terminal.

[0072] (Step S309) The same processing as in Step S307 is performed. Here, assume that the operator presses the "Close" button.

[0073] (Step S310) The PC monitor of the store terminal displays a "Preparing" message. The display unit of the face recognition card reader terminal displays a message such as "Please wait a while." The PC monitor of the operator terminal displays an authentication operation screen.

[0074] <Identity verification using both sides (front and back) of the driver's license> <<When identity verification is successful>> FIG. 14A, FIG. 14B, and FIG. 14C are diagrams showing an example of the screens displayed on the PC monitor of the store terminal and the display unit of the face recognition card reader terminal on the store side, and the PC monitor of the operator terminal and the face monitor on the office side when performing identity verification using the driver's license according to Embodiment 1, and showing an example of the case where identity verification is successful.

[0075] (Step S401) The PC monitor of the store terminal displays the image of the operator. The face monitor of the operator terminal displays the image of the user. The PC monitor of the operator terminal displays the start screen. When the operator presses the "Identity Verification" tab from the start screen, the process proceeds to the next step S402.

[0076] (Step S402) The PC monitor of the store terminal displays a message indicating preparation. The PC monitor of the operator terminal displays the authentication operation screen. When the operator presses the "Start Identity Verification" button from the authentication operation screen, the operator terminal sends a reading instruction to the face authentication card reader terminal and proceeds to the next step S403.

[0077] (Step S403) The PC monitor of the store terminal displays a message instructing to place the identity verification document (My Number Card or driver's license) on the placement section of the face authentication card reader terminal. Since the face authentication card reader terminal has already received a reading instruction from the operator terminal through the store terminal, it displays a message on the display section indicating the start of reception. The user places the driver's license on the placement section of the face authentication card reader terminal.

[0078] (Step S404) The face authentication card reader terminal displays a message "Do not move the card" and reads personal information from the driver's license. Here, assume that the reading of personal information from the driver's license is successful. The face authentication card reader terminal transmits the result of successful reading of personal information to the operator terminal through the store terminal.

[0079] (Step S405) The operator terminal receives the result of successful reading of personal information from the face authentication card reader terminal through the store terminal. The PC monitor of the operator terminal displays a message indicating successful reading of the driver's license and also displays the read personal information and face image data (face photo). The personal information includes name, address, date of birth, gender, and expiration date. The face image data may be obtained from the face photo on the face of the driver's license. The operator can recognize that the reading of the user's driver's license has been successful by looking at this.

[0080] (Step S406) The PC monitor of the store terminal displays a message such as "Please place your face within the frame of the camera of the face recognition card reader." The display unit of the face recognition card reader terminal displays a message such as "Please place your face within the frame," takes a picture of the user's face with the camera, generates and displays a face capture image. The face recognition card reader terminal collates the face capture image with the face photo on the driver's license, and determines whether the user is the person indicated by the identification document (that is, performs identity verification). Here, assume that the identity verification is successful. The face recognition card reader terminal transmits the result of successful identity verification to the operator terminal through the store terminal.

[0081] (Step S407) The PC monitor of the store terminal displays a message such as "The operator is checking the customer information." The display unit of the face recognition card reader terminal displays a message such as "Please take your card." The operator terminal receives the result of successful identity verification from the store terminal and displays a message of successful identity verification on the PC monitor. The operator checks the result displayed on the PC monitor of the operator terminal.

[0082] (Step S408) The PC monitor of the store terminal displays a message such as "The customer's identity verification procedure has been completed." The display unit of the face recognition card reader terminal displays a message such as "The reception has been completed."

[0083] (Step S409) The PC monitor of the store terminal displays a message such as "Please place the driver's license on the back." The display unit of the face recognition card reader terminal displays a message such as "The reception will start. Please place the driver's license on the back." The user places the driver's license on the back and places it on the placement unit of the face recognition card reader terminal.

[0084] (Step S410) The face recognition card reader terminal displays a message saying "Please do not move the card" and takes a picture of the back of the driver's license. Here, assume that the picture of the back of the driver's license is successfully taken. The face recognition card reader terminal transmits the captured image of the back of the driver's license to the operator terminal through the store terminal.

[0085] (Step S411) The PC monitor of the store terminal displays a message such as "The operator is checking the customer information". The display unit of the face recognition card reader terminal displays a message such as "Please take the card". The user takes out the driver's license from the face recognition card reader terminal. The operator terminal receives the captured image of the back of the driver's license from the store terminal and displays a message indicating successful reading of the driver's license on the PC monitor. The operator checks the result displayed on the PC monitor of the operator terminal.

[0086] (Step S412) The PC monitor of the store terminal displays a message such as "The customer's identity verification procedure is completed". The display unit of the face recognition card reader terminal displays a message such as "The reception is completed".

[0087] Through the above processing, the operator can efficiently perform identity verification of the user using the driver's license remotely.

[0088] <<When the face recognition card reader terminal fails to read the front of the driver's license>> FIG. 15A and FIG. 15B are diagrams showing an example of the screens displayed on the PC monitor of the store terminal on the store side and the display unit of the face recognition card reader terminal, and the PC monitor and face monitor of the operator terminal on the office side when performing identity verification using the driver's license according to Embodiment 1, and show an example when the face recognition card reader terminal fails to read the front of the driver's license.

[0089] (Steps S501 - S502) Perform the same processing as Steps S401 - S402.

[0090] (Step S503) The PC monitor of the store terminal displays a message instructing to place the identity verification document (My Number Card or driver's license) on the placement section of the face recognition card reader terminal. Since the face recognition card reader terminal has already received a reading instruction from the operator terminal through the store terminal, it displays a message on the display section indicating the start of reception. The user places the driver's license on the placement section of the face recognition card reader terminal.

[0091] (Step S504) The display section of the face recognition card reader terminal displays a message "Do not move the card" and reads personal information therefrom. Here, assume that the reading of personal information from the My Number Card fails. The face recognition card reader terminal transmits the result of the failure to read personal information to the operator terminal through the store terminal.

[0092] (Step S505) The PC monitor of the store terminal displays a message indicating that the reading has failed. The display section of the face recognition card reader terminal displays a message such as "Authentication failed". The operator terminal receives the result of the failure to read personal information from the face recognition card reader terminal through the store terminal. The PC monitor of the operator terminal displays a dialog message for the failure to read the driver's license and a "Close" button. The operator checks this and confirms that the reading of the user's driver's license has failed, and presses the "Close" button.

[0093] (Step S506) The PC monitor of the store terminal displays a "Preparing" message. The display section of the face recognition card reader terminal displays a message such as "Please wait a moment". The PC monitor of the operator terminal displays an authentication operation screen.

[0094] <<When face verification of the driver's license fails with the face recognition card reader terminal>> FIG. 16A, FIG. 16B, and FIG. 16C are diagrams showing an example of the screens displayed on the PC monitor of the store terminal and the display unit of the face authentication card reader terminal on the store side, and the PC monitor of the operator terminal and the face monitor on the office side when performing identity verification using the driver's license according to Embodiment 1, and show an example of the case where face verification fails with the face authentication card reader terminal.

[0095] (Steps S601 to S605) Perform the same processing as Steps S401 to S405.

[0096] (Step S606) The PC monitor of the store terminal displays a message such as "Please place your face within the frame of the camera of the face authentication card reader." The display unit of the face authentication card reader terminal displays a message such as "Please place your face within the frame," captures the user's face with the camera, generates and displays a face capture image. The face authentication card reader terminal collates the face capture image with the face photo on the driver's license to determine whether the user is the person indicated by the identity verification document (i.e., performs identity verification). Here, it is assumed that identity verification fails. The face authentication card reader terminal transmits the result of identity verification failure to the operator terminal through the store terminal.

[0097] (Step S607) The PC monitor of the store terminal displays a message such as "Face verification has failed. Please wait a moment." The display unit of the face authentication card reader terminal displays a message such as "Your face could not be recognized successfully." The operator terminal receives the result of identity verification failure from the store terminal and displays an identity verification failure dialog message and a "Close" button on the PC monitor. Here, it is assumed that the operator presses the "Close" button.

[0098] (Step S608) The PC monitor of the store terminal displays a "Preparing" message. The PC monitor of the operator terminal displays an authentication operation screen. When the operator presses the "Start Identity Verification" button from the authentication operation screen, the operator terminal transmits a reading instruction to the face authentication card reader terminal and proceeds to the next Step S609.

[0099] (Step S609) The PC monitor of the store terminal displays a message instructing to place the identity document (My Number Card or driver's license) on the placement section of the face recognition card reader terminal. Since the face recognition card reader terminal has already received a reading instruction from the operator terminal through the store terminal, it displays a message on the display section to start the reception. The user places the driver's license on the placement section of the face recognition card reader terminal.

[0100] (Step S610) The face recognition card reader terminal displays a message "Do not move the card" and reads personal information from the driver's license. Here, assume that the reading of personal information from the driver's license is successful. The face recognition card reader terminal transmits the result of successful reading of personal information to the operator terminal through the store terminal.

[0101] (Step S611) The operator terminal receives the result of successful reading of personal information from the face recognition card reader terminal. The PC monitor of the operator terminal displays a message of successful reading of the driver's license and also displays the read personal information and face image data (face photo). The personal information includes name, address, date of birth, gender, and expiration date. The face image data may be obtained from the face photo on the face of the driver's license. The operator can recognize that the reading of the user's driver's license has been successful by looking at this.

[0102] (Step S612) The PC monitor of the store terminal displays a message such as "Please place your face within the frame of the camera of the face recognition card reader". The display section of the face recognition card reader terminal displays a message such as "Please place your face within the frame", takes a picture of the user's face with the camera, generates and displays a face captured image. The face recognition card reader terminal compares the face captured image with the face photo of the driver's license and determines whether the user is the person indicated by the identity document (that is, performs identity verification). Here, assume that the identity verification fails. The face recognition card reader terminal transmits the result of failed identity verification to the operator terminal through the store terminal.

[0103] (Step S613) The PC monitor of the store terminal displays a message such as "Face verification failed. Please wait a moment." The display unit of the face authentication card reader terminal displays a message such as "Face could not be recognized successfully." The operator terminal receives the result of failed identity verification from the store terminal and displays a dialog message of failed identity verification and a "Close" button on the PC monitor. Here, it is assumed that the operator presses the "Close" button.

[0104] (Step S614) The PC monitor of the store terminal displays a "Preparing" message. The display unit of the face authentication card reader terminal displays a message such as "Please wait a while." The PC monitor of the operator terminal displays an authentication operation screen.

[0105] <<When the photographing of the back of the driver's license is finally successful with the face authentication card reader terminal>> FIG. 17A and FIG. 17B are diagrams showing an example of the screens displayed on the PC monitor of the store terminal on the store side and the display unit of the face authentication card reader terminal, and the PC monitor of the operator terminal on the office side and the face monitor when performing identity verification using the driver's license according to Embodiment 1, showing an example when the photographing of the back of the driver's license is finally successful with the face authentication card reader terminal.

[0106] (Steps S701 - S708) Perform the same processing as Steps S401 - S408.

[0107] (Step S709) The PC monitor of the store terminal displays a message such as "Please place the driver's license on the back." The display unit of the face authentication card reader terminal displays a message such as "Acceptance starts. Please place the driver's license with the back side up." The user places the driver's license with the back side up on the placement unit of the face authentication card reader terminal.

[0108] (Step S710) The face recognition card reader terminal displays a message saying "Please do not move the card" and takes a photo of the back of the driver's license. Here, assume that the photo-taking of the back of the driver's license fails. The face recognition card reader terminal sends, through the store terminal, the fact that the photo-taking of the back of the driver's license has failed to the operator terminal.

[0109] (Step S711) The PC monitor of the store terminal displays a message such as "The reading has failed. Please wait a moment". The display unit of the face recognition card reader terminal displays a message such as "The reading has failed". The user takes out the driver's license from the face recognition card reader terminal. The operator terminal receives the fact that the photo-taking of the back of the driver's license has failed from the store terminal, and displays on the PC monitor a dialog message of the failure in photo-taking of the back of the driver's license and a "Close" button. The operator checks this and confirms that the photo-taking of the back of the user's driver's license has failed, and presses the "Close" button.

[0110] (Step S712) When the operator presses the "Back side photo-taking" button on the screen of the PC monitor of the operator terminal, the process proceeds to the next Step S713.

[0111] (Step S713) The PC monitor of the store terminal displays a message such as "Please place the driver's license with the back side up". The display unit of the face recognition card reader terminal displays a message such as "The reception will start. Please place the driver's license with the back side up". The back side of the driver's license that has been placed is already placed on the placement unit of the face recognition card reader terminal.

[0112] (Step S714) The face recognition card reader terminal displays a message saying "Please do not move the card" and takes a photo of the back of the driver's license. Here, assume that the photo-taking of the back of the driver's license is successful. The face recognition card reader terminal sends the photographed image of the back of the driver's license to the operator terminal through the store terminal.

[0113] (Step S715) The PC monitor of the store terminal displays a message such as "The operator is checking the customer information". The display unit of the face recognition card reader terminal displays a message such as "Please take out your card". The user takes out the driver's license from the face recognition card reader terminal. The operator terminal receives the photographed image of the back of the driver's license from the store terminal and displays a message of successful driver's license reading on the PC monitor. The operator checks the result displayed on the PC monitor of the operator terminal.

[0114] As described above, the embodiments have been described with reference to the accompanying drawings, but the present disclosure is not limited to such examples. It is obvious that those skilled in the art can conceive various modification examples, correction examples, substitution examples, addition examples, deletion examples, and equivalent examples within the scope described in the claims, and it is understood that these also belong to the technical scope of the present disclosure. Also, within the scope not departing from the gist of the invention, the components in the above-described embodiments may be arbitrarily combined.

Industrial Applicability

[0115] The technology of the present disclosure is useful when an operator remotely verifies the identity of a user using an identity document.

Explanation of Reference Numerals

[0116] 20 Identity document 21 IC chip 22 Facial photo 23 Character information 31 My Number card 32 Passport 33 Residence card 34 Driver's license

Claims

1. An identity verification system comprising an identity verification device that reads information from the user's identity document, and an operator terminal operated by an operator who remotely responds to the user, wherein when the operator instructs identity verification, the operator terminal permits the identity verification device to read the identity document, and when the reading of the identity document is permitted by the operator terminal, the identity verification device executes the reading of the information of the identity document, and when the reading of the identity document is not permitted by the operator terminal, the identity verification device does not execute the reading of the information of the identity document, An identity verification system.

2. The identity verification device transmits the information of the read identity document to the operator terminal, and the operator terminal displays the information of the identity document received from the identity verification device. The identity verification system according to Claim 1.

3. The identity verification device determines whether the user is the person indicated by the identity document by comparing the face image of the user included in the information of the read identity document with the face captured image of the user, and transmits the determination result to the operator terminal. The identity verification system according to Claim 2.

4. The identity document is at least one of a My Number card, a driver's license, and a residence card. The identity verification system according to Claim 1.

5. The information of the identity document is at least one of name, date of birth, address, expiration date, face image data, and face photo. The identity verification system according to Claim 1.

Images