Identity Verification System

Abstract

To provide a personal identification system for improving the efficiency of counter business which handles various transactions.SOLUTION: In a store 100, a personal identification system includes a reception terminal for receiving a user wanting a transaction, a personal identification device for performing personal identification that the user is an object person of the transaction on the basis of at least authenticity determination of a document for personal identification, and authentication that a document owner is the user about the user received at the reception terminal, a transaction counter terminal capable of executing the transaction through operation by a counter responsible person, an automatic transaction device capable of executing the transaction by operation of the user, an identification information generation part for generating identification information for uniquely identifying the user or the transaction wanted by the user and transmitting the identification information to a mobile terminal operable by the user, and a personal identification control part for controlling the personal identification device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates generally to identity verification technology. [Background technology]

[0002] In recent years, as the shift to cashless payment and operational reforms have reduced the workload of counter staff, efforts are being made to improve efficiency by promoting self-service counter operations. In addition, in order to prevent money laundering, the outflow of funds to terrorist organizations, and fraudulent transactions, which have long been problems, new online identity verification methods have been established through legal reforms, and there is a demand for operational efficiency improvements in identity verification using photo identification documents, which was previously carried out at the counter.

[0003] As a conventional technology that is expected to improve business efficiency, for example, Patent Document 1 discloses an automatic transaction system that uses two-dimensional codes to carry out transactions. The automatic transaction system disclosed in Patent Document 1 is a system that aims to shorten transaction time by simplifying input operations that are repeated every time a transaction is made by using a two-dimensional code generated from data manually entered by a customer. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2005-346129 A Summary of the Invention [Problem to be solved by the invention]

[0005] According to the above-mentioned conventional example, it is possible to shorten the transaction time for transactions in which the same amount is transferred every month. However, this conventional technology has the problem that it can only handle specific fixed-amount transactions and cannot improve the efficiency of counter operations that handle a variety of transactions.

[0006] SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to solve the above problems, that is, to provide an identity verification system that improves the efficiency of counter operations that handle a variety of transactions. [Means for solving the problem]

[0007] In order to solve such problems, the present invention provides an identity verification system for performing a series of transaction procedures including identity verification, an input information management unit that manages reception information including personal information of the user and transaction information related to a transaction desired by the user by linking the reception information to identification information based on information input by the user, and transmits first code data including the identification information to a mobile terminal operable by the user who input the information; and a reception procedure based on the user's visit to a store, in which if the user who is a store visitor has input the information, the first code data is read from a mobile terminal operable by the store visitor, and in case the user has not input the information, second code data is provided which is code data for connecting to a site where the information is input and includes identification information newly assigned to the store visitor, and the user is prompted to input the information via the mobile terminal reading the second code data. A reception terminal and the reception The procedure is completed The above Visitors Through an identity verification device and operations by the counter staff to verify the identity of the customer Prescribed A transaction window terminal capable of executing a transaction; Visitors By the operation of Specific An automated transaction device capable of executing a transaction, the reception terminal, the identity verification device, the transaction counter terminal, the automated transaction device, and the Input information management and an identity verification control unit that is communicatively connected to the identity verification device and controls the identity verification device, The above-mentioned visitor From the mobile device The first code data Read reading first and second confirmation information from an identification document provided by the customer, photographing the customer to obtain a facial image, determining the authenticity of the identification document by analyzing the first confirmation information, and verifying that the owner of the identification document is the customer by verifying that the second confirmation information matches the facial image using a facial recognition algorithm; The identity verification control unit is by If identity verification is successful, The reception information corresponding to the first code data read from the mobile terminal of the customer and at least a part of the information used in the customer's identity verification by the identity verification device are transferred to at least one of the transaction counter terminal or the automated transaction device according to the content of the transaction indicated by the transaction information included in the reception information. An identity verification system will be provided. Effect of the Invention

[0008] According to the present invention, the work of a counter that handles various transactions can be made more efficient. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram showing an example of a connection configuration of an identity verification system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a diagram showing an example of the internal configuration of a personal identification device 200. [Diagram 3] 10 is a flowchart showing an example of a processing procedure of an overall process in the present embodiment. [Figure 4] 13 is a flowchart showing a detailed example of a procedure of a reception process. [Diagram 5]13 is a flowchart showing a detailed example of a processing procedure of information input processing. [Figure 6] 13 is a flowchart showing a detailed example of a procedure for identity verification processing; [Figure 7] 13 is a flowchart showing a detailed example of a processing procedure of a transaction process. [Figure 8] FIG. 13 is a diagram showing a screen display example (part 1) of a mobile terminal 180. [Figure 9] FIG. 13 is a diagram showing a second example of a screen display of the mobile terminal 180. [Figure 10] FIG. 13 is a diagram showing a third example of a screen display of the mobile terminal 180. [Figure 11] FIG. 13 is a diagram showing a fourth example of a screen display of the mobile terminal 180. [Figure 12] 13 is a diagram showing an example of a screen display of the reception terminal 110. FIG. [Figure 13] FIG. 13 is a diagram showing a screen display example (part 1) of the personal identification device 200. [Figure 14] FIG. 2 is a diagram showing a second example of a screen display of the personal identification device 200. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] In the following description, an "interface apparatus" may refer to one or more interface devices. The one or more interface devices may be at least one of the following: One or more I / O (Input / Output) interface devices. The I / O interface device is an interface device to at least one of the I / O device and a remote display computer. The I / O interface device to the display computer may be a communications interface device. The at least one I / O device is a user interface device, and may be, for example, any one of input devices such as a keyboard and a pointing device, and output devices such as a display device. One or more communication interface devices. The one or more communication interface devices may be one or more homogeneous communication interface devices (e.g., one or more NICs (Network Interface Cards)) or two or more heterogeneous communication interface devices (e.g., a NIC and an HBA (Host Bus Adapter)).

[0011] In the following description, a "memory" is an example of one or more storage devices, and is one or more memory devices. The memory may be a volatile memory device or a non-volatile memory device, and is typically a primary memory device.

[0012] In the following description, a "persistent storage device" is an example of one or more storage devices, and refers to one or more persistent storage devices. A persistent storage device is typically a non-volatile storage device (e.g., an auxiliary storage device), and specifically, for example, a hard disk drive (HDD), a solid state drive (SSD), a non-volatile memory express (NVME) drive, or a storage class memory (SCM).

[0013] In the following description, the term "storage device" may be at least one of the above-mentioned memory and persistent storage device.

[0014] Furthermore, in the following description, a "processor" may refer to one or more processor devices. The at least one processor device may typically be a microprocessor device such as a CPU (Central Processing Unit), but may also be other types of processor devices such as a GPU (Graphics Processing Unit). The at least one processor device may be a single-core or multi-core. The at least one processor device may be a processor core. The at least one processor device may also be a broader processor device such as a circuit that is a collection of gate arrays written in a hardware description language that performs part or all of the processing (e.g., an FPGA (Field-Programmable Gate Array), a CPLD (Complex Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit)).

[0015] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0016] An example of an outline of an embodiment is as follows: That is, the identity verification system is an identity verification system that performs a series of transaction procedures including identity verification, and includes a reception terminal that receives a user who wishes to perform a transaction, an identity verification device that performs identity verification of the user that is received at the reception terminal as being the subject of the transaction based on at least determining the authenticity of an identity verification document and authenticating that the owner of the document is the user, a transaction counter terminal that can execute the transaction through an operation by a counter clerk, an automated transaction machine that can execute the transaction through an operation by the user, and a transaction counter that generates identification information that uniquely identifies the user or the transaction desired by the user. and an identification information generating unit that transmits the identification information to a mobile terminal that can be operated by the user, and an identification information generating unit that is communicatively connected to the reception terminal, the identity verification device, the transaction counter terminal, the automated transaction machine, and the identification information generating unit and controls the identity verification device, the identity verification device performs the identity verification of the user received by the reception terminal using the identification information read from the mobile terminal or input by the user, and when identity verification is successful at the identity verification device, the identity verification control unit notifies the user whether the transaction can be performed at the transaction counter terminal or the automated transaction machine. In addition, in the identity verification system, the identification information may be a unique identification number, as well as a two-dimensional code indicating information including the identification number. In the identity verification system, the identity verification control unit may deliver information required for identity verification, together with the result of identity verification at the identity verification device, to a configuration other than the identity verification device in the identity verification system. In addition, in the identity verification system, the identity verification device may have an object photographing unit that photographs the identity verification document and the mobile terminal as objects, a face photographing unit that photographs an image of the user's face, and a control unit that compares the image of the document photographed by the object photographing unit with the identification information obtained from the image of the mobile terminal photographed by the object photographing unit to determine the authenticity of the identity verification document, and compares the image of the document with the face image photographed by the face photographing unit to authenticate that the owner of the document is the user.In the identity verification system, the identity verification device may further include a display operation unit that allows the user to perform identity verification operations. In the identity verification system, the identity verification device may perform biometric authentication by authenticating a plurality of patterns of face images captured by the face photographing unit using a biometric authentication algorithm, in addition to determining the authenticity of the identity verification document and authenticating that the owner of the document is the user. In the identity verification system, the mobile terminal may be a mobile terminal owned by the user or a mobile terminal lent at the counter, and may be a smartphone, a tablet terminal, or a mobile phone. In the identity verification system, the identity verification control unit may be built into the identity verification device. In the identity verification system, the identity verification device may be built into the automated transaction device. According to the identity verification system configured as above, by transferring identity verification results between devices using a two-dimensional code or an identification number that can identify a customer, it is possible to make most of the counter operations self-service, thereby making it possible to streamline the operations of the counter that handle various transactions.

[0017] FIG. 1 is a diagram showing an example of a connection configuration of an identity verification system according to an embodiment of the present invention.

[0018] In FIG. 1, a store 100 is provided with a reception terminal 110, a transaction counter terminal 120, an automated transaction machine 130, a router 140, a personal identification control unit 190, and a personal identification device 200. Each of the reception terminal 110, the transaction counter terminal 120, the automated transaction machine 130, the personal identification control unit 190, and the personal identification device 200 is realized, for example, by a device having an interface device, a storage device, and a processor connected thereto. In addition, at least one of the reception terminal 110, the transaction counter terminal 120, the automated transaction machine 130, the personal identification control unit 190, and the personal identification device 200 may be configured to have an input device that receives input from a customer and a display device that outputs information, or the input device and the display device may be integrated. In addition, the input device and the display device may be a user interface device.

[0019] The identity verification device 200 and the reception terminal 110 are installed in a store 100 (e.g., a head office or branch office of a financial institution) and are controlled by an identity verification control unit 190. The identity verification control unit 190 is connected to a server 160 via a router 140 connected by a wired LAN (Local Area Network) or WiFi (registered trademark) of an in-house network. The transaction counter terminal 120 and the automated transaction device 130 are also installed in the store 100 and connected to the server 160 via a router 140 connected by a wired LAN of an in-house network.

[0020] When a customer (principal) makes a reservation and inputs information in advance, the customer connects the customer's mobile terminal 180 to the server 160 using the network 170 (e.g., WiFi or a mobile phone network) and inputs transaction details, personal information permission, and personal information to the server 160 via the mobile terminal 180, thereby making a reservation for the transaction date and time at the store 100 to the server 160 via the mobile terminal 180. After the reservation is completed, the server 160 generates a personal identification number (No.) that identifies the person who made the reservation and a two-dimensional code that encodes the personal identification number, and sends an email containing the generated personal identification number and two-dimensional code to the email address included in the personal information input by the customer. In this way, the server 160 registers the transaction details, personal information permission, and personal information, and registers reservation information (including, for example, information indicating the reservation of the transaction date and time), and the information is managed by the server 160, for example, linked to the generated personal identification number. The "identification number (No.)" referred to in this paragraph may be an identification number that identifies the customer himself or herself, or an identification number that identifies a reservation made by the customer. In either case, it is sufficient that at least the customer (the person himself) can be identified from the identification number. "Personal information" includes, for example, an email address, but may include other types of information (e.g., name, address, date of birth) instead of or in addition to an email address. Also, in this example, the identification number and the two-dimensional code encoding the identification number are notified to the customer by email, but other notification methods (e.g., notification by email following SMS (Short Message Service)) may be adopted instead of or in addition to email.

[0021] After entering the store, if the customer has made an advance reservation, the customer displays the two-dimensional code written in the email on the screen of mobile terminal 180 and has the two-dimensional code read by the barcode reader of reception terminal 110. If the customer does not have an advance reservation, the customer moves to reception terminal 110 installed in store 100 and has the barcode reader (e.g., an app for reading two-dimensional codes) of the customer's mobile terminal 180 read the two-dimensional code displayed on reception terminal 110. If the customer does not use his / her own mobile terminal 180, the customer borrows a mobile terminal 180 from store 100 and performs the above process using the borrowed mobile terminal 180.

[0022] When there is an advance reservation, based on the reading of the two-dimensional code by the reception terminal 110, predetermined reception information that triggers the start of identity verification for the transaction reserved in advance is transferred from the reception terminal 110 that read the two-dimensional code to the server 160 and the transaction counter terminal 120 via the identity verification control unit 190. When there is no advance reservation, the mobile terminal 180 is connected to the identity verification control unit 190 using any of WiFi, USB (Universal Serial Bus), or Bluetooth (registered trademark), and transaction details, personal information permission, and personal information are input to an access destination according to a URL (Uniform Resource Locator) represented by the two-dimensional code read by the mobile terminal 180, and the reception information including the information is transferred to the server 160. When the access destination is the server 160, the transaction details, personal information permission, and personal information are input from the mobile terminal 180 to the server 160. The "reception information" referred to in this paragraph may include, for example, personal identification information (number), transaction details, personal information permission, and personal information, and at least a portion of that information may be information read from a two-dimensional code.

[0023] When the transaction details, personal information permission, and personal information are input to the server 160, if the server 160 requires identity verification, the server 160 transmits to the mobile terminal 180 a call guide for the customer (for example, a call and guide notifying the customer that identity verification is required), together with a two-dimensional code for identifying the customer (for example, a two-dimensional code including information including the identity number obtained based on the reception information) and the identity number (for example, the identity number obtained based on the reception information). The customer has the identity verification device 200 read the two-dimensional code displayed on the mobile terminal 180, and performs a self-operation on the identity verification device 200 by the customer. In response to the operation, the identity verification device 200 captures an image of the identity verification document (for example, the front and back of the document) and the face of the customer. In this way, an image that is a part of the information required for identity verification, such as an image of the identity verification document (for example, the front and back of the document) or an image of the customer's face, is obtained. If the identity verification device 200 is unable to read the two-dimensional code, it accepts manual input of the identity verification number displayed on the mobile terminal 180 from the customer.

[0024] When the personal identification device 200 has completed acquisition of information necessary for personal identification (including, for example, an identification document and a photographed image of the face), it transfers the information to the mobile terminal 180. The mobile terminal 180 displays the information received, allowing the person to confirm the information acquired by the personal identification device 200 (information necessary for personal identification). If there is no problem as a result of the person's confirmation of the above information, the person notifies the personal identification device 200 of completion via (or not via) the mobile terminal 180. When the personal identification device 200 receives the completion notification, it transfers the fact that the confirmation has been completed and the information necessary for personal identification (information that the person has confirmed to be problem-free (including, for example, a photographed image)) to the transaction counter terminal 120. The counter clerk then makes a comprehensive judgment based on the information received and displayed by the transaction counter terminal 120 (for example, the fact that confirmation has been completed and the information necessary for personal identification). If the result of the overall judgment is normal (for example, when the transaction counter terminal 120 receives input from the counter clerk indicating that the result of the overall judgment is "normal"), the transaction counter terminal 120 transmits to the mobile terminal 180 a two-dimensional code that identifies the customer and a personal identification number, along with a call guide to call the customer to the transaction counter terminal 120 or the automated transaction device 130. For example, the information required for identity verification may include the personal identification number, transaction details, personal information permission, and at least a portion of the personal information, and therefore may include, for example, an email address. In this case, the transaction counter terminal 120 may transmit an email containing the call guide, the two-dimensional code, and the personal identification number to the email address.

[0025] When a transaction is required at the counter, the customer performs the transaction via the transaction counter terminal 120 operated by a teller. Also, when a transaction can be performed at the automated transaction apparatus 130, the customer can have the automated transaction apparatus 130 read the two-dimensional code displayed on the mobile terminal 180 and perform the transaction by self-operation. When the automated transaction apparatus 130 cannot read the two-dimensional code, the customer manually inputs the personal identification number displayed on the mobile terminal 180 into the automated transaction apparatus 130.

[0026] After completing the transaction, the customer leaves the store 100. If the customer borrowed a mobile terminal 180 at the store 100, the customer returns the mobile terminal 180 and confirms that the personal information has been completely deleted.

[0027] Fig. 2 is a diagram showing an example of the internal configuration of the personal identification device 200. The personal identification device 200 has functions related to operation and display, and is a device that a user (typically a customer) operates to perform personal identification. As shown in Fig. 2, the personal identification device 200 includes a control unit 201, an IO control unit 202, a power supply unit 203, a display operation unit 210, an operator display operation unit 211, a front photographing unit 212, a back photographing unit 213, a face photographing unit 214, a front illumination unit 215, a back illumination unit 216, a non-contact IC reading unit 217, an audio output unit 218, and an audio input unit 219.

[0028] The control unit 201 has a wired connection terminal such as USB or HDMI (High-Definition Multimedia Interface) (registered trademark) and a wireless connection terminal such as Bluetooth, and is connected to the identity verification control unit 190 via USB or Bluetooth. The display operation unit 210 is connected to the control unit 201 and includes a display unit that displays guidance and an operation unit that has a touch panel function for operation. The display operation unit 210 allows the user (the customer himself) to perform touch operations on the operation unit by instructions such as the display of a guidance screen on the operation unit and voice output from the voice output unit 218. The display operation unit 210 can ensure security by making it difficult for anyone other than the operator to see by mounting a privacy film. Furthermore, when the display operation unit 210 is an air touch operation display, operation buttons are displayed in the air in addition to the displayed guidance screen, and it is possible to operate cleanly without directly touching the screen, etc. Furthermore, in operation, operation by voice recognition is also possible by inputting voice related to the operation into the microphone of the voice input unit 219, and in this case, it is possible to operate cleanly without directly touching the screen, etc.

[0029] In the personal identification device 200 shown in FIG. 2, the process of determining the authenticity of the personal identification document, which will be described later, is performed, for example, as follows. That is, a guide (see FIG. 13) is displayed on the display unit (for example, a screen) of the display operation unit 210. The customer follows the guide and places the personal identification document with the front side facing the photographing unit. The personal identification document is assumed to be, for example, a driver's license or the like, and may be a document with a photograph of the person. The front photographing unit 212 connected to the control unit 201 photographs the front side of the personal identification document with the illumination of the front illumination unit 215 controlled by the IO control unit 202 capable of emitting multiple light sources, and the illumination of the transmission light source of the back illumination unit 216 controlled by the IO control unit 202 capable of emitting multiple light sources. The front illumination unit 215 and the back illumination unit 216 can each be equipped with a light source of visible light and special light (for example, ultraviolet light for making a special paint glow, or transmitted light for photographing a see-through image) as a plurality of light sources. In photographing the front side of the identification document, the front photographing unit 212 photographs a plurality of types of images using the above-mentioned visible light and special light, and in authenticity determination, these plurality of types of photographed images are compared with each other, so that highly accurate authenticity determination can be performed. For example, in photographing the front side of the identification document, the front photographing unit 212 may photograph a photographed image of the watermark using a light source for transmission of the back illumination unit 216, and in authenticity determination, the photographed image of the watermark may be analyzed, so that highly accurate authenticity determination can be performed. In photographing the back side, the back photographing unit 213 connected to the control unit 201 can photograph the identification document with the illumination of the back illumination unit 216 capable of irradiating a plurality of light sources, without the customer having to turn the identification document over, while the identification document is placed. By photographing the identification document as described above, the front photographing unit 212 and the back photographing unit 213 can photograph both sides of the identification document without the customer having to turn the identification document over at a predetermined placement location in the identification device 200. In addition to the light source for photographing, the backside illumination unit 216 is equipped with an ultraviolet light source (UV-C) for the purpose of sterilization, and can sterilize the top surface of the frontside photographing unit 212 while the identity verification process is being performed.The contactless IC information mounted on the identification document can also be read by the contactless IC reading unit 217 controlled by the IO control unit 202 while the identification document is still placed and the front side is photographed. Note that, in order to read the contactless IC information, input of a personal identification number may be required depending on the identification document, but the personal identification number can be input using a software key displayed on the display operation unit 210. As described above, the control unit 201, for example, can determine the authenticity of the identification document and obtain information necessary for the determination (information necessary for identity verification (including, for example, the photographed image)) using images of the front and back sides of the identification document and character information and contactless IC information recognized from these images.

[0030] In addition to determining the authenticity of the identification document, the identity verification process uses face recognition technology to verify that the customer is the owner of the identification document. For face recognition, the image of the document captured during the authenticity verification of the identification document and the image captured by the face photographing unit 214 connected to the control unit 201 are authenticated by a face recognition algorithm installed in the identity verification control unit 190 (or the identity verification device 200), thereby verifying that the customer is the owner of the identification document.

[0031] Furthermore, in this embodiment, biometric authentication may be performed in the identity verification process. For biometric authentication, for example, multiple patterns of face images are captured by the face photographing unit 214, and authentication is performed by a biometric authentication algorithm installed in the identity verification control unit 190 (or identity verification device 200), thereby preventing impersonation.

[0032] The personal identification device 200 may be equipped with a direct touch operation display or an air touch operation display. When the personal identification device 200 is equipped with an air touch operation display, operation buttons are projected in the air using holography technology, and it becomes possible to operate without touching the screen. The personal identification device 200 starts the personal identification process by having the user (customer) direct the screen of the mobile terminal 180 to the front photographing unit 212 or the back photographing unit 213 to read the two-dimensional code according to instructions such as the guide screen displayed on the display operation unit 210 and the voice output from the voice output unit 218. When reading the personal identification document, the front side is placed downward and an image is taken. Also, according to instructions such as the guide screen displayed on the display operation unit 210 and the voice output from the voice output unit 218, an image of the user's face is taken by the face photographing unit 214, thereby confirming that the owner is the owner and that the user has not been impersonated. Also, the personal identification device 200 may be equipped with an operator display operation unit 211 on the back side, and the operator can confirm the taken image and received information.

[0033] In the overall system (identification system) including the identity verification device according to this embodiment, the connection form of each component is not limited to the example shown in Figure 1 and Figure 2, and various connection configurations can be adopted as listed below. The connection configurations listed below can be combined as appropriate.

[0034] For example, in the overall system according to this embodiment, the reception terminal 110 and the router 140 may be directly connected to each other so as to be able to communicate with each other.

[0035] Furthermore, the overall system according to this embodiment is not limited to the function corresponding to the identity verification control unit 190 being implemented in an independent device as shown in FIG. 1, but may be configured, for example, such that the function corresponding to the identity verification control unit 190 is built into the identity verification device 200.

[0036] When the function corresponding to the identity verification control unit 190 is built into the identity verification device 200, for example, the identity verification device 200 and the router 140 may be connected so as to be able to directly communicate with each other. In this case, the connection between the identity verification device 200 and the router 140 may be made using any of wired LAN, WiFi, USB, Bluetooth, etc.

[0037] Furthermore, the overall system according to this embodiment is not limited to the personal identification device 200 being implemented as an independent device, but may be configured such that the functionality equivalent to the personal identification device 200 is built into the automated transaction device 130.

[0038] In addition, when the function corresponding to the personal identification device 200 is built into the automated transaction device 130, for example, the mobile terminal 180 and the automated transaction device 130 may be connected to be able to directly communicate with each other. In this case, the connection between the mobile terminal 180 and the automated transaction device 130 may be made using any of wired LAN, WiFi, USB, Bluetooth, etc.

[0039] FIG. 3 is a flowchart showing an example of a processing procedure of a series of processes for performing a predetermined transaction based on customer identity verification, as an example of the processing procedure of the entire process in this embodiment. This is a flowchart for explaining the details of some of the processes shown in FIGS. 4 to 7 and 3. FIGS. 8 to 11 are diagrams showing screen display examples (parts 1 to 4) of the mobile terminal 180. The individual contents will be described later, but the mobile terminal 180 displaying the screen display examples of FIGS. 8 to 11 may be any of a smartphone, a tablet terminal, and a mobile phone. FIG. 12 is a diagram showing a screen display example of the reception terminal 110. FIGS. 13 to 14 are diagrams showing screen display examples of the identity verification device 200. A series of processes for performing a predetermined transaction will be explained using this flow chart and screen display examples.

[0040] As shown in FIG. 3, first, a customer enters the store 100 (S101), and reception processing is carried out mainly by the reception terminal 110 (S102).

[0041] FIG. 4 is a flowchart showing a detailed example of the procedure of the reception process. According to FIG. 4, the process branches depending on whether or not the reception terminal 110 is installed in the store 100 (S201). If the store 100 does not have the reception terminal 110 (NO in S201), the store 100 lends the mobile terminal 180 with a unique reception number to the customer (S202), and the reception process ends. On the other hand, if the store 100 has the reception terminal 110, the process branches depending on whether or not information has been input and a reservation has been made in advance in the server 160 (S203). As a specific process in S203, for example, it is assumed that the reception terminal 110 displays a message asking the customer whether or not information has been input and a reservation has been made in advance, and makes a judgment depending on the content of the customer's response to the message. If information input and reservation have not been made in advance (NO in S203), the reception terminal 110 displays a two-dimensional code (a two-dimensional code including a personal identification number (No.) assigned to the customer) as illustrated in FIG. 12 (S204). FIG. 12 is a diagram showing an example of a screen display on the reception terminal 110. FIG. 12 shows an example of a screen display displayed on the display operation unit 111 (e.g., a touch operation display) of the reception terminal 110 when a personal identification number is issued, in which a two-dimensional code including information including the personal identification number assigned to the customer is displayed and the customer is instructed to read it. In response to the display in S204, the customer operates the mobile terminal 180 to read the two-dimensional code displayed on the reception terminal 110 (S205), and the reception process is terminated. Also, if information input and reservation have been made in advance in S203 (YES in S203), the customer operates the mobile terminal 180 to display on the mobile terminal 180 the two-dimensional code (see FIG. 8) received at the time of advance information input and reservation (S206). Fig. 8 is a diagram showing an example (part 1) of a screen display of the mobile terminal 180. Fig. 8 shows an example of a screen display of the mobile terminal 180 when advance information input and reservation are completed, in which the two-dimensional code received at the time of reservation is displayed, and an instruction is given to have the reception terminal read the two-dimensional code when reception starts. After S206, when the barcode reader of the reception terminal 110 reads the two-dimensional code (S207), the reception process ends.

[0042] 3, after the reception process (S102), an information input process (S103) is performed between the mobile terminal 180 and the server 160. The information input process is a process executed mainly by the reception terminal 110 and the mobile terminal 180.

[0043] Fig. 5 is a flowchart showing a detailed example of a processing procedure of the information input process. According to Fig. 5, first, it is confirmed whether or not information has been input in advance (advance input) and a reservation has been made (S301).

[0044] If there is no advance information input or reservation in S301 (NO in S301), the customer inputs information such as transaction details (see FIG. 9), personal information permission, and personal information to the access destination according to the URL indicated by the two-dimensional code read by the mobile terminal 180 provided at the reception desk or the mobile terminal 180 brought by the customer (S302). FIG. 9 is a diagram showing an example of a screen display (part 2) of the mobile terminal 180. FIG. 9 shows an example of a screen display of the mobile terminal 180 when the two-dimensional code is read and connected to the access destination when there is no advance reservation, and the customer is requested to select the purpose of the visit (transaction details). After the information is input in S302, it is confirmed whether or not a server 160 exists apart from the access destination (S303). If there is a server 160 apart from the access destination (YES in S303), the information input in S302 is transferred to the server 160 (S304), and the information input process ends. If there is no server 160 other than the access destination (for example, if the access destination is the server 160) (NO in S303), the information input process ends.

[0045] Furthermore, if advance information input and reservation have been made in S301 (YES in S301), the information has already been transferred to the server 160, so there is no need to additionally input any particular information, and the information input process ends.

[0046] 3, after the information input process (S103), a personal identification process is carried out (S104). The personal identification process is a process executed mainly by the personal identification device 200.

[0047] FIG. 6 is a flowchart showing a detailed example of a procedure of the identity verification process. According to FIG. 6, first, whether identity verification is necessary is confirmed (S401). If identity verification is not necessary (NO in S401), the identity verification device 200 (control unit 201) transfers a confirmation completion notice and information (e.g., reception information) to the transaction window terminal 120 (S410). If identity verification is necessary (YES in S401), the device waits for a call (S402) and periodically determines whether a call is made (S403). If a call is made after waiting (YES in S403), the customer displays a two-dimensional code and an identity identification number on the mobile terminal 180 (see FIG. 10) (S404). FIG. 10 is a diagram showing an example (part 3) of a screen display on the mobile terminal 180. FIG. 10 shows an example of a screen display during identity verification, instructing the reception terminal 110 (which may be read as identity verification device 200) to input information required for identity verification (reading a two-dimensional code or inputting a personal identification number (No.)). When the customer reads the two-dimensional code or manually inputs the personal identification number as displayed in S404, the identity verification device 200 starts identity verification (S405).

[0048] When identity verification is started, the customer places the identity verification document to be used for certification on the identity verification device 200 in accordance with the screen of the identity verification device 200 (see FIG. 13). FIG. 13 is a diagram showing a screen display example (part 1) of the identity verification device 200. When identity verification is started, a guide display as shown in FIG. 13 is displayed on the display operation unit 210 of the identity verification device 200, so that the customer can be prompted to execute an operation to place the identity verification document in a predetermined place on the identity verification device 200. When the identity verification document is placed in a predetermined place on the identity verification device 200, the identity verification device 200 performs at least one of acquiring information from an IC (Integrated Circuit) of the identity verification document (e.g., a passport or a driver's license) and reading images of the front and back of the identity verification document, and photographing an image of the face of the customer, determines the authenticity, and acquires auxiliary information for authenticity, information indicating that the owner is the actual person, and information for confirming that the person has not been impersonated (S406). Here, if the mobile terminal 180 is a loaned mobile terminal, the information input to the mobile terminal 180 (for example, a manually input personal identification number) is transferred to the personal identification device 200 (S407). In S407, the personal identification device 200 may display the acquired information each time a predetermined type of information is acquired (for example, when the front and back images of the personal identification document are read), to have the customer (person) check the accuracy and visibility of the information (see FIG. 14), and if the customer answers "OK", proceed to the next process of S408. FIG. 14 is a diagram showing a screen display example (part 2) of the personal identification device 200. At the start of personal identification, the display operation unit 210 of the personal identification device 200 displays a guide display as shown in FIG. 14, so that the contents of the transaction desired by the customer, an image of the personal identification document, etc. are displayed, and the customer checks these displayed contents, and if there are no problems, touches "Next" to proceed to the process of S408. The screen display as shown in FIG. 14 may also be displayed on the operator display operation unit 211 of the personal identification device 200.

[0049] When the personal identification device 200 has acquired all the information necessary for personal identification through the processes of S405 to S407, the personal identification device 200 transfers the information (for example, at least a part of the information read from the IC of the personal identification document, the front and back images of the personal identification document, the photographed face image of the person, the information indicating the authenticity determination result, the auxiliary information of authenticity, the information indicating that the owner is the person himself, and the information for confirming that the person has not been impersonated) to the mobile terminal 180 (S408). Next, the customer himself confirms the information received by the mobile terminal 180 (S409). The confirmation result (determination result) in S409 is notified to the personal identification device 200 (control unit 201) by the customer inputting corresponding to the determination result into the mobile terminal 180. Then, when it is determined that there is a problem in S409 (NG in S409), the personal identification device 200 returns to S404 and repeats the process. On the other hand, if it is determined in S409 that there is no problem (OK in S409), the mobile terminal 180 notifies the identity verification device 200 of completion, and the completion of the identity verification and information necessary for the identity verification (including, for example, an image) are transferred from the mobile terminal 180 or the identity verification device 200 to the transaction counter terminal 120 (S410). Note that at this time, the completion of the identity verification and the information necessary for the identity verification may also be transferred to a device other than the transaction counter terminal 120 (for example, the automated transaction device 130 or the server 160). Then, based on the information and image received by the transaction counter terminal 120, a counter clerk makes a comprehensive judgment to determine the final judgment result in the identity verification process (S411), and ends the identity verification process.

[0050] 3, after the completion of the identity verification process (S104), the transaction process is carried out (S105). The transaction process is carried out by the mobile terminal 180, the identity verification device 200, the transaction counter terminal 120, the automated transaction device 130, etc., executing corresponding processes in response to various operations by the customer.

[0051] FIG. 7 is a flowchart showing a detailed example of a processing procedure of a transaction process. According to FIG. 7, first, the customer waits until he is called (S501). If the result of the above-mentioned comprehensive judgment by the teller (S411 in FIG. 6) is normal, a call guide is given to the customer (YES in S502), and a two-dimensional code and a personal identification number (No.) are displayed on the mobile terminal 180 (see FIG. 11) (S503). FIG. 11 is a diagram showing an example of a screen display (part 4) of the mobile terminal 180. FIG. 11 shows an example of a call guide for a customer when a transaction is possible at the automated transaction device 130. The call guide display may inform the customer of whether the transaction is possible at the automated transaction device 130 or at the counter where the transaction counter terminal 120 is installed. Also, if it is determined that the transaction is not possible, a call guide may be given to the customer to come to the counter. That is, depending on the contents of the call guide display in S503, the progress of the subsequent transaction branches as shown in S3804 and S3805. The branch destination of S3804 and S3805 is determined by the personal identification control unit 190, but the control unit 201 of the personal identification device 200 may act on its behalf. Specifically, a branch is made in S504 as to whether the transaction is possible, and if the transaction is impossible (NO in S504), the person at the counter explains the reason why the transaction is impossible (S505) at the transaction counter, and the transaction processing is terminated. If the transaction is possible (YES in S504), a branch is made in S506 as to whether the transaction is to be performed at the counter (transaction counter terminal 120) or the automated transaction device 130. If the transaction counter terminal 120 is used in the transaction ("Counter" in S506), the transaction is executed through the operation of the transaction counter terminal 120 by the person at the counter (S507). When the automated transaction machine 130 is used in the transaction ("automated transaction machine" in S506), the automated transaction machine 130 reads the two-dimensional code displayed on the mobile terminal 180 (or receives a manual input of a personal identification number (No.)) (S508), and the transaction is executed using the automated transaction machine 130 (S509). After the transaction is completed in S507 or S509, the customer leaves the store, but before leaving, it is confirmed whether the customer has borrowed the mobile terminal 180 at the store 100 (S510).If the customer has borrowed the mobile terminal 180 (YES in S510), the customer returns the mobile terminal 180 (S511), and after confirming that the personal information has been completely deleted from the mobile terminal 180 (S512), leaves the store (S106 in FIG. 3). On the other hand, if the customer has not borrowed the mobile terminal 180 (NO in S510), the customer simply leaves the store (S106 in FIG. 3).

[0052] According to the above-described embodiment, the identity verification system of the present invention can be summarized as follows.

[0053] A part (for example, most) of store operations (typically counter operations) will be replaced by self-operation performed by customers themselves and information exchange using two-dimensional codes, instead of the traditional work performed by store staff, resulting in a reduction in store operations and an increase in efficiency. That is, in identity verification using identification documents, in addition to obtaining information from contactless ICs, determining authenticity using images of the document's face, and having customers verify their identity using face recognition technology using images of their appearance, the process including transactions within each store can be handed over using two-dimensional codes or specific numbers displayed on mobile devices, making it possible to increase the efficiency of counter operations that handle a variety of transactions.

[0054] For example, when a customer has a reception terminal 110 and has made an advance reservation, the customer has registered the transaction details, personal information permission, and at least a portion of the personal information in advance with the server 160. The customer's personal identification number (No.) and a two-dimensional code containing information representing that number are sent from the server 160 to the customer's mobile terminal 180. The reception terminal 110 reads the two-dimensional code displayed on the mobile terminal 180 (or accepts manual input of the No. from the customer). As a result, the store recognizes the visit of the customer identified from the No., and then performs process X. Process X includes, for example, the following: The mobile terminal 180 displays the two-dimensional code and the customer identification number (No.). Specifically, for example, the customer waits for a call for identity verification as necessary, and is called through the customer's mobile terminal 180 (or by other means such as an in-store announcement). In response to the call, the mobile terminal 180 displays the two-dimensional code and the number. The personal identification device 200 reads the two-dimensional code displayed on the mobile terminal 180 (or accepts the customer's manual input of the personal identification number (No.)) and acquires a photographed image (obtains a photographed image by photographing at least one of the personal identification document and the customer's face). The personal identification device 200 may also acquire IC information (read information from the IC of the personal identification document). Information necessary for identity verification is transferred to the transaction counter terminal 120. "Information necessary for identity verification" may include an identity number (No.), acquired information, and reception information. "Acquired information" is information including, for example, the identity verification document or the photographed image of the customer's face itself, and information obtained by converting the photographed image of the identity verification document into text using the OCR (Optical Character Recognition / Reader) function of the identity verification device 200 or identity verification control unit 190. "Reception information" is information including, for example, transaction details, personal information permission, and at least a portion of the personal information already registered in the server 160. The information required for identity verification is displayed on the transaction counter terminal 120, and the counter clerk makes a comprehensive judgment (for example, whether or not the acquired information matches the received information).

[0055] After the identity verification is completed, the identity verification control unit 190 not only notifies other devices in the identity verification system that the identity verification has been completed, but also transfers the necessary information for identity verification (such as face authentication information) to other devices in the identity verification system, thereby making it possible to confirm that the person who has come to the transfer destination (such as the automated transaction device 130) is the person in question, and thus preventing impersonation. Also, in places where multiple transactions and procedures are performed, such as government offices, once identity verification is completed, the results and the necessary information for identity verification can be shared to achieve so-called "horizontal cooperation," so that the transactions and procedures desired by the customer can be provided without having to re-conduct identity verification for each transaction and procedure, which is expected to reduce the burden on the customer and the counter.

[0056] Also, for example, when there is a reception terminal 110 but no prior reservation, the personal identification number (number) represented by the two-dimensional code displayed on reception terminal 110 and read by mobile terminal 180 (or the number displayed on reception terminal 110 and manually entered into mobile terminal 180) is transmitted to server 160, and the transaction details, personal information permission, and at least a part of the personal information are entered into server 160 via mobile terminal 180, and as a result, the number is linked to the reception information (transaction details, personal information permission, and at least a part of the personal information) and registered in server 160. After that, the above-mentioned process X is performed.

[0057] Also, for example, if there is no reception terminal 110, the mobile terminal 180 is lent to the customer at the store 100. In this case, the number assigned to the mobile terminal 180 corresponds to the number that identifies the customer. This mobile terminal 180 accepts input of transaction details, personal information permission, and personal information from the customer, and transmits reception information including these and the number of this mobile terminal 180 to the server 160. As a result, the number is linked to the reception information and registered in the server 160. Then, the above-mentioned process X is performed. After process X, the personal information, etc. input to this mobile terminal 180 is erased when the customer leaves the store.

[0058] Although one embodiment of the present invention has been described above, this is merely an example for explaining the present invention, and the scope of the present invention is not limited to this embodiment. The present invention can be implemented in various other forms. For example, USB, Bluetooth, and WiFi are each examples of communication methods, and other types of communication methods may be used instead of at least one of these. [Explanation of symbols]

[0059] 100 ···Stores 110 Reception terminal 120: Trading window terminal 130 Automatic transaction device 140 Router 160 ···Server 170 ···Network 180 ···Mobile Devices 190 Personal identification control unit 200 Personal Identification Device

Claims

1. An identity verification system for carrying out a series of transaction procedures including identity verification, an input information management unit that manages reception information including personal information of the user and transaction information related to a transaction desired by the user, by linking the reception information to identification information based on information input by the user, and transmits first code data including the identification information to a mobile terminal operable by the user who input the information; a reception terminal which, as a reception procedure based on the user's visit to a store, reads the first code data from a mobile terminal which the user can operate if the user has already input the information, and, if the user has not yet input the information, provides second code data which is code data for connecting to a site where the information is input and includes newly assigned identification information corresponding to the user, and prompts the user to input the information by reading the second code data with the mobile terminal; an identity verification device for verifying the identity of the customer who has completed the reception procedure; a transaction counter terminal capable of executing a predetermined transaction through operation by a teller; an automated transaction device capable of executing a specific transaction by operation of the customer; an identity verification control unit that is communicably connected to the reception terminal, the identity verification device, the transaction counter terminal, the automated transaction device, and the input information management unit and controls the identity verification device; Equipped with The identity verification device includes: reading the first code data from the mobile terminal of the customer, reading first confirmation information and second confirmation information from an identity verification document provided by the customer, photographing the customer to obtain a facial image; determining the authenticity of the identification document by analyzing the first verification information, and verifying that the owner of the identification document is the customer by verifying that the second verification information matches the facial image using a facial recognition algorithm; When the identity verification by the identity verification device is successful, the identity verification control unit transfers the reception information corresponding to the first code data read from the mobile terminal of the customer and at least a part of the information used in the identity verification by the identity verification device to at least one of the transaction counter terminal or the automated transaction device, depending on the content of the transaction indicated by the transaction information included in the reception information. The present invention relates to an identity verification system.

2. The identification information may be a unique identification number or a two-dimensional code showing information including the identification number.

2. The personal identification system according to claim 1.

3. The identity verification control unit transfers information required for identity verification together with a result of identity verification in the identity verification device to a configuration other than the identity verification device in the identity verification system.

2. The personal identification system according to claim 1.

4. The identity verification device further includes a display and operation unit on which the user can perform identity verification operations.

2. The personal identification system according to claim 1.

5. The personal identification device performs biometric authentication by authenticating a plurality of patterns of the face image of the customer using a biometric authentication algorithm in addition to determining the authenticity of the personal identification document and confirming that the owner of the document is the customer.

2. The personal identification system according to claim 1.

6. The mobile terminal is a mobile terminal owned by the user or a mobile terminal provided at a counter, and is a smartphone, a tablet terminal, or a mobile phone.

2. The personal identification system according to claim 1.

7. The identity verification control unit is built into the identity verification device.

2. The personal identification system according to claim 1.

8. The identity verification device is built into the automated transaction device.

2. The personal identification system according to claim 1.

Images