Identity verification terminal, program, identity verification method, and identity verification system

Abstract

To provide an identity verification terminal capable of performing reliable identity verification.SOLUTION: The identity verification terminal includes: a camera for picking up a face image of a user; and a reader that acquires a registered image which is a face image. The identity verification terminal also includes a processor that is configured to perform the following steps: acquiring the captured image of user face taken by the camera; comparing the registered image with the captured image; completing the user identity when the face recognition between the face of the person in the registered image and the user face is successful; and registering the registered image or the captured image as an image for identity verification.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present disclosure relates to an identity verification terminal, a program, an identity verification method, and an identity verification system. [Background technology]

[0002] Non-Patent Document 1 describes a method of verifying age using a public identification card such as a driver's license or a My Number card as an age verification method that utilizes digital technology. The age verification method that utilizes digital technology discloses a method in which the public identification card itself is inserted into some device and the age is verified based on the date of birth, and a method in which the identity is verified in advance by confirming the identity of the person in person or by mail, etc., and then the identity is verified using a mobile phone, biometric authentication, etc. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Japan Franchise Association, "Guidelines for verifying age of alcohol and tobacco products using digital technology," [online], accessed February 24, 2023, Internet <URL:https: / / www.digital.go.jp / assets / contents / node / basic_page / field_ref_resources / 0196dc94-0101-4063-8d6e-a8af88589d2c / 5db45cc1 / 20221130_meeting_administrative_research_working_group_outline_02.pdf> Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, convenience stores and other stores have been introducing unmanned registers (hereinafter referred to as "self-registers") that allow customers to process their purchases themselves as a measure to reduce labor through technology. However, there are challenges in terms of reducing labor for products that require age verification, such as alcohol and tobacco (hereinafter referred to as "licensed products"), because employees or other personnel must verify the age of customers in person.

[0005] Non-Patent Document 1 discloses that an official identification card is read by reading the card face information, an Integrated Circuit (hereinafter referred to as "IC") reader, and a Personal Identification Number (hereinafter referred to as "PIN code") code is input to confirm the date of birth and age. By using an official identification card to verify the age in advance, it is considered possible to purchase licensed products at a self-checkout without the involvement of an employee. However, there is a risk that a minor may pose as an adult and purchase licensed products by verifying the age using another person's official identification card. Note that "adult" here refers to an age at which licensed products can be purchased.

[0006] The present disclosure has been devised in view of the above-mentioned conventional situation, and aims to perform highly reliable identity verification. [Means for solving the problem]

[0007] The present disclosure provides an identity verification terminal comprising a camera that photographs a user's face, a reader that acquires a registration image, which is an image of the face, from an identity verification document, and a processor that acquires the image of the user's face photographed by the camera, compares the registration image with the photographed image, and completes identity verification of the user if facial authentication between the face of a person appearing in the registration image and the face of the user is successful, and registers the registration image or the photographed image as an identity verification image.

[0008] The present disclosure also provides a program that causes a computer to execute the following processes: a process of having a camera capture a photograph of a user's face; a process of acquiring a registration image from an identification document; a process of acquiring a photographed image of the user's face; a process of matching the registration image with the photographed image; and a process of completing identity verification of the user if facial authentication between the face of a person appearing in the registration image and the face of the user is successful, and registering the registration image or the photographed image as an image for identity verification.

[0009] The present disclosure also provides a method for identity verification, which includes photographing a user's face, obtaining a registration image from an identification document, obtaining a photographed image of the user's face, comparing the registration image with the photographed image, and completing identity verification of the user if facial authentication between the face of a person appearing in the registration image and the face of the user is successful, and registering the registration image or the photographed image as an identity verification image.

[0010] The present disclosure also provides an identity verification system comprising: an identity verification terminal comprising a first camera that photographs a user's face, a reader that acquires a registration image from an identity verification document, and a processor that acquires a first photographed image of the user's face photographed by the first camera, compares the registration image with the first photographed image, and completes identity verification of the user if facial authentication between the face of the person in the registration image and the face of the user is successful, and registers the registration image or the first photographed image as an identity verification image; a second camera that photographs the user's face, and a processor that acquires the identity verification image from the identity verification terminal, compares the second photographed image of the user's face photographed by the second camera with the identity verification image, and permits the purchase of a licensed item if facial authentication between the face in the second photographed image and the face in the identity verification image is successful; and a self-checkout register.

[0011] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0012] According to the present disclosure, highly reliable identity verification can be performed. [Brief description of the drawings]

[0013] [Figure 1] A flowchart showing an example of a conventional method for purchasing licensed products. [Diagram 2] A system configuration diagram of an identity verification system according to the present embodiment. [Diagram 3] A diagram showing an application running on a terminal device. [Figure 4] A flowchart showing an example of a member registration process in a member application. [Diagram 5] A flowchart showing an example of a process for identity verification using a My Number card [Figure 6] Flowchart of image registration process for identity verification using My Number card [Figure 7] A flowchart showing an example of a process for identity verification using a driver's license. [Figure 8] Flowchart of image registration process for personal identification using driver's license [Figure 9] A diagram showing an example of a screen showing items that have been registered in a member app [Figure 10] Flowchart of the self-checkout licensed product purchase authorization process [Figure 11A] A diagram to explain the use case of using the hotel member app [Figure 11B] A diagram to explain the use case of using a rental car member app [Figure 11C] A diagram to explain the use case of using a gas station member app [Figure 12] A diagram to explain the use case of using the member app of government services [Figure 13] A diagram explaining the use case of applying for financial services using an identity verification app [Figure 14]A diagram to explain the use case when registering a credit card payment app [Figure 15] A diagram to explain the use cases when using a credit card payment app [Figure 16] Block diagram showing a modified example of the personal identification system [Figure 17] A flowchart showing an example of a process for registering an image for personal identification in a personal identification server and reusing the image. [Figure 18] A flowchart showing an example of the registered process shown in FIG. 17. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, with reference to the drawings as appropriate, detailed explanations will be given of the embodiments specifically disclosing the identity verification terminal, program, identity verification method, and identity verification system according to the present disclosure. However, more detailed explanations than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the attached drawings and the following explanation are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0015] An example of a conventional method for purchasing licensed items will be described with reference to Fig. 1. Fig. 1 is a flowchart showing an example of a conventional method for purchasing licensed items.

[0016] In a store such as a convenience store or supermarket, a company that manages the store may require the user (e.g., a person shopping at the store) to purchase licensed products at a self-checkout register in advance. Hereinafter, an application that is provided by a company and that registers users as members will be referred to as a "member app." Note that the store is not limited to being managed by a company, but may also be a corporation, a public organization, an association, or an individual. There is a method in the member app that allows a user to purchase licensed products at a self-checkout register by verifying their age in advance using an identification card. An example of a method for purchasing licensed products using a member app will be described below.

[0017] A user registers as a member by inputting personal information such as name and date of birth into the member app. The user follows the instructions of the member app to verify his / her age using an identification card (step St100). The identification card is, for example, a driver's license or a My Number card. For example, the member app verifies the age by reading the information on the IC chip of an identification card such as a driver's license or a My Number card with a terminal device such as a smartphone owned by the user. The identification card can be read as an identity verification document.

[0018] A user enters a store (step St101), picks up products including licensed products to be purchased (step St102), and carries the products to a self-checkout register. The user operates the self-checkout register and selects whether or not to purchase a bag to put the products in (hereinafter, referred to as a "plastic bag") (step St103). The user has the self-checkout register read the licensed products (step St104).

[0019] The user causes the self-checkout to read the registration information of the member application (step St105). For example, the user causes the self-checkout to read a barcode including information indicating that the user has passed age verification and is an adult as the registration information of the member application.

[0020] The self-checkout register completes age verification based on the registration information read in the process of step St105 (step St106) and permits the purchase of licensed items.

[0021] The user makes payment at the self-checkout (step St107) and leaves the store (step St108).

[0022] This allows the user to purchase licensed products at a self-checkout using the registration information of the member app that he or she registered in advance.

[0023] However, when a user registers as a member in the member app in the processing of step St100 and uses an identification card to verify his / her age, there is a problem in that even if the user is a minor, the user may be able to falsify his / her age by using the identification card of another adult.

[0024] In addition, when the self-checkout register uses the registration information of the member app to verify the user's age in step St106 and allows the user to purchase licensed products, the user may use a terminal device that contains a member app for another adult whose age has already been verified, causing the self-checkout register to read the registration information of another person. This creates a problem in that the user may be able to purchase licensed products at the self-checkout register even if he or she is a minor.

[0025] In addition, when the user processes the payment in step St107, the self-checkout register must read each of the points information (e.g., a points card), the payment code (e.g., a Quick Response code (hereinafter referred to as "QR code (registered trademark)")), and / or the credit card, etc., which is cumbersome for the user, which is an issue.

[0026] Although an example of a method for purchasing licensed products at a store such as a convenience store or a supermarket has been described, the method is not limited to the above-mentioned store, and unmanned sales of licensed products at tourist spots, theme parks, concert venues, etc. may also be assumed. For example, a user can complete age verification in advance using a member app provided by the tourist spot, theme park, or concert venue, and use the registration information of the member app to purchase licensed products at stores and vending machines located in the tourist spot, theme park, or concert venue without the assistance of a store clerk. For convenience of explanation, the following description will be given using a use case at a store such as a convenience store or a supermarket.

[0027] Below, we will explain an identity verification system 1 (see FIG. 2) that has been devised in consideration of the above-mentioned circumstances and is capable of performing highly reliable identity verification. In the identity verification system 1, a member app is linked to an application (hereinafter referred to as an "identity verification application") that verifies in advance whether a user registered in the member app is the user himself / herself (hereinafter referred to as "identity verification"), thereby performing identity verification in advance. Completion of identity verification indicates that the name and date of birth information registered in the member app are highly reliable information, and is synonymous with the completion of the user's age verification. Note that the member app and identity verification application may be configured as a single application.

[0028] Next, a system configuration diagram of the personal identification system 1 according to the present embodiment will be described with reference to Fig. 2. Fig. 2 is a system configuration diagram of the personal identification system 1 according to the present embodiment.

[0029] The identity verification system 1 includes a terminal device 10, an identity verification authentication business operator server 20, an identity verification server 30, a member company server 40, a payment company server 50, a point company server 60, and a self-checkout register 70. The identity verification authentication business operator server 20 may be omitted from the identity verification system 1. Furthermore, the identity verification authentication business operator server 20 may be read as an administrative server.

[0030] The terminal device 10 is a device that performs identity verification of a user in advance. The terminal device 10 is, for example, a smartphone or a tablet. The terminal device 10 includes a processor 11, a reader 12, a camera 13, a communication I / F 14, a display 15, and a memory 16.

[0031] The processor 11 is, for example, a central processing unit (hereinafter referred to as "CPU"), a digital signal processor (hereinafter referred to as "DSP"), a graphical processing unit (hereinafter referred to as "GPU"), or a field programmable gate array (hereinafter referred to as "FPGA"). The processor 11 functions as a controller that manages the overall operation of the terminal device 10. The processor 11 performs control processing for managing the operation of each part of the terminal device 10, input / output processing of data between each part of the terminal device 10, calculation processing of data, and storage processing of data. The processor 11 operates according to a program stored in the memory 16. The processor 11 uses the memory 16 during operation, and temporarily stores data generated or acquired by the processor 11 in the memory 16. The processor 11 executes programs of a member application and an identity verification application. The identity verification application will be described with reference to FIG. 4.

[0032] The reader 12 is a device that acquires information contained in an IC chip of an identification card such as a driver's license or a My Number card. The reader 12 is, for example, a communication I / F, and acquires information in the IC chip using a short-range wireless communication technology such as Near Field Communication (hereinafter referred to as "NFC"). I / F represents an interface. The reader 12 may be omitted from the terminal device 10 and may be an external device such as an IC card reader. The reader 12 outputs personal information acquired from the identification card to the processor 11.

[0033] The camera 13 is a device that photographs the identification card and the face of the user. The camera 13 is configured to have at least a lens (not shown) and an image sensor (not shown) as optical elements. The lens forms an optical image of the object on the light receiving surface (in other words, the photographing surface) of the image sensor by receiving light reflected by an object within the angle of view of the area photographed by the camera 13. The image sensor is a solid-state photographing element such as a Charged Coupled Device (hereinafter referred to as "CCD") or a Complementary Metal Oxide Semiconductor (hereinafter referred to as "CMOS"). The image sensor converts the optical image formed on the photographing surface through the lens into an electrical signal every predetermined time (for example, 1 / 30 (second)). For example, when the predetermined time is 1 / 30 (second), the frame rate of the camera 13 is 30 fps. The camera 13 may also generate image data (video data) by performing a predetermined signal processing on the electrical signal every predetermined time. The image data is a still image, and the video data is a video. Camera 13 outputs image data (video data) to processor 11. Hereinafter, image data and video data will be referred to as captured images.

[0034] The communication I / F 14 is an interface circuit that performs wireless or wired communication between the terminal device 10 and the identity authentication business operator server 20, between the terminal device 10 and the identity authentication server 30, between the terminal device 10 and the member company server 40, between the terminal device 10 and the payment company server 50, between the terminal device 10 and the point company server 60, and between the terminal device 10 and the self-register 70. Communications between the terminal device 10 and the identity authentication business operator server 20, between the terminal device 10 and the identity authentication server 30, between the terminal device 10 and the member company server 40, between the terminal device 10 and the payment company server 50, between the terminal device 10 and the point company server 60, and between the terminal device 10 and the self-register 70 may be performed via a network. The communication method by the communication I / F 14 is, for example, a Wide Area Network (hereinafter referred to as "WAN"), a Local Area Network (hereinafter referred to as "LAN"), Long Term Evolution (hereinafter referred to as "LTE"), mobile communication such as 4G and 5G, power line communication, short-range wireless communication (e.g. Bluetooth (registered trademark) communication), or communication for mobile phones. Note that when the reader 12 is a communication I / F, the reader 12 and the communication I / F 14 may be configured as one communication I / F.

[0035] The display 15 is a display device that displays information such as registration information of member applications, input screens for member applications and personal identification applications, and verification results of the personal identification application. The display 15 also accepts input operations from the user. The display 15 is, for example, a touch panel display.

[0036] The memory 16 is configured using, for example, a Random Access Memory (hereinafter referred to as "RAM") and a Read Only Memory (hereinafter referred to as "ROM"), and temporarily stores programs necessary for the operation of the terminal device 10, programs for the member application and the personal identification application, and further data generated during operation. The RAM is, for example, a work memory used during the operation of the terminal device 10. The ROM stores and holds, for example, a program for controlling the terminal device 10 in advance.

[0037] "Identity verification authentication business operators" operate services that use the electronic certificate of the My Number card to verify identity, etc. The identity verification authentication business operator server 20 is a server device that provides public personal authentication services. The identity verification authentication business operator server 20 accepts the electronic certificate of the My Number card in response to a request for a service that requires identity verification from the identity verification server 30, and checks the validity of the electronic certificate. If the identity verification authentication business operator server 20 is able to confirm the validity of the electronic certificate, it returns the result to the identity verification server 30. This completes identity verification when using the service.

[0038] The identity verification server 30 is a server device of a business that provides an identity verification app that verifies the identity of a user. The identity verification server 30 temporarily stores information on the user's identification card in a memory (not shown). The identity verification server 30 also stores personal information such as the user's name, age, and identity verification image acquired by the identity verification app in the memory. The identity verification image will be described later. Note that when the member app and the identity verification app are configured as a single application, the identity verification server 30 may be omitted, and the above-mentioned personal information of the user may be stored in the memory (not shown) of the member company server 40.

[0039] The member company server 40 is a server device of a company that manages the store and provides a member app that registers users who use the store as members. The member company server 40 stores information such as personal information entered and registered by users in the member app. In addition, the member company server 40 may grant company-specific points when a user purchases an item at a store and link the points to the registration information of the member app. The member company server 40 and the terminal device 10, the member company server 40 and the payment company server 50, the member company server 40 and the point company server 60, and the member company server 40 and the self-checkout 70 are connected to be able to communicate with each other.

[0040] The payment company server 50 is a server device of a business that provides payment services. The payment company server 50 provides payment services such as credit cards, QR codes (registered trademark), or electronic money. The payment company server 50 permits payment information to be linked to registration information of a member app. When a product is purchased using registration information of a member app linked with the payment information, the payment company server 50 communicates with the member company server 40 and performs payment processing. The payment company server 50 and the terminal device 10, the payment company server 50 and the member company server 40, and the payment company server 50 and the self-checkout 70 are connected to be able to communicate with each other.

[0041] The point company server 60 is, for example, a server device of an external point-granting company that is affiliated with the member company server 40. The point company server 60 allows its own company's points to be linked to the registration information of the member app. When a product purchase is completed using the registration information of the member app linked to the point information, the point company server 60 communicates with the member company server 40 and grants points. The point company server 60 and the terminal device 10, the point company server 60 and the member company server 40, and the point company server 60 and the self-checkout 70 are connected so as to be able to communicate with each other.

[0042] The self-checkout register 70 is an unmanned register installed in a store. A user shopping at the store can operate the self-checkout register 70 and carry out the purchase procedure for the product by himself / herself. The self-checkout register 70 has a processor 71, a reader 72, a camera 73, a communication I / F 74, a display 75, and a memory 76.

[0043] The processor 71 is, for example, a CPU, a DSP, a GPU, or an FPGA. The processor 71 functions as a controller that manages the overall operation of the self-checkout register 70. The processor 71 performs control processing for managing the operation of each part of the self-checkout register 70, input / output processing of data between each part of the self-checkout register 70, calculation processing of data, and data storage processing. The processor 71 operates according to a program stored in the memory 76. The processor 71 uses the memory 76 during operation, and temporarily stores data generated or acquired by the processor 71 in the memory 76.

[0044] The reader 72 is a device that acquires information contained in an IC chip of an identification card such as a driver's license or a My Number card. The reader 72 is, for example, an IC card reader. The reader 72 is also a communication I / F and may acquire information in the IC chip using a short-range wireless communication technology such as NFC. The reader 72 outputs personal information acquired from the identification card to the processor 71. The reader 72 also reads registration information (for example, a barcode) of a member app displayed on the display 15 of the terminal device 10, and outputs the registration information to the processor 71.

[0045] The camera 73 is a device that photographs the face of a user who purchases a licensed product at the self-checkout register 70. The camera 73 is configured to have at least a lens (not shown) and an image sensor (not shown) as optical elements. The lens receives light reflected by an object within the angle of view of the area photographed by the camera 73 and forms an optical image of the object on the light receiving surface of the image sensor (in other words, the photographing surface). The image sensor is, for example, a solid-state photographing element such as a CCD or a CMOS. The image sensor converts the optical image formed on the photographing surface through the lens into an electrical signal every predetermined time (for example, 1 / 30 (second)). For example, when the predetermined time is 1 / 30 (second), the frame rate of the camera 73 is 30 fps. The camera 73 may also generate a photographed image by performing a predetermined signal processing on the electrical signal every predetermined time described above. The camera 73 outputs the photographed image to the processor 71.

[0046] The communication I / F 74 is an interface circuit that performs wireless or wired communication between the terminal device 10 and the self-register 70, the identity verification server 30 and the self-register 70, the member company server 40 and the self-register 70, the settlement company server 50 and the self-register 70, and the point company server 60 and the self-register 70. The communication between the terminal device 10 and the self-register 70, the identity verification server 30 and the self-register 70, the member company server 40 and the self-register 70, the settlement company server 50 and the self-register 70, and the point company server 60 and the self-register 70 may be via a network. The communication method by the communication I / F 74 is, for example, mobile communication such as WAN, LAN, LTE, 4G, 5G, power line communication, short-range wireless communication (e.g. Bluetooth (registered trademark) communication), or communication for mobile phones. Note that when the reader 72 is a communication I / F, the reader 72 and the communication I / F 74 may be configured as one communication I / F. The communication I / F 74 receives member application registration information (personal information such as an image for personal identification, name, and age) from the communication I / F 14 using a short-range wireless communication technology such as NFC.

[0047] The display 75 is a display that displays a screen regarding product purchases, a guide for age verification, the results of age verification, and the like. The display 75 is a touch panel display or the like, and may receive input from a user. When the display 75 receives input from a user, the input may be received using a mouse, a touch pen, a keyboard, or the like. The display 75 may also be a non-contact type aerial display in which a display is displayed in the air. In this case, the display 75 receives input from a user using an infrared sensor or the like.

[0048] The memory 76 is configured using, for example, RAM and ROM, and temporarily stores programs necessary for the operation of the self-register 70, personal information of the user received from the terminal device 10, and data generated during operation. The RAM is, for example, a work memory used during the operation of the self-register 70. The ROM, for example, stores and holds in advance programs for controlling the self-register 70.

[0049] Next, applications that run on the terminal device will be described with reference to Fig. 3. Fig. 3 is a diagram showing applications that run on the terminal device.

[0050] The terminal device 10 has a member application MA and an individual verification application HA. The member application MA and the individual verification application HA are stored in the memory 16.

[0051] The member application MA is an application provided by the member company server 40. The member application MA is installed in the terminal device 10 based on a user operation.

[0052] The personal identification application HA is an application provided by the personal identification server 30. The personal identification application HA is installed in the terminal device 10 based on a user operation.

[0053] The member application MA and the identity verification application HA operate in cooperation with the processor 11. The member application MA and the identity verification application HA may be configured as one application. When the member application MA and the identity verification application HA are configured as one application, the identity verification server 30 or the member company server 40 provides the application.

[0054] Next, an example of member registration processing in the member application MA will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of member registration processing in the member application MA.

[0055] The processor 11 installs the member application MA in response to an input operation of the user to install the member application MA in the terminal device 10 (step St200).

[0056] The member application MA starts the process of registering a user as a new member (step St201).

[0057] The member application MA displays a screen on the display 15 requesting the user to input an email address. The member application MA receives information about the email address through an input operation by the user (step St202). The member application MA transmits the email address received in the processing of step St202 to the member company server 40. The member company server 40 transmits an authentication code to the received email address.

[0058] The user inputs the received authentication code into the member application MA, which receives the authentication code through the user's input operation (step St203).

[0059] The member application MA displays a screen requesting the user to enter a password and member information on the display 15. The member application MA receives the password and member information through the user's input operation (step St204). The member information is, for example, information such as name, date of birth, sex, or address.

[0060] The member application MA displays a screen requesting the user to agree to the membership terms and conditions on the display 15. The member application MA receives information indicating that the user has agreed to the membership terms and conditions through an input operation by the user, and completes the user's membership registration (step St205).

[0061] The member registration method of the member application shown in Fig. 3 is merely an example, and is not limited to the example shown in Fig. 3. For example, the member application MA may request a phone number from the user instead of an email address in the process of step St202, or may register the user as a member in cooperation with another application (for example, a communication application, etc.).

[0062] Next, an example of identity verification processing using a My Number card will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of identity verification processing using a My Number card. The processing of the flowchart in Fig. 5 is executed by an identity verification application HA.

[0063] The identity verification application HA judges whether or not to use a My Number card (step St300). For example, the identity verification application HA displays a screen on the display 15 asking the user whether or not to use a My Number card as an identification card for identity verification. The identity verification application HA performs the process of step St300 based on an input operation from the user. In addition, the type of identification card used for identity verification of the user may be predetermined by the identity verification server 30, in which case the process of step St300 is omitted.

[0064] When it is determined based on the user's input operation that the My Number card is not to be used (step St300, NO), the personal identification application HA executes the process shown in FIG.

[0065] When the personal identification application HA determines that the My Number card is to be used based on the user's input operation (step St300, YES), the personal identification application HA displays instructions to the user for reading information on the IC chip of the My Number card on the display 15. For example, the personal identification application HA displays on the display 15 instructions to the user to hold the terminal device 10 over the My Number card.

[0066] When the user sets the My Number card in the terminal device 10 in a state in which the information on the IC chip can be read, the personal identification application HA reads the information on the IC chip of the My Number card (step St301). The personal identification application HA acquires personal information such as the user's name and date of birth as the information on the IC chip.

[0067] The identity verification application HA starts an authentication process to verify the validity of the electronic certificate of the My Number card of the user (for example, displays a screen on the display 15 requesting the user to enter a password), and transmits the authentication information of the My Number card to the identity verification authentication business operator server 20 (step St302).

[0068] The identity verification application HA receives the verification result of the validity of the electronic certificate from the identity verification authentication business operator server 20 (step St303). If the identity verification application HA can verify the validity of the electronic certificate, it determines that the logged-in user is the correct user.

[0069] The identity verification application HA determines whether or not to register payment information (step St304). The identity verification application HA displays a screen asking the user whether or not to register payment information on the display 15. When the identity verification application HA determines that the payment information is to be registered based on the user's input operation (step St304, YES), it acquires the payment information based on the user's input operation (step St305).

[0070] The identity verification application HA transmits the payment information acquired in the process of step St305 and a request for permission to link the payment information with the registration information of the member application MA to the payment company server 50. The payment company server 50 checks whether the received payment information is correct against information stored in a memory (not shown) in the payment company server 50. The payment company server 50 receives, for example, a credit card number, expiration date, and security code as payment information, and checks whether there is an error by checking the information stored in the payment company server 50. If the payment company server 50 determines that the received payment information is correct, it transmits information permitting linking (i.e., linking) with the registration information of the member application MA to the identity verification application HA. The identity verification application HA links the payment information with the registration information of the member application MA (step St306). Then, the processor 11 advances the process to step St307.

[0071] When the personal identification application HA determines, based on the user's input operation, that the payment information is not to be registered (step St304, NO), the personal identification application HA determines whether or not to register point information (step St307).

[0072] The personal identification application HA displays a screen on the display 15 to ask the user whether or not to register point information. When the personal identification application HA determines that the point information is to be registered based on the user's input operation (step St307, YES), it acquires the point information based on the user's input operation (step St308). The personal identification application HA acquires the point information, for example, by receiving input information of a point card number from the user or by cooperating with an application provided by the point company server 60.

[0073] The personal identification application HA transmits to the point company server 60 a request for permission to link the point information acquired in the processing of step St308 with the registration information of the member application MA. The point company server 60 verifies whether the received point information is correct, and if it is correct, transmits information permitting linking (i.e., linking) with the registration information of the member application MA to the personal identification application HA. The personal identification application HA links the point information with the registration information of the member application MA (step St309). The personal identification application HA may link the point information with the registration information of the member application MA by linking with an application provided by the point company server 60. After processing of step St309, the personal identification application HA executes processing of step St310.

[0074] When the identity verification application HA determines not to register point information based on the user's input operation (step St307, NO), it executes a process for registering an image of the user's face using the My Number card (hereinafter referred to as "identification image registration process") (step St310). The identity verification image registration process using the My Number card will be described in detail in FIG. 6. Hereinafter, the face image to be registered in the member application MA determined in the identity verification image registration process will be referred to as the identity verification image. The identity verification image may be any of the face image on the face of the My Number card, the face image in the IC chip of the My Number card, and the face image of the user.

[0075] After the process of step St310, the identity confirmation application HA executes a process when identity confirmation is completed (hereinafter, referred to as "identity confirmation completion process") (step St311). When the identity confirmation application HA is able to register the identity confirmation image in the process of step St310, the identity confirmation application HA associates the registration information of the member application MA with the identity confirmation image and registers it in the identity confirmation server 30 as identity confirmation completion process. That is, the identity confirmation application HA associates the personal information such as the name and date of birth registered in advance by the user in the member application MA with the identity confirmation image and registers it in the identity confirmation server 30. However, the personal information registered in advance by the user may be associated with the identity confirmation image and registered in the identity confirmation application HA or the member application MA. In addition, the identity confirmation application HA may display a screen indicating that identity confirmation is completed on the display 15. When the identity confirmation application HA is unable to register the identity confirmation image in the process of step St310, the identity confirmation application HA may display a screen indicating that identity confirmation is incomplete on the display 15 as identity confirmation completion process. The identity verification application HA may notify the user that identity verification has been completed or not by outputting a sound from a speaker (not shown).

[0076] The identity verification application HA may link the personal information acquired from the My Number card with the identity verification image. This allows the identity verification application HA to generate registration information in which the personal information and the identity verification image are linked, without the user having to input the personal information in advance.

[0077] Furthermore, as a process for completing identity verification, the identity verification application HA creates a code that holds information linked to the payment information, point information, and identity verification image information. The code is, for example, a one-dimensional code such as a barcode or a two-dimensional code such as a QR code (registered trademark). The code may be a multi-dimensional code having two or more dimensions. The identity verification application HA registers the created code in the member application MA. The member application MA further links the registration information to the code of the identity verification application HA.

[0078] The code may also be created by the member app MA. In this case, the identity verification app HA may obtain a code linked to the registration information of the member app MA from the member app MA, and link the code with payment information, point information, and identity verification image information. The member app MA may obtain payment information, point information, and identity verification image from the identity verification app, and create a code linked to the payment information, point information, identity verification image, and registration information.

[0079] The order of the process in step St304, the process in step St307, and the process in step St310 is not limited to the order shown in FIG. 4, and may be any order.

[0080] The identity verification application HA may also use personal information acquired from the My Number card to determine whether the name and date of birth registered in the member application MA match. In other words, the identity verification application HA acquires name and date of birth information from the My Number card, determines whether the name and date of birth information entered by the user in the member application MA match the information on the My Number card, and if they match, registers the identity verification image linked to the information in the member application MA.

[0081] Next, a description will be given of a process for registering an image for personal identification using a My Number card with reference to Fig. 6. Fig. 6 is a flowchart of a process for registering an image for personal identification using a My Number card. Each process in the flowchart of Fig. 6 is executed by a personal identification application HA.

[0082] The identity verification application HA judges whether or not to use a face image stored in the IC chip of the My Number card (hereinafter, the face image stored in the IC chip of the My Number card and the driver's license will be referred to as a "registered image") as an identity verification image to be registered in the member application MA (step St400). The identity verification application HA displays on the display 15 a screen that allows the user to select whether or not to use the registered image of the My Number card as an identity verification image to be registered in the member application MA. When the identity verification application HA judges based on the user's selection operation that the registered image of the My Number card will be used as an identity verification image to be registered in the member application MA (step St400, YES), it displays on the display 15 a screen that requests the user to input the verification number B of the My Number card. The verification number B is a 14-digit number consisting of a 6-digit date of birth, a 4-digit expiration date, and a 4-digit security code printed on the face of the My Number card. The identity verification application HA receives the verification number B input from the user (step St401). If the face of the My Number card can be read by OCR, the identity verification application HA may automatically obtain the verification number B from the result of OCR reading of the face of the My Number card in step St401.

[0083] The personal identification application HA acquires a registration image from the IC chip of the My Number card using the verification number B acquired in the process of step St401 as a key (step St402).

[0084] The identity verification application HA causes the camera 13 to capture a picture of the user's face (step St403). By executing the process of step St403 and performing face authentication, it is possible to verify that the operator of the identity verification application HA is the actual person. Note that, if the user is permitted to use the image of the My Number card as an identity verification image simply by possessing the My Number card, the process of step St403 may be omitted. In this case, the processes of steps St403 to St409 are omitted, and the identity verification application HA executes the process of step St410 after the process of step St402.

[0085] The personal identification application HA compares the registered image acquired from the My Number card with the photographed image of the user's face acquired in the process of step St403 using a known technique such as face matching technique (step St404).

[0086] The identity verification application HA compares the registered image with the captured image to determine whether or not face authentication between the face of the person appearing in the registered image and the face of the person appearing in the captured image is successful (step St405).

[0087] When it is determined that the face authentication has failed (step St405, NO), the personal identification application HA displays a result screen indicating that the face authentication has failed on the display 15 (step St406).

[0088] The identity verification application HA determines whether or not face authentication between the registered image and the captured image has been performed less than n times (step St407), where n is an integer equal to or greater than 1.

[0089] When the personal identification application HA determines that face authentication between the registered image and the captured image has been performed less than n times (step St407, NO), it executes the process of step St403 again.

[0090] When the identity verification application HA determines that the face authentication between the registered image and the captured image has not been performed less than n times, that is, that it has been performed more than n times (step St407, YES), the identity verification application HA displays a screen on the display 15 to prompt the user to end the procedure of using the image of the My Number card as the identity verification image (step St408). For example, the identity verification application HA displays a screen presenting an alternative method on the display 15 to prompt the user to end the procedure. The alternative method may be a procedure by mail or a prompt to inquire with the administrator of the identity verification application HA.

[0091] The personal identification application HA displays a screen on the display 15 to ask the user whether to retake an image or to end the procedure. The personal identification application HA determines whether to retake an image based on the user's input operation (step St409). When the personal identification application HA determines to retake an image based on the user's input operation (step St409, YES), it executes the process of step St403 again.

[0092] When the identity verification application HA ends the process, the identity verification application HA may link information indicating that the identity verification of the user could not be performed to the registration information of the member application MA, or may not perform anything to the registration information of the member application MA (i.e., the identity verification of the member application MA remains incomplete). When the identity verification application HA ends the process, the identity verification application HA may display a screen indicating that the identity verification of the user could not be performed on the display 15.

[0093] When the identity verification application HA determines that the face authentication is successful (step St405, YES), it links the registered image of the My Number card to the registration information of the member application MA as an identity verification image and registers it in the identity verification server 30 (step St410). In addition, the identity verification application HA links the registration information of the member application MA with information that identity verification has been completed and registers it in the identity verification server 30.

[0094] When the identity verification application HA determines not to use the registered image of the My Number card as the identity verification image to be registered in the member application MA based on the user's selection operation (step St400, NO), it starts the camera 13 and makes the camera 13 capture the user's face (step St411). For example, the identity verification application HA displays a notification on the display 15 that the face will be captured, and then starts the camera 13 and makes the camera 13 capture the user's face. Since the registered image of the My Number card is a black and white image, there is an advantage that the face can be newly captured and the captured image, which is a color image, is used as the identity verification image for face authentication at the self-register 70, since this allows for highly accurate face authentication. The face authentication at the self-register 70 will be described with reference to FIG. 8.

[0095] The personal identification application HA displays a screen requesting the user to input the verification number B of the My Number card on the display 15. The personal identification application HA receives the verification number B input from the user (step St412).

[0096] The personal identification application HA acquires a registration image from the IC chip of the My Number card using the acquired verification number B as a key (step St413).

[0097] The identity verification application HA compares the registered image acquired from the My Number card in the process of step St413 with the photographed image of the user's face acquired in the process of step St411 using a known technique such as face matching technology (step St414).

[0098] The identity verification application HA compares the registered image with the captured image to determine whether or not face authentication between the face of the person appearing in the registered image and the face of the person appearing in the captured image is successful (step St415).

[0099] When it is determined that the face authentication has failed (step St415, NO), the personal identification application HA displays a result screen indicating that the face authentication has failed on the display 15 (step St416).

[0100] The identity verification application HA determines whether or not face authentication between the registered image and the captured image has been performed less than n times (step St417).

[0101] When the identity verification application HA determines that face authentication between the registered image and the captured image has been performed less than n times (step St417, NO), it executes the process of step St411 again.

[0102] If the identity verification application HA determines that the facial authentication between the registered image and the captured image has not been performed less than n times, i.e., that it is the nth time or more (step St417, YES), it displays a screen on the display 15 prompting the user to complete the procedure of using the captured image as an identity verification image (step St418).

[0103] The personal identification application HA displays a screen on the display 15 to ask the user whether to retake an image or to end the procedure. The personal identification application HA determines whether to retake an image based on the user's input operation (step St419). When the personal identification application HA determines to retake an image based on the user's input operation (step St419, YES), it executes the process of step St411 again.

[0104] When the identity verification application HA determines not to re-take a photograph based on the user's input operation (step St419, NO), it ends the process. When ending the process, the identity verification application HA may link information indicating that the identity of the user could not be verified to the registration information of the member app MA, or may not do anything to the registration information of the member app MA (i.e., the identity verification of the member app MA remains incomplete). When ending the process, the identity verification application HA may display a screen indicating that the identity of the user could not be verified on the display 15.

[0105] When the identity verification application HA determines that the face authentication is successful (step St415, YES), it links the captured image to the registration information of the member application MA as an identity verification image and registers it in the identity verification server 30 (step St420). In addition, the identity verification application HA links the registration information of the member application MA with information that identity verification has been completed and registers it in the identity verification server 30.

[0106] By comparing the registered image stored in the IC chip of the My Number card with the photographed image by the identity verification application HA, for example, even if a minor borrows an adult's My Number card and tries to register it, face authentication fails. In this way, the identity verification system 1 prevents a minor user from masquerading as an adult and verifying his / her identity. By comparing the registered image with the photographed image, the identity verification application HA can link the registered image or photographed image of the user to the registration information of the member application MA as an image for identity verification, and can prevent the image of the face of another person other than the user from being linked to the registration information. In this way, the identity verification application HA can link the highly reliable identity verification result and the image for identity verification to the registration information of the member application MA. In addition, the identity verification application HA can register highly reliable age information in the member application MA by performing identity verification. In other words, completion of identity verification is synonymous with completion of age verification.

[0107] When the member application MA and the identity verification application HA are separate applications, by linking the member application MA and the identity verification application HA provided by each company, the identity verification system 1 can perform highly accurate identity verification of the user without incorporating a new identity verification program into the member application MA.

[0108] The member application MA and the identity verification application HA may be one application. In this case, the user can register as a member and verify his / her identity using one application, without using two applications. In other words, the identity verification system 1 can reduce the complexity of the identity verification process for the user.

[0109] Furthermore, when the terminal device 10 is loaded with information on the My Number card, the terminal device 10 can perform identity verification of the user by linking the information on the My Number card loaded in the terminal device 10 with the identity verification application HA. However, there is a possibility that a minor may use the terminal device 10 of another person who is an adult (for example, a parent or the owner of a terminal device obtained illegally) to perform identity verification and register the member app MA. Even when the terminal device 10 is loaded with information on the My Number card, the terminal device 10 can prevent a minor from registering the member app MA by impersonating another person by photographing the user's face during identity verification.

[0110] Next, an example of a process for identity verification using a driver's license will be described with reference to Fig. 7. Fig. 7 is a flowchart showing an example of a process for identity verification using a driver's license. The process of the flowchart in Fig. 7 is executed by an identity verification application HA. Note that the same processes as those in Fig. 5 are denoted by the same reference numerals and will not be described.

[0111] 5, when it is determined that the My Number card is not to be used (step St300, NO), the personal identification application HA displays an instruction for the user to read information on the IC chip of the driver's license on the display 15. Note that the personal identification application HA may start from the processing of step St500 when it is determined in advance that the driver's license is to be used as the identification card.

[0112] The personal identification application HA displays a screen on the display 15 requesting the user to input the PIN 1 of the driver's license. The personal identification application HA acquires the PIN 1 in response to an input operation by the user. The personal identification application HA displays a screen on the display 15 requesting the user to set the driver's license in a state in which it can be read by the terminal device 10. When the driver's license is set by the user in a state in which the information on the IC chip can be read by the terminal device 10, the personal identification application HA reads the information on the IC chip of the driver's license using the PIN 1 as a key (step St500).

[0113] If step St307 is NO or after the process of step St309 is executed, the personal identification application HA executes a personal identification image registration process using the driver's license (step St505). The personal identification image registration process using the driver's license will be described with reference to FIG.

[0114] Next, a personal identification image registration process using a driver's license will be described with reference to Fig. 8. Fig. 8 is a flowchart of a personal identification image registration process using a driver's license. Each process in the flowchart of Fig. 8 is executed by a personal identification application HA.

[0115] The personal identification application HA judges whether or not to use the registered image stored in the IC chip of the driver's license as the personal identification image to be registered in the member application MA (step St600). The personal identification application HA displays on the display 15 a screen that allows the user to select whether or not to use the registered image of the driver's license as the personal identification image to be registered in the member application MA. When the personal identification application HA judges based on the user's selection operation that the registered image of the driver's license is to be used as the personal identification image to be registered in the member application MA (step St600, YES), it displays on the display 15 a screen that requests the user to input the PIN numbers 1 and 2 of the driver's license. The personal identification application HA acquires the PIN numbers 1 and 2 based on the user's input operation (step St601). The personal identification application HA may display on the display 15 a screen that requests the user to input the PIN number 2 and acquire only the PIN number 2.

[0116] The personal identification application HA determines whether or not a registration image has been acquired from the IC chip of the driver's license using the PINs 1 and 2 as keys (step St602). The personal identification application HA determines whether or not the process of step St602 is performed based on whether or not a registration image has been acquired from the IC chip of the driver's license.

[0117] If the personal identification application HA is unable to acquire a registration image from the IC chip of the driver's license using the PINs 1 and 2 as keys (that is, the PIN 1 and / or the PIN 2 is incorrect) (step St602, NO), it executes the process of step St600 again.

[0118] If the personal identification application HA is able to acquire a registration image from the IC chip of the driver's license using the PIN numbers 1 and 2 as keys (step St602, YES), it causes the camera 13 to capture a picture of the user's face (step St603).

[0119] The personal identification application HA compares the registered image acquired from the driver's license with the photographed image of the user's face acquired in the process of step St603 using a known technique such as face matching technology (step St604).

[0120] The identity verification application HA compares the registered image with the captured image to determine whether or not face authentication between the face of the person appearing in the registered image and the face of the person appearing in the captured image is successful (step St605).

[0121] When it is determined that the face authentication has failed (step St605, NO), the identity verification application HA determines whether or not the face authentication between the registered image and the captured image has been performed less than n times (step St606).

[0122] When the personal identification application HA determines that face authentication between the registered image and the captured image has been performed less than n times (step St606, NO), it executes the process of step St600 again.

[0123] When the identity verification application HA determines that the face authentication between the registration image and the captured image is not less than the nth time, that is, that it is the nth time or more (step St606, YES), it does not allow the registration of the registration image (step St607). When the identity verification application HA determines that the registration of the registration image is not allowed, it may link information that the identity verification of the user could not be performed to the registration information of the member app MA, or it may not do anything to the registration information of the member app MA (that is, the identity verification of the member app MA remains incomplete).

[0124] When the identity verification application HA determines that the face authentication is successful (step St605, YES), it registers the registered image of the driver's license as an identity verification image by linking it to the registration information of the member application MA (step St608). In addition, the identity verification application HA links information indicating that identity verification has been completed to the registration information of the member application MA.

[0125] The processes of steps St603 to St607 may be omitted. In other words, when the image of the driver's license is used as the image for personal identification, the image of the driver's license may be used as the image for personal identification without performing face authentication. In this case, the personal identification application HA executes the process of step St608 after the process of step St602, YES.

[0126] In addition, if an image of the face of the driver's license is used instead of an image of the IC chip, when face authentication is successful in the processes of steps St603 to St605, the image captured in the process of step St603 or the image of the face of the license may be used as the image for identity verification.

[0127] When the personal identification application HA determines that the registered image of the driver's license is not to be used as the personal identification image to be registered in the member application MA based on the user's selection operation (step St600, NO), it starts the camera 13 and makes the camera 13 capture the user's face (step St609). For example, the personal identification application HA displays a notification on the display 15 that the face will be captured, and then starts the camera 13 and makes the camera 13 capture the user's face.

[0128] The personal identification application HA displays a screen requesting input of driver's license PIN numbers 1 and 2 on the display 15. The personal identification application HA acquires the PIN numbers 1 and 2 based on an input operation by the user (step St610). Note that the personal identification application HA may display a screen requesting input of the PIN number 2 on the display 15 and acquire only the PIN number 2.

[0129] The personal identification application HA determines whether or not a registration image has been acquired from the IC chip of the driver's license using the PINs 1 and 2 as keys (step St611). The personal identification application HA determines whether or not the process of step St611 is performed based on whether or not a registration image has been acquired from the IC chip of the driver's license.

[0130] If the personal identification application HA is unable to acquire a registration image from the IC chip of the driver's license using the PINs 1 and 2 as keys (that is, the PINs 1 and 2 are incorrect) (step St611, NO), it executes the process of step St600 again.

[0131] If the identity verification application HA is able to obtain the registered image from the IC chip of the driver's license using the PIN numbers 1 and 2 as keys (step St611, YES), it compares the captured image obtained in the processing of step St609 with the registered image obtained in the processing of step St611 using publicly known technology such as face matching technology (step St612).

[0132] The identity verification application HA compares the registered image with the captured image to determine whether or not face authentication between the face of the person appearing in the registered image and the face of the person appearing in the captured image is successful (step St613).

[0133] When it is determined that the face authentication has failed (step St613, NO), the identity verification application HA determines whether or not the face authentication between the registered image and the captured image has been performed less than n times (step St614).

[0134] When the personal identification application HA determines that face authentication between the registered image and the captured image has been performed less than n times (step St614, NO), it executes the process of step St600 again.

[0135] When the identity verification application HA determines that the face authentication between the registered image and the captured image is not less than the nth time, that is, that it is the nth time or more (step St614, YES), it does not allow the captured image to be registered (step St615). When the identity verification application HA determines that the captured image cannot be registered, it may link information that the identity verification of the user could not be performed to the registration information of the member app MA, or it may not do anything to the registration information of the member app MA (that is, it leaves the identity verification of the member app MA incomplete).

[0136] When the identity verification application HA determines that the face authentication is successful (step St613, YES), the identity verification application HA registers the captured image as an identity verification image by linking it to the registration information of the member application MA (step St616). In addition, the identity verification application HA links information indicating that identity verification has been completed to the registration information of the member application MA.

[0137] Next, an example of a screen for items whose registration has been completed in the member application MA will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of a screen for items whose registration has been completed in the member application MA.

[0138] The screen MN is an example of a screen displayed on the display 15 of the terminal device 10. The screen MN shows items of registration information of the member application MA.

[0139] The screen MN includes the items "Register image for identity verification", "Register points", "My Number card", "Driver's license", "Electronic money linkage", and "Credit card linkage". Note that the items of registration information of the member app MA displayed on the display 15 are not limited to the above-mentioned examples. "Government (official identification card)" indicates the identification card used to register the user's facial image (i.e., to verify the user's identity).

[0140] The screen MN has marks CH1, CH2, CH3, CH4, CH5, and CH6 next to each item to indicate whether or not the registration has been completed. In the example shown in FIG. 8, for items for which registration has been completed, marks with a circle located on the right side, such as marks CH1, CH2, and CH3, are displayed, and for items for which registration has not been completed, marks with a circle located on the left side, such as marks CH4, CH5, and CH6, are displayed. Note that the design of the mark is only an example, and a mark of any design, such as a check mark, may be displayed for items for which registration has been completed. In addition, whether or not registration has been completed may be indicated by emphasizing the text of each item (making the text bold, making the text darker, or filling in the background of the text, etc.) instead of a mark. In the example shown in FIG. 8, it is indicated that the registration of the identification image and the registration of points have been completed. It is also indicated that the My Number card was used to register the identification image. In addition, it is also indicated that neither electronic money nor credit card is linked with regard to payment information.

[0141] In addition, the marks CH1, CH2, CH3, CH4, CH5, and CH6 may be buttons that accept a user's touch operation, and when the user touches a mark, a registration process for the corresponding item may be started. For example, when the user touches the mark CH1, a registration process for an identification image is started.

[0142] Next, an example of a permission process for purchasing a licensed item by the self-checkout 70 will be described with reference to Fig. 10. Fig. 10 is a flowchart of a permission process for purchasing a licensed item by the self-checkout 70. Each process in the flowchart of Fig. 10 is executed by the self-checkout 70.

[0143] The self-checkout 70 receives information regarding pre-purchase processing based on an input operation from a user who is a customer purchasing a product in the store (step St700). The information regarding pre-purchase processing is, for example, information regarding whether or not to purchase a shopping bag. The processing of step St700 may be omitted.

[0144] The self-checkout 70 displays a screen on the display 75 that allows the user to select whether or not the user has registered with the member application MA. The self-checkout 70 determines whether or not the user has registered with the member application MA based on an input operation by the user (step St701).

[0145] When the self-checkout register 70 determines that the user is not registered in the member application MA based on the user's input operation (step St701, NO), the user causes the self-checkout register 70 to read the licensed item, thereby receiving information about the licensed item (step St703).

[0146] The self-register 70 displays instructions for reading the user's identification on the display 75. The instructions for reading the identification are, for example, instructions such as "Please hold your identification over the reader." The self-register 70 reads the information on the IC chip of the My Number card or driver's license held over the reader 72 by the user, and acquires the personal information such as the date of birth and the registered image stored in the IC chip (step St704). At this time, when acquiring the information on the IC chip of the driver's license, it is necessary to input the set PIN. Therefore, for convenience, the self-register 70 may acquire the personal information such as the date of birth and the registered image from the card face image of the My Number card or driver's license instead of reading the information on the IC chip.

[0147] The self-checkout 70 determines whether the date of birth acquired in the process of step St704 is a date of birth indicating that the customer is an adult (step St705).

[0148] If the self-checkout register 70 determines that the date of birth is not that of an adult (i.e., that the date of birth is that of a minor) (step St705, NO), it disallows the purchase of the licensed product as a NG process (step St706). As a NG process, the self-checkout register 70 displays, for example, a screen on the display 75 indicating that the purchase of the licensed product is not permitted.

[0149] If the self-checkout 70 determines that the date of birth is an adult date of birth (step St705, YES), it activates the camera 73 and takes a picture of the user's face (step St707). The self-checkout 70 compares the image of the user's face taken in the process of step St707 with the registered image acquired in the process of step St704, and performs face authentication using a known technique such as face matching technique (step St708).

[0150] The self-checkout register 70 verifies the user's identity by determining whether facial authentication between the captured image and the registered image is successful in the processing of step St708, and determines whether the user is eligible to purchase licensed items (i.e., whether the user is an adult) (step St709).

[0151] If the self-checkout 70 determines that face authentication between the captured image and the registered image has failed and determines that the user is not qualified to purchase the licensed product (step St709, NO), the self-checkout 70 disallows the purchase of the licensed product as NG processing (step St723). As NG processing, the self-checkout 70 displays, for example, a screen on the display 75 indicating that the purchase of the licensed product is not permitted.

[0152] If the self-register 70 determines that face authentication between the captured image and the registered image is successful and determines that the user is eligible to purchase the licensed product (step St709, YES), it displays a screen on the display 75 that allows the user to select a payment method. The self-register 70 makes a payment using the payment method selected by the user (step St710). Note that the self-register 70 may request the user to input information on points to be linked (for example, registration information related to points) before making a payment.

[0153] If the self-register 70 receives input regarding the point information to be linked from the user before the processing of step St710, the self-register 70 executes the point granting process (step St711). For example, as the point granting process, the self-register 70 transmits the point information and purchase information (e.g., purchase date and time and purchase amount information) to the point company server 60. The point company server 60 grants points to the corresponding registered information based on the point information and purchase information received from the self-register 70. Note that if the self-register 70 does not receive input regarding the point information to be linked from the user, the processing of step St711 is omitted.

[0154] When the self-checkout register 70 determines that the user has registered in the member app based on the user's input operation (step St701, YES), it displays a screen on the display 75 that includes instructions to have the reader 72 read a code linked to the registration information of the member app MA. For example, based on the instructions displayed on the display 75, the user holds the code displayed on the display 15 of the terminal device 10 over the reader 72. The self-checkout register 70 reads the code using the reader 72 (step St7021).

[0155] The self-register 70 determines whether an identity verification image has been registered in the member app MA (step St7022). Specifically, the self-register 70 determines whether an identity verification image is linked to the registration information of the member app MA from the code read in the process of step St7021. As a result, the self-register 70 determines whether identity verification of the user (i.e., age verification) has been completed.

[0156] If the self-checkout register 70 determines that the personal identification image has not been registered in the member application MA (i.e., not registered) (step St7022, NO), the user has the self-checkout register 70 scan the licensed item to receive information about the licensed item (step St712).

[0157] Since the user has not registered an image for identity verification in the member app MA and identity verification has not been completed in advance, the self-register 70 needs to obtain information on the user's identification card and verify the user's age. The self-register 70 displays instructions for reading the user's identification card on the display 75. The instructions for reading the identification card are, for example, instructions such as "Please hold your identification card over the reader." The self-register 70 reads information from the IC chip of the My Number card or driver's license held over the reader 72 by the user and obtains personal information such as the date of birth and the registered image stored in the IC chip (step St713). At this time, when obtaining information from the IC chip of the driver's license, it is necessary to input the set PIN. Therefore, for convenience, the self-register 70 may obtain personal information such as the date of birth and the registered information from a card image obtained by photographing the My Number card or driver's license instead of reading information from the IC chip.

[0158] The self-checkout 70 determines whether the date of birth acquired in the process of step St713 is a date of birth indicating that the customer is an adult (step St714).

[0159] If the self-checkout register 70 determines that the date of birth is not that of an adult (i.e., that the date of birth is that of a minor) (step St714, NO), it disallows the purchase of the licensed product as a NG process (step St706). As a NG process, the self-checkout register 70 displays, for example, a screen on the display 75 indicating that the purchase of the licensed product is not permitted.

[0160] If the self-checkout 70 determines that the date of birth is an adult date of birth (step St714, YES), it activates the camera 73 and takes a picture of the user's face (step St715). The self-checkout 70 compares the image of the user's face taken in the process of step St715 with the registered image acquired in the process of step St716, and performs face authentication using a known technique such as face matching technique (step St716).

[0161] The self-checkout register 70 verifies the user's identity by determining whether facial authentication between the captured image and the registered image is successful, and determines whether the user is eligible to purchase licensed items (i.e., whether the user is an adult) (step St717).

[0162] If the self-checkout 70 determines that the face authentication between the captured image and the registered image has failed and determines that the user is not qualified to purchase the licensed product (step St717, NO), the self-checkout 70 disallows the purchase of the licensed product as NG processing (step St723). As NG processing, the self-checkout 70 displays, for example, a screen on the display 75 indicating that the purchase of the licensed product is not permitted.

[0163] If the self-checkout register 70 determines that facial authentication between the captured image and the registered image is successful and determines that the user is eligible to purchase the licensed product (step St717, YES), it determines whether the payment information has been registered in the member app (step St718).

[0164] When the self-checkout 70 determines that the payment information has not been registered in the member app MA by referring to the information linked to the member app MA (step St718, NO), it displays a screen on the display 75 that allows the user to select a payment method. The self-checkout 70 performs payment using the payment method selected by the user (step St710).

[0165] The self-checkout register 70 references the information linked to the member app MA to determine whether point information has been registered in the member app MA, and if it determines that point information has been registered, executes a point granting process (step St711). As part of the point granting process, the self-checkout register 70 transmits purchase information (e.g., information on the purchase date and time and the purchase amount) to the terminal device 10. The terminal device 10 transmits the received purchase information and the point information linked to the member app MA to the point company server 60. The point company server 60 grants points to the corresponding registered information based on the point information and purchase information received from the terminal device 10.

[0166] When the self-checkout 70 determines that the payment information has been registered in the member app MA by referring to the information linked to the member app MA (step St718, YES), the self-checkout 70 performs payment based on the payment information linked to the registered information of the member app MA (step St719). After the process of step St719, the self-checkout 70 executes the process of step St711.

[0167] When it is determined that an image for personal verification has been registered in the member application MA (step St7022, YES), the self-checkout 70 acquires an image for personal verification from the member application MA.

[0168] The self-checkout register 70 receives information about the licensed item when the user has the self-checkout register 70 read the licensed item (step St720).

[0169] Since the user has already registered an identity verification image in the member app MA and identity verification has been completed, the self-register 70 does not need to verify the user's age using the user's identification card. However, there is a possibility that a minor may purchase licensed goods at the self-register 70 using another person's terminal device 10 that has the member app MA installed and for which identity verification has been completed. In this way, in order to prevent a minor from purchasing licensed goods at the self-register 70 using another person's terminal device 10, the self-register 70 photographs the face of the user who is the purchaser, performs face authentication, and determines whether the image matches the identity verification image in the member app MA.

[0170] The self-checkout register 70 activates the camera 73 and captures a picture of the user's face (step St721). The self-checkout register 70 compares the captured image of the user's face with the identity verification image registered in the member application MA, and performs face authentication using a known technique such as face matching technique (step St722).

[0171] The self-checkout register 70 verifies the user's identity by determining whether facial authentication between the captured image and the identity verification image is successful, and determines whether the user is eligible to purchase licensed items (i.e., whether the user is an adult) (step St717).

[0172] If the self-checkout 70 determines that the face authentication between the photographed image acquired in the process of step St721 and the image for personal identification has failed and determines that the user is not qualified to purchase the licensed product (step St717, NO), it disallows the purchase of the licensed product as NG processing (step St723). As NG processing, the self-checkout 70 displays, for example, a screen on the display 75 indicating that the purchase of the licensed product is not permitted.

[0173] If the self-checkout 70 determines that the face authentication between the photographed image acquired in the process of step St721 and the image for identity verification is successful and determines that the user is qualified to purchase the licensed product (step St717, YES), it determines whether the payment information has been registered in the member app (step St718). The processes after step St718, that is, steps St710, St711, and St719, have been explained once, so the explanation will be omitted here.

[0174] If the self-checkout 70 does not receive the information about the licensed product (that is, if the user does not purchase the licensed product), the self-checkout 70 executes the process of step St718 after the process of step St701.

[0175] Furthermore, when the self-checkout register 70 receives the information on the licensed product, the self-checkout register 70 may determine whether or not the user has been registered in the member application MA (that is, the process of step St701).

[0176] The identity verification system 1 can register a user's personal information, an identity verification image, payment information, and point information in association with one code. The identity verification system 1 can perform everything from user age verification, point allocation, and payment with that one code. This allows the identity verification system 1 to eliminate the need for the user to present various pieces of information and input payment information when purchasing licensed products, thereby improving convenience.

[0177] As described above, the identity verification system 1 photographs the face of a user purchasing licensed goods at the self-checkout register 70 and performs facial authentication by comparing the photographed image with a registered image on the identification card, thereby preventing minors from purchasing licensed goods by masquerading as adults.

[0178] Furthermore, even when the self-register 70 completes identity verification and uses the member app MA linked to the identity verification image to determine whether or not to permit the purchase of a licensed product, the self-register 70 performs face authentication by comparing the captured image with the identity verification image. This allows the identity verification system 1 to prevent a minor from using an adult's terminal device 10 to pose as an adult and purchase a licensed product at the self-register 70. For example, if a minor attempts to purchase a licensed product at the self-register 70 using an adult's terminal device 10, face authentication between the captured image and the identity verification image will fail, and the minor will not be able to purchase the licensed product.

[0179] <Hotel, car rental, and gas station use cases> 11A is a diagram for explaining a use case in which a hotel member application MA is used. In the following description, the hotel member application MA is referred to as a hotel application.

[0180] The user operates the terminal device 10 to register the user's personal information in the hotel application by the method shown in Fig. 4 (St801). The personal information registered in the hotel application is referred to as registration information.

[0181] The user operates the terminal device 10 and uses the identity verification application HA to verify the identity of the user in the method shown in FIGS. 5 and 6 (or the method shown in FIGS. 7 and 8) (St802).

[0182] If the identity verification is successful in step St802, the terminal device 10 associates the hotel application with the identity verification application HA and registers them in the identity verification server 30 (St803). As a result, the registration information of the hotel application and the identity verification image of the identity verification application HA are associated and registered in the identity verification server 30.

[0183] The user makes a hotel reservation through the hotel app. The hotel app generates a code (e.g., a barcode or a two-dimensional code) corresponding to the registration information and the information related to the reservation (St804).

[0184] When checking in to a hotel, the user causes the terminal device 10 to display the code (e.g., a barcode or a two-dimensional code) generated by the hotel app, and causes the self-checkout register 70 of the hotel to read it (St805). Reading this code corresponds to step St7021 in Fig. 10. Note that the user may cause the identity verification app HA to display the code instead of the hotel app, and cause the self-checkout register 70 to read it.

[0185] The self-register 70 inquires of the identity verification server 30 as to whether the registration information corresponding to the read code is linked to the identity verification image, and if so, obtains the registration information and the identity verification image from the identity verification server 30 and performs identity verification (St806). To verify the identity of the user, the self-register 70 may photograph the user's face, compare the photographed image with the identity verification image, and determine that the user is the real person if the comparison is successful. The comparison between the photographed image and the identity verification image may be performed by the identity verification server 30.

[0186] If the identity verification in step St806 is successful, the self-register 70 performs check-in processing. This allows the self-register 70 to perform reservation confirmation, identity verification, membership authentication, reward provision, payment processing, point provision, and the like for the user associated with the code all at once.

[0187] The user stays at the hotel (St807). Then, when checking out of the hotel, the user displays the code on the hotel app and has the self-registered cash register 70 read it (St808). This allows the self-registered cash register 70 to perform identity verification, membership authentication, rewards, payment processing, points allocation, and other operations for the user associated with the code all at once.

[0188] 11B is a diagram for explaining a use case in which a rental car member application MA is used. In the following description, the rental car member application MA is referred to as a rental car application.

[0189] The user operates the terminal device 10 to register the user's personal information in the rental car application (St811) in the manner shown in Fig. 4. The personal information registered in the rental car application is referred to as registration information.

[0190] The user operates the terminal device 10 and uses the personal identification application HA to perform personal identification using the driver's license in the manner shown in FIGS. 7 and 8 (St812).

[0191] If the identity verification is successful in step St812, the terminal device 10 associates the rental car application with the identity verification application HA and registers them in the identity verification server 30 (St813). As a result, the registration information of the rental car application and the identity verification image of the identity verification application HA are associated and registered in the identity verification server 30.

[0192] The user reserves a rental car through the rental car app. The rental car app generates a code corresponding to the registration information and the information related to the rental car reservation (St814).

[0193] When renting a car, the user causes the rental car app to display the code generated above on the terminal device 10 and causes the self-checkout register 70 at the rental car store to read it (St815). Reading this code corresponds to step St7021 in Fig. 10. Note that the user may cause the personal identification app HA to display the code instead of the rental car app and cause the self-checkout register 70 to read it.

[0194] The self-register 70 inquires of the identity verification server 30 as to whether the registration information corresponding to the read code is linked to the identity verification image, and if so, obtains the registration information and the identity verification image from the identity verification server 30 and performs identity verification (St816). To verify the identity of the user, the self-register 70 may photograph the user's face, compare the photographed image with the identity verification image, and determine that the user is the real person if the comparison is successful. The comparison between the photographed image and the identity verification image may be performed by the identity verification server 30.

[0195] If the identity verification in step St815 is successful, the self-register 70 performs the rental car rental process. This allows the self-register 70 to perform reservation confirmation, identity verification, membership authentication, privilege granting, payment processing, point granting, etc., of the user associated with the code all at once. The code read by the self-register 70 in step St815 may be used as an electronic key for the rental car.

[0196] The user rents a car (St817). Then, when returning the rental car, the user displays the code on the rental car app and has the self-registered cash register 70 read it (St818). This allows the self-registered cash register 70 to perform identity verification, membership authentication, rewards, payment processing, points allocation, and the like for the user associated with this code all at once.

[0197] 11C is a diagram for explaining a use case in which a gas station member application MA is used. In the following description, the gas station member application MA is referred to as a gasoline application.

[0198] The user operates the terminal device 10 to register the user's personal information in the gasoline app (St821) using the method shown in Fig. 4. The personal information registered in the gasoline app is referred to as registration information.

[0199] The user operates the terminal device 10 and uses the identity verification application HA to verify the identity of the user using a driver's license or a My Number card in the manner shown in FIGS. 7 and 8 (or FIGS. 5 and 8) (St822).

[0200] If the identity verification is successful in step St822, the terminal device 10 associates the gasoline application with the identity verification application HA and registers them in the identity verification server 30 (St823). As a result, the registration information of the gasoline application and the identity verification image of the identity verification application HA are associated and registered in the identity verification server 30.

[0201] When using a service at a gas station (e.g., refueling or washing a car), the user causes the terminal device 10 to display a code corresponding to the registration information of the gasoline app, and causes the self-checkout register 70 at the gas station to read it (St824). Reading this code corresponds to step St7021 in Fig. 10. Note that the user may also display the code on the display of the personal identification app HA instead of the gasoline app, and cause the self-checkout register 70 to read it.

[0202] The self-register 70 inquires of the identity verification server 30 as to whether the registration information corresponding to the read code is linked to the identity verification image, and if so, obtains the registration information and the identity verification image from the identity verification server 30 and performs identity verification (St825). To verify the identity of the user, the self-register 70 may photograph the user's face, compare the photographed image with the identity verification image, and determine that the user is the real person if the comparison is successful. The comparison between the photographed image and the identity verification image may be performed by the identity verification server 30.

[0203] If the identity verification in step St825 is successful, the self-checkout 70 provides the service (for example, starts refueling, starts the car wash, etc.). As a result, the self-checkout 70 can select the type of refueling and amount of refueling for the user associated with this code, select the car wash items, verify the identity, authenticate the member, grant benefits, process payments, grant points, etc., all at once.

[0204] The user uses the gas station service (St826).

[0205] Note that an identity verification image once registered in the identity verification server 30 from a member app MA of a certain service (e.g., a hotel app) may be usable for identity verification in a member app MA of another service (e.g., a rental car app or a gasoline app) with the user's consent. This allows the user to omit the registration of an identity verification image from the next time onwards, once an identity verification image has been registered.

[0206] <Use cases for government services> 12 is a diagram for explaining a use case in which a member application MA of a government service is used. Hereinafter, the member application MA of a government service is referred to as a citizen application.

[0207] The user operates the terminal device 10 and registers the user's personal information in the citizen app (St901) by the method shown in Fig. 4. The personal information registered in the citizen app is referred to as registration information.

[0208] The user operates the terminal device 10 and uses the identity verification application HA to verify the identity of the user in the manner shown in Figures 5 and 6 (or the manner shown in Figures 7 and 8) (St902). Here, the identity verification includes, in addition to verifying whether the user is the user himself / herself, verifying whether the user is a resident of an administrative district (e.g., a city, ward, town, or village) in which the citizen application is provided.

[0209] If the identity verification is successful in step St902, the terminal device 10 associates the citizen app with the identity verification application HA and registers them in the identity verification server 30. As a result, the registration information of the citizen app and the identity verification image of the identity verification application HA are associated and registered in the identity verification server 30 (St903).

[0210] When entering a facility managed by the government (e.g., a museum, a science museum, a zoo, etc.), the user displays a code corresponding to the registration information of the citizen app and has the self-checkout 70 of the facility read it (St904). Reading this code corresponds to step St7021 in Fig. 10. Note that the user may display the code on the identity verification app HA instead of the citizen app and have the self-checkout 70 read it.

[0211] The self-register 70 inquires of the identity verification server 30 as to whether the registration information corresponding to the read code is linked to the identity verification image, and if so, obtains the registration information and the identity verification image from the identity verification server 30 and performs identity verification (St906). To verify the identity of the user, the self-register 70 photographs the user's face, compares the photographed image with the identity verification image, and determines that the user is the person in question if the comparison is successful. The comparison between the photographed image and the identity verification image may be performed by the identity verification server 30.

[0212] If the self-checkout 70 is successful in the identity verification in step St906 (for example, if it is verified that the user is a resident of the administrative district of the facility), it presents free admission to the terminal device 10 (St907). The user enters the facility free of admission fee (St909). Note that free admission is just one example, and it may be possible to offer a discount on the admission fee or provide a special benefit. Furthermore, the self-checkout 70 may also verify the user's age, etc., during identity verification, and offer a discount or special benefit according to the user's age.

[0213] If the identity verification in step St906 fails, the self-register 70 presents the entrance fee to the terminal device 10, and the terminal device 10 pays the entrance fee to the self-register 70 (St908). The self-register 70 then displays permission to enter. At this time, the self-register 70 may open the entrance gate to allow the user to enter (St909). This allows the user to enter the facility.

[0214] Through the above process, users can use the citizen app to easily receive services from the administrative district they live in. In addition, through the above process, administrative agencies providing services can perform strict and speedy identity verification and easily collect user information, reducing the workload of employees.

[0215] <Financial services use cases> FIG. 13 is a diagram illustrating a use case in which an application for financial services is made using an identity verification application.

[0216] The terminal device 10 acquires the personal identification application provided by the financial server (St921, St922).

[0217] The identity verification application HA of the terminal device 10 authenticates the user's My Number card. For example, the identity verification application HA transmits the electronic certificate of the IC chip of the My Number card to the financial server (St923). The financial server queries the identity verification authentication business operator server 20 for the electronic certificate of the My Number card (St924), and if the query is successful, links the query result to the identity verification application HA (St925). This enables the financial server to verify the validity of the electronic certificate of the My Number card, and to trust that information exchanged with the terminal device 10 thereafter belongs to the user.

[0218] The identity verification application HA of the terminal device 10 transmits the identity verification image of the user to the financial server (St926). The financial server registers the received identity verification image (St927). The identity verification image may be any of an image of the user's face, a facial photograph printed on the face of the identity verification document, and face image data stored in the IC chip of the My Number card.

[0219] The user operates the terminal device 10 to apply for financial services (St928), and the financial server accepts the application (St929).

[0220] The terminal device 10 captures the user's face, generates a captured image, and transmits it to the financial server (St930).

[0221] The financial server receives the photographed image in step St930, compares the photographed image with the identity verification image, and performs identity verification (St931). Note that in this process, the financial server performs identity verification, but the financial server may request identity verification from the identity verification server 30 described above, and the identity verification server 30 may perform identity verification.

[0222] If the identity verification in step St931 is successful, the financial server executes the application process (St932).

[0223] The financial server transmits the application result to the terminal device 10 (St933). If the identity verification and application processing are successful, the financial server transmits information indicating the application success and the application contents as the application result to the terminal device 10. If the identity verification or application processing is unsuccessful, the financial server transmits information indicating the application failure as the application result to the terminal device 10.

[0224] The terminal device 10 receives the application result from the financial server, and displays the application result (success, failure, etc.) on the display 15 (St934).

[0225] Through the above process, the user can apply for financial services using the terminal device 10 without visiting the financial company's counter. In addition, the financial company can verify that the user is the person in question, so that the application for financial services can be realized using the terminal device 10.

[0226] <Use case of credit card payment app> Fig. 14 is a diagram for explaining a use case when registering a credit card payment application. The credit card payment application may correspond to the above-mentioned member application MA. In the following, the credit card payment application will be described as including the function of the above-mentioned personal identification application HA, but the credit card payment application and the personal identification application HA may be separate applications.

[0227] The terminal device 10 acquires a credit card payment application provided by a credit card company from the payment company server 50 and installs it (St941, St942).

[0228] The user starts the credit card payment application of the terminal device 10 (St943). Then, the user inputs his / her credit card number and expiration date into the credit card payment application (St944). Note that this input may be manual input by the user, or may be automatic input by capturing an image of the credit card with the camera 13 of the terminal device 10.

[0229] The user inputs the PIN of the My Number card to the credit card payment application of the terminal device 10 (St945). Alternatively, the credit card payment application captures an image of the My Number card with the camera 13 of the terminal device 10 and performs OCR to obtain the verification number B of the My Number card.

[0230] The credit card payment application of the terminal device 10 acquires personal information, face image data, and the like from the IC chip of the My Number card using the PIN or verification number B of step St945 (St946).

[0231] The credit card payment application of the terminal device 10 captures an image of the user's face and generates a captured image (St947).

[0232] The credit card payment application of the terminal device 10 performs a one-to-one comparison between the face image data acquired in step St946 and the image of the user's face captured in step St947, and performs identity verification (St948).

[0233] The credit card payment application of the terminal device 10 transmits the result of the identity verification in step St948 to the payment company server 50 (St949). The following describes the case where identity verification is successful. If identity verification is unsuccessful, the following processes may not be executed.

[0234] The credit card payment application of the terminal device 10 requests the identity verification server 30 to register an identity verification image (St950). The identity verification image may be face image data acquired from the IC chip of the My Number card in step S946, a face image printed on the face of the My Number card, or a photographed image of the user's face captured in step S947.

[0235] The personal identification server 30 associates the credit card payment application with the personal identification image and registers them in a predetermined database (St951).

[0236] The credit card payment application of the terminal device 10 requests the payment company server 50 to register the user's personal information and secret information (St952). Here, the personal information may be information acquired in step St946. The secret information may be, for example, secret information known only to the user and input by the user.

[0237] The settlement company server 50 associates the personal information and confidential information of step St952 with the credit card number and expiration date, and stores them in a predetermined database (St953).

[0238] The payment company server 50 issues a new user ID to the user, and transmits the user ID to the credit card payment application of the terminal device 10 (St954).

[0239] The credit card payment application of the terminal device 10 displays the user ID and the successful registration in step St954 (St955), and ends this process.

[0240] Through the above process, the credit card company can securely link the user's credit card to the credit card payment app using the user's My Number card. Also, the user can easily obtain the credit card payment app linked to his / her credit card using the My Number card without manually inputting personal information, etc.

[0241] FIG. 15 is a diagram for explaining a use case when using a credit card payment application.

[0242] The user selects a product, for example, in a web browser or app on the terminal device 10, and presses a purchase button on the purchase screen (St961). The user then presses a payment button on the web browser or app (St962) and selects a payment method (St963). Here, the user selects credit card payment as the payment method (St964).

[0243] The terminal device 10 starts the credit card payment application (St965).

[0244] The credit card payment application of the terminal device 10 automatically inputs the payment information (eg, payment amount, credit card number, expiration date, user name, etc.) (St966).

[0245] The credit card payment application of the terminal device 10 captures an image of the user's face with the camera 13 and generates a captured image (St967).

[0246] The credit card payment application of the terminal device 10 transmits a face authentication request to the personal identification server 30 (St968). The face authentication request includes the captured image generated in step St967.

[0247] The identity verification server 30 receives the face authentication request in step St968 and performs one-to-N face matching processing (St969). For example, as the one-to-N face matching processing, the identity verification server 30 searches the database for an identity verification image having a face matching score with the photographed image that is equal to or higher than a predetermined threshold and is the highest. The face matching score is a score indicating the likelihood that two face images are the same person. If the search fails, that is, if the identity verification image presumed to be the same person as the photographed image does not exist in the database, the identity verification server 30 transmits a face authentication result including face authentication failure and a matching score to the terminal device 10. If the search succeeds, that is, if the identity verification image presumed to be the same person as the photographed image exists in the database, the identity verification server 30 transmits a face authentication result including face authentication success, a matching score, and the date and time when the identity verification image was registered (hereinafter referred to as registration date and time) to the terminal device 10.

[0248] The credit card payment application of the terminal device 10 determines whether or not the face authentication has been successful based on the face authentication result of step St969 (St970). If it is determined that the face authentication has been successful, the credit card payment application of the terminal device 10 requests payment from the payment company server 50 (St971). If it is determined that the face authentication has failed, the credit card payment application of the terminal device 10 may display a message to that effect and end the process.

[0249] The payment company server 50 receives the payment request in step St971 and performs the payment process using the credit card number associated with the user (St972). The payment company server 50 transmits a payment process completion to the terminal device 10.

[0250] The credit card payment application of the terminal device 10 displays the completion of the payment process in step St972 (St973). At this time, the credit card payment application may also display information regarding point allocation, bonus allocation, etc., as necessary. Then, this process ends.

[0251] Through the above process, the credit card company can prevent fraudulent use of credit cards by performing face authentication of the user through the credit card payment app and performing payment processing if the face authentication is successful. In addition, by making a payment through the credit card payment app, the user can easily make a payment without having to enter a credit card number, etc.

[0252] <Identity verification via store terminal> FIG. 16 is a block diagram showing a modified example of the personal identification system 1. In FIG.

[0253] 16, the identity verification system 1 according to the modified example includes a store terminal 80, an identity verification server 30, a face matching DB 31, a payment company server 50, and an identity verification authentication business operator server 20. The identity verification system 1 may also include a member company server 40 and / or a point company server 60 shown in FIG.

[0254] The face matching DB 31 manages face images used for face matching of users of the store as a database. The identity verification server 30 uses the face matching DB 31 to perform face matching of the user.

[0255] The store terminal 80 includes a processor 81, a memory 82, a communication I / F 83, an IC reader 84, a code reader 85, a camera 86, and a display 87. The processor 81, the memory 82, the communication I / F 83, and the display 87 may be similar to the processor 71, the memory 76, the communication I / F 74, and the display 75 of the self-checkout 70 described above. The IC reader 84 is a device that reads information stored in an IC chip on an identification document. The code reader 85 is a device that reads bar codes and two-dimensional codes. The camera 86 captures a picture of the user's face and generates a captured image.

[0256] The store terminal 80 cooperates with the identity verification server 30 to verify the identity and age of the user based on a photographed image of the user's face and his / her identity document. The store terminal 80 also cooperates with the payment company server 50 to perform payment processing for licensed products and the like purchased by the user. Details of the processing performed by the store terminal 80 will be described later as appropriate.

[0257] FIG. 17 is a flowchart showing an example of a process for registering an identity verification image in the identity verification server 30 and reusing it.

[0258] The store terminal 80 uses the code reader 85 to read the bar code (or two-dimensional code) of the licensed item (St1001).

[0259] The store terminal 80 displays the payment amount for the licensed product read in step St1001 on the display 87 (St1002).

[0260] The store terminal 80 determines whether or not the identity verification image of the user who purchases the licensed product has been registered in the identity verification server 30 (St1003). For example, the store terminal 80 inquires of the user whether or not the identity verification image has been registered in the past, and makes the determination based on the response from the user.

[0261] When the store terminal 80 determines that the user's identity verification image has been registered in the identity verification server 30 (for example, when the user responds to the inquiry that the image has been registered) (St1003, YES), the store terminal 80 performs a registration process (St1004). Details of the registration process will be described later (see FIG. 18).

[0262] If the store terminal 80 determines that the user's identity verification image has not been registered in the identity verification server 30 (for example, if the user responds to the inquiry that the image has not been registered) (St1003, NO), the store terminal 80 proceeds to the next step St1005.

[0263] The store terminal 80 requests the user to submit an identity verification document (St1005). In response, the user provides the store terminal 80 with an identity verification document that the user possesses.

[0264] The store terminal 80 uses the IC reader 84 to acquire face image data, age information, etc. from the IC chip of the identification document provided by the user, and temporarily stores the data in the memory 82 (St1006). The store terminal 80 may also photograph the face of the identification document with a specified camera and acquire the face photo printed on the face as face image data. The store terminal 80 may also photograph the face of the identification document with a specified camera, perform OCR, and identify age information from the date of birth printed on the face of the document.

[0265] The store terminal 80 judges, from the age information acquired in step St1006, whether or not the user is of an age sufficient to purchase the licensed product read in step St1001 (St1007).

[0266] When the store terminal 80 determines that the user is not of an age to purchase the licensed product (St1007, NO), it displays to the user that the licensed product cannot be purchased (St1008) and ends this process. In this case, the store terminal 80 may call a store clerk.

[0267] When the store terminal 80 determines that the user is old enough to purchase the licensed product (St1007, YES), it uses the camera 86 to take a picture of the user's face (St1009).

[0268] The store terminal 80 performs face matching between the image of the user's face captured in step St1009 and the face image data acquired from the IC chip of the identification document that was temporarily stored in the memory 82 in step St1006. That is, the store terminal 80 performs identity verification. The store terminal 80 determines whether or not face matching is successful (St1010), and if face matching is unsuccessful (St1010, NO), returns the process to step St1009. Note that if face matching has failed a predetermined number of times or more, the store terminal 80 may end this process and call a store clerk.

[0269] If face matching is successful (St1010, YES), the store terminal 80 transmits a payment request for the payment amount displayed in step St1002 to the payment company server 50 (St1011).

[0270] The settlement company server 50 receives the settlement request in step St1011, executes the settlement process (St1012), and transmits a settlement completion notice to the shop terminal 80.

[0271] The store terminal 80 receives the notice of completion of the payment from the payment company server 50, and displays the completion of the payment on the display 87 (St1013).

[0272] The store terminal 80 inquires of the user whether or not it is OK to register the face image used for face matching (St1014). At this time, the store terminal 80 may also display the advantage that by registering the face image, it will become unnecessary to present an identification document when purchasing licensed products from the next time onwards.

[0273] If the user replies that he / she does not approve the registration of the face image used for face matching (St1014, NO), the store terminal 80 ends this process.

[0274] If the user answers that the face image used for face matching is to be registered (St1014, YES), the store terminal 80 transmits a request to register the face image to the identity verification server 30. Here, the face image transmitted to the identity verification server 30 may be face image data acquired from the IC chip of the identity verification document, face image data acquired by photographing the face of the identity verification document, or a photographed image of the user taken in step St1009.

[0275] The personal identification server 30 receives the facial image registration request transmitted in step St1016, registers the facial image in the face matching DB 31 (St1017), and transmits a registration completion notification to the store terminal 80. The facial image registered in the personal identification server 30 is referred to as a personal identification image.

[0276] The store terminal 80 receives the registration completion notification from the personal identification server 30, displays the completion of the registration of the face image on the display 87 (St1018), and ends this process.

[0277] Through the above process, the identity verification image that has been successfully matched is registered in the identity verification server 30. Next, a detailed description will be given of the registration process (St1004) that is executed when it is determined in step St1003 that the identity verification image has been registered in the identity verification server 30 (St1003, YES).

[0278] Fig. 18 is a flow chart showing an example of the registered process of Fig. 17. That is, Fig. 18 corresponds to details of step St1004 of Fig. 17.

[0279] The store terminal 80 uses the camera 86 to capture a picture of the user's face (St1101).

[0280] The store terminal 80 transmits a face authentication request including the image of the user's face captured in step St1101 to the personal identification server 30 (St1102).

[0281] The identity verification server 30 receives the face authentication request from the store terminal 80 and executes one-to-N face matching processing (St1103). For example, as one-to-N face matching processing, the identity verification server 30 searches the face matching DB 31 for an identity verification image having a face matching score with the photographed image that is equal to or higher than a predetermined threshold. The face matching score is a score indicating the likelihood that two face images are the same person. If the search fails, that is, if the identity verification image estimated to be the same person as the photographed image does not exist in the face matching DB 31, the identity verification server 30 transmits a face authentication result including a face authentication failure and a matching score to the store terminal 80. If the search succeeds, that is, if the identity verification image estimated to be the same person as the photographed image exists in the face matching DB 31, the identity verification server 30 transmits a face authentication result including a face authentication success, a matching score, and the date and time when the identity verification image was registered (hereinafter referred to as the registration date and time) to the store terminal 80.

[0282] The store terminal 80 determines whether the face authentication result received from the identity verification server 30 is a success or not (St1104).

[0283] When the store terminal 80 determines that the face authentication has failed (St1104, NO), the store terminal 80 advances the process to step St1005 in Fig. 17. Note that, when the face authentication has failed, the store terminal 80 may return to step St1101 several times to repeat face photographing and face authentication, rather than immediately advancing the process to step St1005.

[0284] When the store terminal 80 determines that the face authentication was successful (St1104, YES), it performs a validity determination of the face authentication result (St1105). For example, the store terminal 80 performs the validity determination of the face authentication result based on at least one of the following conditions (A1) to (A4). The store terminal 80 may adopt one or two or more of the following conditions (A1) to (A4). Furthermore, when two or more conditions are adopted, the store terminal 80 may determine that the result is valid when all the conditions are satisfied, or may determine that the result is valid when at least one of the conditions is satisfied.

[0285] (A1) The store terminal 80 determines that the face matching score is invalid when it is less than a predetermined reference value, and determines that the face matching score is valid when it is equal to or greater than the reference value. The reference value is a value greater than the threshold value for face matching in the identity verification server 30. (A2) If the time that has elapsed since the registration date and time of the personal verification image is greater than a predetermined reference value, the store terminal 80 determines that the image is invalid, and if the time that has elapsed is equal to or less than the reference value, the store terminal 80 determines that the image is valid. (A3) When the number of times that face photographing and face authentication are repeated after returning to step St1101 is equal to or greater than a predetermined threshold, the store terminal 80 determines that the process is invalid; when the number of times that the process is repeated is less than the threshold, the store terminal 80 determines that the process is valid. (A4) If the captured image has a local change in characteristics (for example, a change in hairstyle or the presence or absence of glasses) compared to the image for identity verification, the store terminal 80 determines that the image is invalid; if there is no change in characteristics, the store terminal 80 determines that the image is valid.

[0286] In this way, by performing the validity determination in step St1105, it is possible to perform more strict identity verification. Note that the validity determination in step St1105 may be omitted. Alternatively, whether or not to perform the validity determination in step St1105 may be determined depending on the type of licensed product.

[0287] When it is determined that the image is not valid (St1105, NO), the store terminal 80 advances the process to step St1005 in Fig. 17. As a result, the personal verification image is updated.

[0288] When the store terminal 80 determines that the image is valid (St1105, YES), it displays the expiration date of the current identification image on the display 87 (St1106). The expiration date of the identification image may be a predetermined period from the registration date and time. This allows the user to know that if the expiration date is short, the user will need to bring an identification document next time. Note that the identification server 30 may delete an identification image whose expiration date has passed from the face matching DB 31.

[0289] The store terminal 80 transmits a payment request for the payment amount displayed in step St1002 to the payment company server 50 (St1107). In other words, if an identity verification image of the same person as that of the photographed image exists in the face matching DB 31 of the identity verification server 30, the store terminal 80 permits the user of the photographed image to purchase the licensed product. This is because the existence of an identity verification image of the same person as that of the photographed image in the face matching DB 31 of the identity verification server 30 is synonymous with the user being a person who has been permitted to purchase a licensed product in the past.

[0290] The settlement company server 50 receives the settlement request in step St1107, executes the settlement process (St1108), and transmits a settlement completion notice to the shop terminal 80.

[0291] The shop terminal 80 receives the notice of completion of the payment from the payment company server 50, and displays the completion of the payment on the display 87 (St1109). Then, this process ends.

[0292] Through the above process, a user whose identity verification image has been registered in identity verification server 30 can purchase licensed products without presenting an identity verification document.

[0293] (Modification) The above-mentioned identity verification process of comparing the face information of the person (e.g., a photographed image of the face) with registered face information (e.g., an image for identity verification), the judgment process based on information acquired from an IC chip of an identity verification document (e.g., in the case of judging whether or not a licensed product can be sold, the judgment process based on information on the date of birth acquired from the IC chip), and the payment process may all be realized by cooperation between a payment terminal linked to a POS register installed in a store and the user's terminal device 10. For example, the user may start a payment application of the terminal device 10 (e.g., a smartphone), and the payment application may perform the above-mentioned process with the payment terminal. Alternatively, the user may hold the terminal device 10 (e.g., a smartphone) over the payment terminal, and the terminal device 10 may perform the above-mentioned process with the payment terminal through short-range wireless communication represented by NFC communication. Alternatively, the user may approach the payment terminal (e.g., pass through a specified gate) while keeping the terminal device 10 (e.g., a smartphone) in a pocket of a bag or clothes, and the terminal device 10 may perform the above-mentioned process with the payment terminal through specified wireless communication.

[0294] (Summary of this embodiment) <Technology 1> An identity verification terminal (e.g., terminal device 10) in this embodiment includes a camera (e.g., camera 13) that photographs the user's face, a reader (e.g., reader 12) that acquires a registration image, which is an image of the face, from an identity verification document, and a processor (e.g., processor 11) that acquires the image of the user's face captured by the camera, compares the registration image with the captured image, and completes identity verification of the user if facial authentication between the face of the person appearing in the registration image and the user's face is successful, and registers the registration image or the captured image as an identity verification image.

[0295] As a result, when the identity verification terminal of this embodiment performs identity verification of a user using an identity verification document, it photographs the user's face and compares the photographed image with the registered image on the identity verification document, thereby preventing the user from registering as another person and performing highly reliable identity verification.

[0296] <Technology 2> In the personal identification terminal described in Technology 1, the processor registers personal information, such as the user's name and date of birth, which the user has registered in advance, in association with an image for personal identification.

[0297] As a result, the personal identification terminal according to the present embodiment can create registration information that links a highly reliable personal identification image for which personal identification has been completed with the personal identification information of the user. By using the registration information, the personal identification terminal can determine with high accuracy whether the user is a minor or an adult.

[0298] <Technology 3> In the personal identification terminal described in Technique 1 or 2, the processor creates a code that holds information linking personal information and a personal identification image.

[0299] This allows the user to skip age verification at the self-checkout (e.g., the self-checkout 70) by having the self-checkout read the code when purchasing a licensed product at the self-checkout. This allows the user's identity verification terminal according to the present embodiment to improve user convenience.

[0300] <Technology 4> In the personal identification terminal according to any one of the first to third aspects, the code is a one-dimensional code or a two-dimensional code.

[0301] As a result, the identity verification terminal of this embodiment can eliminate age verification at the self-checkout by having the self-checkout read a one-dimensional or two-dimensional code linked to the user's registration information, thereby improving user convenience.

[0302] <Technology 5> In the personal identification terminal according to any one of techniques 1 to 4, the processor further links information stored in the code with information on a service linked by the user.

[0303] As a result, the identity verification terminal of this embodiment can further link other services to the code linked to the user's registration information, allowing the user to use various services all at once, thereby improving user convenience.

[0304] <Technology 6> In the personal identification terminal according to any one of the first to fifth aspects, the service information is payment information or point information.

[0305] In this way, the identity verification terminal according to the present embodiment further links payment information and point information to a code linked to the user's registration information, thereby eliminating the need for the user to input payment information and point information when purchasing a product, and reducing the complexity of the user's purchase process at the self-checkout. Also, the identity verification terminal can reduce the time required for the user's purchase process and prevent the self-checkout from becoming crowded.

[0306] <Technology 7> In an identity verification terminal described in any one of Techniques 1 to 6, if a processor determines that facial authentication between the face of a person appearing in a registered image and the user's face has failed, and the number of times the registered image has been compared with the captured image is equal to or greater than a threshold, a screen is displayed on a display device indicating that the user's identity could not be verified and a screen prompting the user to end the procedure.

[0307] As a result, the personal identification terminal according to this embodiment can prevent the registration of an image of a person's face that is different from the registered image on the personal identification document, and can perform highly accurate personal identification of the user.

[0308] <Technology 8> In the personal identification terminal according to any one of techniques 1 to 7, when the personal identification document is a My Number card, the processor obtains an electronic certificate for personal information held on the My Number card.

[0309] As a result, the personal identification terminal according to this embodiment can prevent a user from identifying himself / herself using another person's personal identification document by acquiring an electronic certificate.

[0310] <Technology 9> In the identity verification terminal according to any one of the first to eighth techniques, the processor displays on the display device a screen indicating that registration of the user's identity verification has been completed.

[0311] This allows the personal identification terminal according to this embodiment to notify the user whether or not personal identification has been successful.

[0312] <Technology 10> In the personal identification terminal according to any one of techniques 1 to 9, the personal identification document is a My Number card or a driver's license.

[0313] As a result, the personal identification terminal according to this embodiment can perform highly reliable user identification by using a highly reliable official identification card as the personal identification document.

[0314] <Technology 11> In an identity verification terminal described in any one of Technologies 1 to 10, a processor obtains identity information of the user, such as the user's name and date of birth, from the identity verification document, determines whether the input information of the name and date of birth entered by the user matches the identity information, and if the input information matches the identity information, links the input information to an identity verification image and registers it.

[0315] As a result, the personal identification terminal according to this embodiment can perform personal identification based on information that the user has registered in advance in the application, and can register the personal identification image in association with the information.

[0316] Although the embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, corrections, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also belong to the technical scope of the present disclosure. In addition, the components in the above-mentioned embodiments may be arbitrarily combined within the scope of the invention. [Industrial Applicability]

[0317] The technology disclosed herein is useful as an identity verification terminal, a program, an identity verification method, and an identity verification system that perform highly reliable identity verification. [Explanation of symbols]

[0318] 1. Identity Verification System 10 Terminal Equipment 20 Identity Verification and Authentication Business Server 30 Identity Verification Server 31 Face Matching DB 40 Member Company Server 50 Payment company server 60 points company server 70 Self-checkout 80 Store terminals 11,71,81 Processor 12,72 Leader 13,73,86 Camera 14,74,83 Communication I / F 15,75,87 Display 16,76,82 Memory 84 IC Reader 85 Code Reader MN screen CH1,CH2,CH3,CH4,CH5,CH6 mark

Claims

1. A camera that captures the user's face; A reader that acquires a registration image, which is a face image, from an identification document; and a processor that acquires a photographed image of the face of the user captured by the camera, compares the photographed image with the registered image, and completes identity verification of the user when face authentication between the face of the person in the registered image and the face of the user is successful, and registers the registered image or the photographed image as an identity verification image. Identity verification terminal.

2. The processor registers personal information, including the user's name and date of birth, which the user has registered in advance, in association with the personal identification image.

2. The personal identification terminal according to claim 1.

3. The processor creates a code that holds information linking the identity information and the identity verification image.

3. The personal identification terminal according to claim 2.

4. The code is a one-dimensional code or a two-dimensional code. The personal identification terminal according to claim 3.

5. The processor further links information of a service linked by the user to the information held by the code. The personal identification terminal according to claim 3.

6. The service information is payment information or point information.

6. The personal identification terminal according to claim 5.

7. the processor determines that face authentication between the face of the person appearing in the registration image and the face of the user has failed, and when the number of times the registration image and the captured image have been matched is equal to or greater than a threshold, displays on a display device a screen indicating that the identity of the user could not be verified and a screen prompting the user to end the procedure.

2. The personal identification terminal according to claim 1.

8. When the identity verification document is a My Number Card, the processor obtains an electronic certificate for personal information held on the My Number Card.

2. The personal identification terminal according to claim 1.

9. The processor displays on a display device a screen indicating that registration of the user's identity verification has been completed.

2. The personal identification terminal according to claim 1.

10. The identity document is a My Number card or a driver's license.

2. The personal identification terminal according to claim 1.

11. the processor acquires personal information of the user, such as the name and date of birth, from the identification document, determines whether the input information of the name and date of birth entered by the user matches the personal information, and if the input information matches the personal information, associates the input information with the identification image and registers them; 2. The personal identification terminal according to claim 1.

12. A process of taking a picture of a user's face with a camera; obtaining an enrollment image from an identity document; A process of acquiring a photographed image of the face of the user; A process of matching the registered image with the captured image; and when face authentication between a face of a person appearing in the registration image and a face of the user is successful, completing identity verification of the user and registering the registration image or the captured image as an identity verification image. program.

13. and further causing the computer to execute a process of acquiring personal information of the user, such as the name and date of birth, from the personal identification document, and a process of registering the personal information in association with the personal identification image. The program according to claim 12.

14. and further causing the computer to execute a process of generating a code for holding information linking the personal information and the personal verification image. The program according to claim 13.

15. The code is a one-dimensional code or a two-dimensional code. The program according to claim 14.

16. and further causing the computer to execute a process of further associating information of a service linked by the user with the information held by the code. The program according to claim 14.

17. The service information is payment information or point information. The program according to claim 16.

18. and further causing the computer to execute a process of determining that face authentication between the face of the person appearing in the registration image and the face of the user has failed, and if the number of times that the registration image and the captured image have been matched is equal to or greater than a threshold, displaying on a display device a screen indicating that the identity of the user could not be verified and a screen prompting the user to end the procedure. The program according to claim 12.

19. and further causing the computer to execute a process of obtaining a digital certificate for the personal information held in the identity verification document. The program according to claim 12.

20. and further causing the computer to execute a process of displaying on a display device a screen indicating that registration of the user's identity verification has been completed. The program according to claim 12.

21. Identification documents are My Number Card or driver's license. The program according to claim 12.

22. and further causing the computer to execute a process of acquiring personal information of the user, such as the name and date of birth, from the personal identification document, a process of determining whether or not the input information of the name and date of birth input by the user matches the personal information, and a process of linking the input information with the personal identification image and registering the input information when the input information matches the personal information. The program according to claim 12.

23. Take a picture of the user's face, Obtain a registration image from your identity document, Obtaining a photographed image of the user's face; Matching the registered image with the captured image; When face authentication between the face of the person appearing in the registration image and the face of the user is successful, identity verification of the user is completed, and the registration image or the captured image is registered as an identity verification image. How you verify your identity.

24. an identity verification terminal comprising: a first camera that photographs a user's face; a reader that acquires a registration image from an identity verification document; and a processor that acquires a first photographed image of the user's face photographed by the first camera, compares the registration image with the first photographed image, and completes identity verification of the user when facial authentication between the face of a person appearing in the registration image and the face of the user is successful, and registers the registration image or the first photographed image as an identity verification image; A self-checkout system including a second camera that captures an image of the user's face, a processor that acquires the image for identity verification from the identity verification terminal, compares a second captured image of the user's face captured by the second camera with the image for identity verification, and permits the purchase of a licensed product if facial authentication between the face in the second captured image and the face in the image for identity verification is successful; and Identity verification system.

Images