Facial recognition point awarding system and program

Abstract

To provide a face authentication point imparting system and a program by which payment using face authentication is facilitated and a point is imparted to a payer, and further, a point is also imparted to a store visitor who does not make payment to a store whereby the store uses wide information on store visitors to improve services.SOLUTION: In a face authentication point imparting system and a program, a face authentication server 1 receives and stores registration of face picture data and user information from a user terminal 2 and imparts a point to the user, while regarding store visitors including store visitors who make payment and also store visitors who do not make payment as users, and, when the user visits the store from the second time onward, the face authentication server performs face authentication by collating user face picture data taken by a store camera 4 with the registered user face picture data, and outputs and displays the user information on a store terminal 3.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a system that performs face authentication of visitors and grants points, and particularly to a face authentication point granting system and program that can instantaneously grasp information of past customers on the store side through face authentication of visitors and improve services to customers.

Background Art

[0002] [Conventional Technology] Conventionally, when photographing a user's face and the user makes a payment without cash, it has been considered to associate the user's face with the payment method, and then complete the payment only with face photography and the user's approval.

[0003] Also, there has been something that grants points to the user for the user's payment. For example, in a group using a restaurant, even if it is a shared bill, the representative often pays with electronic money, and other members pay the representative the share of cash, and other members may not be granted points.

[0004] [Related Technology] In addition, as related prior arts, Japanese Patent Application Laid-Open No. 2001-351032 "Settlement Method and Personal Authentication Method Using a Portable Communication Device and the Portable Communication Device Used for These Methods" (Patent Document 1), Japanese Patent Application Laid-Open No. 2020-166638 "Unmanned Store System and Unmanned Store Management Method" (Patent Document 2), and Japanese Patent No. 6798539 "Authentication Server, User Terminal, Settlement System, Settlement Method, and Program" (Patent Document 3) exist.

[0005] Patent Document 1 shows that at the time of payment, the face of the person is displayed on the mobile device for personal authentication, and the payment amount is input to perform the payment process.

[0006] Patent Document 2 shows that at the time of entering the store, the face image of the visitor is photographed, entry is permitted by face authentication, face authentication is also performed at the time of settlement, and face authentication is also performed at the time of leaving the store.

[0007] Patent Document 3 describes a system in which facial data of store employees is acquired at a store terminal, and if facial recognition of the employee is successful, payment information associated with the employee is processed to prevent fraudulent payments. [Prior art documents] [Patent Documents]

[0008] [Patent Document 1] Japanese Patent Publication No. 2001-351032 [Patent Document 2] Japanese Patent Publication No. 2020-166638 [Patent Document 3] Patent No. 6798539 [Overview of the Initiative] [Problems that the invention aims to solve]

[0009] However, the conventional technology described above only awards points to the person who made the payment at the store using facial recognition, and it had the problem that it could not be used to improve store services by utilizing the information of customers who did not receive points.

[0010] Furthermore, Patent Documents 1 to 3 do not describe a configuration in which points are awarded to customers who have not made a payment at the store, allowing the store to broadly utilize customer information to improve its services.

[0011] This invention has been made in view of the above circumstances, and aims to provide a facial recognition point awarding system and program that facilitates payments using facial recognition and awards points to payers, as well as awards points to customers who have not made a payment at the store, thereby enabling stores to widely utilize customer information to improve their services. [Means for solving the problem]

[0012] To solve the problems of the above-mentioned conventional example, the present invention is a facial recognition point awarding system having a facial recognition server that performs facial recognition and awards points to users. The facial recognition server accepts and stores the registration of facial image data and user information from user terminals, not only for customers who have made a payment but also for customers who have not made a payment, and awards points to such users. For subsequent visits by a user, the system performs facial recognition by comparing the user's facial image data captured by the store camera with the registered user's facial image data, and displays the corresponding user information on the store terminal. The system stores the user's payment method entered from the store terminal in association with the user's information, and if the payment method differs from the one stored in association with the user's information for the user's second or subsequent payments, the store terminal displays a message indicating that the payment method is different. It is characterized by doing so. Furthermore, the facial recognition point awarding system has a facial recognition server that performs facial recognition and awards points to users, wherein the facial recognition server accepts and stores the registration of facial image data and user information from the user terminal as users, not only for customers who have made a payment but also for customers who have not made a payment, awards points to the user, and for the user's second and subsequent visits, performs facial recognition by comparing the user's facial image data taken by the store camera with the registered user's facial image data, displays the corresponding user information on the store terminal, and performs a point rate conversion so that the points awarded to the user can be used at stores other than the store that was visited.

[0013] The present invention is characterized in that, in the above-mentioned facial recognition point awarding system, the facial recognition server stores the user's visit history information, displays and outputs user information and visit history information to the store terminal when the user visits the store, and awards points to the user.

[0017] The present invention relates to a processing program that operates on a facial recognition server that performs facial recognition and awards points to users. The facial recognition server accepts and stores facial image data and user information from user terminals, not only for customers who have made payments but also for customers who have not, and awards points to such users. For subsequent visits by a user, it performs facial recognition by comparing the user's facial image data captured by the store's camera with the registered user's facial image data, and displays the corresponding user information on the store terminal. The system stores the user's payment method entered from the store terminal in association with the user's information, and if the payment method differs from the one stored in association with the user's information for the user's second or subsequent payments, the store terminal displays a message indicating that the payment method is different. It is characterized by being designed to function in such a way. Furthermore, the present invention relates to a processing program that operates on a facial recognition server that performs facial recognition and awards points to users, characterized in that the facial recognition server accepts and stores registration of facial image data and user information from user terminals for customers who have made payments as well as customers who have not made payments, awards points to such users, performs facial recognition by comparing the user's facial image data taken by the store camera with the registered user's facial image data for subsequent visits by the user, displays the corresponding user information on the store terminal, and performs a point rate conversion so that the points awarded to the user can be used at stores other than the store where the user visited.

[0018] The present invention is characterized in that, in the above program, the facial recognition server stores the user's visit history information, displays user information and visit history information on a store terminal when the user visits the store, and awards points to the user. [Effects of the Invention]

[0022] According to the present invention, a face recognition server accepts and stores the registration of face photo data and user information from a user terminal not only for customers who have made a payment but also for customers who have not made a payment as users, assigns points to the user, and for the user's second and subsequent visits to the store, the face photo data of the user captured by the store camera is compared with the registered face photo data of the user for face recognition, and the corresponding user information is displayed and output to the store terminal. The system stores the user's payment method entered from the store terminal in association with the user's information, and if the payment method differs from the one stored in association with the user's information for the user's second or subsequent payments, the store terminal displays a message indicating that the payment method is different. Since it is a face recognition point awarding system and program, it can be used for customer service and also has the effect of being usable for marketing.

Brief Description of the Drawings

[0023] [Figure 1] It is a schematic configuration diagram of this system. [Figure 2] It is a flowchart of user registration processing. [Figure 3] It is a flowchart showing the processing for the user's second and subsequent visits to the store.

Modes for Carrying Out the Invention

[0024] Embodiments of the present invention will be described while referring to the drawings. [Outline of the Embodiment] The face recognition point awarding system (this system) according to the embodiment of the present invention is such that when a user (customer) reads a two-dimensional barcode provided by a system operator using a user terminal such as their smartphone and moves to the initial registration site, the user takes multiple photos of their face with the camera of their user terminal, selects several favorite ones to enter, and points are awarded to the user. For subsequent use, the user is photographed by a camera installed in the store for face recognition. If the user is a registered user on the site, data on past usage history (past visit dates and times, usage details, etc.) will be displayed on the terminal on the store side (store terminal), which can be used for customer service and also for marketing.

[0025] Furthermore, information such as electronic money and credit card details used for payment are linked from the user's terminal. When electronic money is used during payment, the relationship between the user's facial image data and the payment method is established. For subsequent payments, the payment method used is identified by authenticating the user's facial image data captured by the store's camera against the facial image data registered on the site, making payments easy and secure.

[0026] [This system: Figure 1] The configuration of this system will be explained with reference to Figure 1. Figure 1 is a schematic diagram of the system's configuration. As shown in Figure 1, this system includes a facial recognition server 1, a user terminal 2 such as a user's smartphone, a store terminal 3, a store camera 4, and a network 5. The facial recognition server 1, user terminal 2, store terminal 3, and store camera 4 are all connected to network 5. While there are actually multiple user terminals 2, store terminal 3, and store camera 4, Figure 1 depicts only one of each for simplicity.

[0027] [Facial Recognition Server 1] The facial recognition server 1 comprises a control unit 11, a storage unit 12, and an interface unit 13. The processing program stored in the storage unit 12 is executed by the control unit 11, thereby realizing the following characteristic processing. Furthermore, the memory unit 12 stores data necessary for processing, including user information such as facial photo data, username, user ID (email address), password, payment method, and usage history. Interface unit 13 is an interface that connects the facial recognition server 1 to the network 5.

[0028] Facial recognition server 1 is a server managed by the operator of this system. It allows users to register their facial image data, links it to their payment method, and facilitates payments for subsequent uses. Specifically, a piece of paper with a 2D barcode printed on it is distributed to the store, and the user terminal 2 scans this 2D barcode to be redirected to the website of the facial recognition server 1.

[0029] For first-time registrations, the process involves having users take multiple photos of themselves and register their favorites. The incentive for registration is the awarding of points, which can be exchanged for money (points can also be obtained through time-limited coupons). Users are also required to register their name, date of birth, email address, etc.

[0030] While users may pre-set their payment methods, when an actual payment occurs, the system will link the user's facial image data with their chosen payment method (credit card, debit card, QR code payment system, transportation e-money, retail e-money, credit card-based e-money payment, online banking, carrier billing, etc.). In addition to the payment method, the system will also link and store the user's ID number and other relevant information. Furthermore, even users who do not actually make payments can register using facial recognition, and points will be awarded in this case as well.

[0031] When a user visits another store, such as a chain store that has implemented this system, they can access the facial recognition server 1 website via a 2D barcode printed on a piece of paper at the store, check the "already registered" box, have their face photographed, and send the facial image data to the facial recognition server 1. Once facial recognition processing is complete, they will be able to use the system's services at that store as well. Of course, the system could be made available at all stores after only the initial registration.

[0032] When a user visits the store for the second time or later, the facial recognition server 1 inputs the user's facial image data captured by the store camera 4, compares it with the user's registered facial image data, and displays the authenticated user's information and past usage history on the store terminal 3. For subsequent payments, users will be prompted to launch the app used for the previous payment (such as an e-money app) to facilitate payment.

[0033] [User Terminal 2] User terminal 2 is an information processing device equipped with a camera, such as a smartphone, tablet, or notebook PC, used by the user. When user terminal 2 scans the 2D barcode placed in the store, it accesses the facial recognition server 1 and proceeds to the initial registration process. During initial registration, a dedicated app for accessing the facial recognition server 1 is downloaded to user terminal 2, and this app is used to set up user IDs such as email addresses, passwords, payment methods, etc.

[0034] In this system, initial registration is performed on user terminal 2. However, for customers who do not possess a smartphone or similar device, the store terminal 3 may be used to take a picture of the customer with the store camera 4 and register the facial image data for the initial registration.

[0035] Furthermore, when user terminal 2 makes a payment, if it uses electronic money on its smartphone, a link is established between the electronic money and the facial image data, and the user will be prompted to use the same electronic money for the next payment.

[0036] [Store Terminal 3] The store terminal 3 displays information about users captured by the store camera 4, authenticated by the facial recognition server 1, and information about past usage history (date and time of use, amount spent, payment method, order details, etc.). This display allows store staff to provide detailed service to customers and to prepare for payment by referring to previously used payment methods.

[0037] Furthermore, store terminal 3 performs accounting processing and bills the user for the amount used. Furthermore, the store terminal 3 can obtain information on the user's store usage history from the facial recognition server 1, use it for marketing purposes, and deliver effective direct mail.

[0038] [Store Camera 4] Store camera 4 is a camera installed inside the store, particularly at the entrance, that photographs customers who enter the store, acquires facial image data, and transmits the acquired facial image data to facial recognition server 1.

[0039] This system allows users to register facial photo data taken with their own user terminal 2. This makes the registration process easy to complete during the time between ordering food at a restaurant and receiving it, and users willingly provide their facial photo data.

[0040] This system allows any user who visits the store, regardless of whether they make a payment, to register their facial image data. For subsequent visits, the store camera 4 can identify the user through facial recognition, and the user's information and history can be displayed on the store terminal 3, enabling the provision of detailed services to registered users.

[0041] Furthermore, this system prevents identity theft because, when a specific payment method is used, for example, a credit card, the user at the time of the transaction is identified by their facial image data. Furthermore, if the same credit card is used (paid for) by a different user, the facial recognition server 1 may display on the store terminal 3 that the user who has come to the store is different from the previous user who used the credit card, or it may notify the financial institution handling the payment (for example, the credit card company).

[0042] Furthermore, the facial recognition server 1 may, in the case of a second or subsequent payment by a user, display a message on the store terminal 3 indicating that the payment method is different from the previous payment method if it differs from the payment method stored in association with the user information, thereby prompting the store staff to confirm the payment method. Specifically, the store terminal 3 will display and output information not only when the payment method is different from the previous payment method, but also when the payment method is the same credit card, but the user's ID number (credit card number), etc., is different.

[0043] [User registration process in this system: Figure 2] The user registration process in this system will be explained with reference to Figure 2. Figure 2 is a flowchart of the user registration process. When user terminal 2 reads the store's 2D barcode, facial recognition server 1 directs the user to the registration site (S1).

[0044] Then, the facial recognition server 1 receives and registers multiple facial image data of the user taken from the user terminal 2 (S2). Furthermore, in order to award points to the user, the facial recognition server 1 registers user information such as username, email address (user ID), password, and payment method from the user terminal 2 (S3). Once the registration of user information is complete, the facial recognition server 1 awards points to the above user ID (S4) and terminates the process.

[0045] [Processing of a user's second and subsequent visits in this system: Figure 3] The process for handling a user's second and subsequent visits to the store in this system will be explained with reference to Figure 3. Figure 3 is a flowchart illustrating the process for handling a user's second and subsequent visits. The facial recognition server 1 receives facial image data of customers captured by the store camera 4 (S11) and verifies whether the person is a registered user (S12).

[0046] Then, facial recognition is used to determine whether the customer is a registered user (S13), and if they are not a registered user (No), the process is terminated. If the user is registered (Yes), the facial recognition server 1 retrieves the stored user information and displays it on the store terminal 3 (S14), then retrieves the user's history information and displays it on the store terminal 3 (S15), awards points to the user (S16), and then terminates the process.

[0047] [Application Examples] [Check user points] On user terminal 2, the user accesses facial recognition server 1, enters their user ID and password to display the points they have earned, confirms those points, and makes them available for use.

[0048] [Checking points at chain stores] On user terminal 2, the user can access facial recognition server 1 and, by entering their user ID and password, view and check a list of points earned at each chain store. Furthermore, points earned at a specific store within a chain can be transferred to other stores for use. However, when transferring points from the source to the destination, a rate conversion may be implemented where the points are discounted based on a conversion rate. The rate conversion may also involve a bonus rather than a discount.

[0049] [Checking points earned at stores using this system] On user terminal 2, users can access facial recognition server 1 and, by entering their user ID and password, view and check a list of points earned at different stores, not just chain stores. If point transfers between different stores are permitted, point transfers will be possible. Each store can set its own conversion rate.

[0050] [Checking points at domestic and international chain stores] On user terminal 2, users can access facial recognition server 1 and, by entering their user ID and password, view and check a list of points earned at chain stores operating worldwide, organized by store. Points can be transferred between domestic and international chain stores. Because exchange rates affect transactions both domestically and internationally, the conversion rate will reflect the current exchange rate.

[0051] [Services used] This system can be used in a variety of stores, including restaurants, convenience stores, supermarkets, flower shops, bookstores, record stores, dry cleaners, beauty salons, electronics retailers, department stores, liquor stores, pet shops, sports facilities, studios, delivery companies, food delivery services, and transportation services (trains, buses, taxis, airplanes, etc.).

[0052] Some of the above services may implement automatic payment via facial recognition at the time of use, based on a pre-registered payment method. For example, using facial recognition for automatic payment on public transport services such as trains and buses can significantly improve passenger convenience.

[0053] Furthermore, the dedicated facial recognition app can be linked to a payment app corresponding to a pre-registered payment method. When a payment process is initiated, it switches to the payment app associated with that payment method, allowing for easy payment execution.

[0054] In short, the dedicated facial recognition app manages various payment methods, facilitates the transition between different payment methods, monitors for fraud, and allows users to transfer and use points earned at various stores and services.

[0055] [Effects of the embodiment] According to this system, not only users who make payments, but also users who do not make payments, can register their facial image data and be awarded points. When a registered user visits the store, their information is obtained through facial recognition and displayed on the store terminal 3, allowing store staff to provide better service.

[0056] Furthermore, according to this system, users take a photo of their face using the user terminal 2, register their preferred facial image data with the facial recognition server 1, and link it to their payment method. As a result, stores or financial institutions that handle payments can eliminate impersonation and improve the security of transactions because users' faces have been pre-recognized, and both users and stores can make payments easier. [Industrial applicability]

[0057] The present invention is suitable for a facial recognition point awarding system and program that facilitates payments using facial recognition and awards points to payers, as well as to customers who have not made a payment at the store, thereby enabling the store to widely utilize customer information to improve its services. [Explanation of Symbols]

[0058] 1…Facial recognition server, 2…User terminal, 3…Store terminal, 4…Store camera, 5…Network, 11…Control unit, 12…Storage unit, 13…Interface unit

Claims

1. A facial recognition point awarding system having a facial recognition server that performs facial recognition and awards points to users, The aforementioned facial recognition server accepts and stores facial image data and user information from user terminals, not only for customers who have made a payment but also for customers who have not, and awards points to such users. For subsequent visits by such users, the server performs facial recognition by comparing the user's facial image data captured by the store's camera with the registered user's facial image data, and displays the corresponding user information on the store terminal. A facial recognition point awarding system characterized by storing the payment method of a user entered from the store terminal in association with the user information, and displaying a message on the store terminal indicating that the payment method is different when the payment method differs from the payment method stored in association with the user information for the user's second or subsequent payments.

2. A facial recognition point awarding system having a facial recognition server that performs facial recognition and awards points to users, The aforementioned facial recognition server accepts and stores facial image data and user information from user terminals, not only for customers who have made a payment but also for customers who have not, and awards points to such users. For subsequent visits by such users, the server performs facial recognition by comparing the user's facial image data captured by the store's camera with the registered user's facial image data, and displays the corresponding user information on the store terminal. A facial recognition point awarding system characterized by performing a point rate conversion in order to allow the points awarded to the aforementioned user to be used at stores other than the store where they visited.

3. The facial recognition point awarding system according to claim 1 or 2 is characterized in that the facial recognition server stores the user's visit history information, displays the user information and visit history information on a store terminal when the user visits the store, and awards points to the user.

4. A processing program that runs on a facial recognition server that performs facial recognition and awards points to users, The aforementioned facial recognition server accepts and stores facial image data and user information from user terminals for both customers who have made payments and those who have not, awards points to such users, and for subsequent visits by the same user, it performs facial recognition by comparing the user's facial image data captured by the store's camera with the registered user's facial image data, and displays the corresponding user information on the store's terminal. A program characterized by storing a user's payment method entered from the store terminal in association with the user information, and, if the payment method for the user's second or subsequent payments differs from the payment method stored in association with the user information, causing the store terminal to display an output indicating that the payment method is different.

5. A processing program that runs on a facial recognition server that performs facial recognition and awards points to users, The aforementioned facial recognition server accepts and stores facial image data and user information from user terminals for both customers who have made payments and those who have not, awards points to such users, and for subsequent visits by the same user, it performs facial recognition by comparing the user's facial image data captured by the store's camera with the registered user's facial image data, and displays the corresponding user information on the store's terminal. A program characterized by its function to perform a point rate conversion so that the points awarded to the aforementioned user can be used at stores other than the store where they visited.

6. The program according to claim 4 or 5, characterized in that the facial recognition server stores the user's visit history information, displays the user information and visit history information on a store terminal when the user visits the store, and awards points to the user.

Images