Face authentication point imparting system and program

Abstract

To provide a face authentication point imparting system and a program by which payment using face authentication is facilitated and a point is imparted to a payer, and further, a point is also imparted to a store visitor who does not make payment to a store whereby the store uses wide information on store visitors to improve services.SOLUTION: In a face authentication point imparting system and a program, a face authentication server 1 receives and stores registration of face picture data and user information from a user terminal 2 and imparts a point to the user, while regarding store visitors including store visitors who make payment and also store visitors who do not make payment as users, and, when the user visits the store from the second time onward, the face authentication server performs face authentication by collating user face picture data taken by a store camera 4 with the registered user face picture data, and outputs and displays the user information on a store terminal 3.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a system for awarding points to customers by performing facial recognition on customers, and more particularly to a facial recognition point awarding system and program that enables a store to instantly grasp information on past customers through facial recognition of customers and improve service to customers. [Background technology]

[0002] [Prior Art] Conventionally, when a user makes a cashless payment by photographing their face, the user's face is associated with the payment method, and then the payment can be completed simply by photographing the face and receiving the user's approval.

[0003] There are also systems that give points to a user in response to a payment made by the user. For example, when a group goes to a restaurant, even if the bill is split, the representative will often pay using electronic money, and the other members will pay the representative in cash, which means that the other members may not receive points.

[0004] [Related Technology] Related prior art includes JP 2001-351032 A, “Payment method and personal authentication method using a portable communication device, and portable communication device used for these methods” (Patent Document 1), JP 2020-166638 A, “Unmanned store system and unmanned store management method” (Patent Document 2), and Patent No. 6798539 A, “Authentication server, user terminal, payment system, payment method, and program” (Patent Document 3).

[0005] Patent Document 1 shows that when making a payment, the face of the person is displayed on the mobile phone to authenticate the person, and the payment amount is entered to process the payment.

[0006] Patent Document 2 shows that a customer's face image is photographed when entering a store, and entry is permitted through facial recognition, and facial recognition is also performed when making a payment, and also when leaving the store.

[0007] Patent Document 3 shows that face data of a store clerk is acquired by a terminal in a store, and if face authentication of the store clerk is successful, payment information associated with the store clerk is processed to prevent fraudulent payments. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] JP 2001-351032 A [Patent Document 2] JP 2020-166638 A [Patent Document 3] Patent No. 6798539 Summary of the Invention [Problem to be solved by the invention]

[0009] However, the above-mentioned conventional technology only awards points to the person who makes a payment at a store using facial recognition, and there was a problem in that it was not possible to use information about customers who do not receive points to improve service at the store.

[0010] Furthermore, Patent Documents 1 to 3 do not disclose a configuration in which points are awarded to customers who have not made payment to the store, and the store uses information on customers widely to improve services.

[0011] The present invention has been made in consideration of the above-mentioned situation, and has an object to provide a facial recognition point-granting system and program that facilitates payment by facial recognition and grants points to the person making the payment, as well as granting points to customers who have not made a payment to the store, thereby enabling the store to use a wide range of information about customers to improve service. [Means for solving the problem]

[0012] The present invention, which aims to solve the problems of the above-mentioned conventional examples, is a face recognition point awarding system having a face recognition server that performs face recognition and awards points to users, in which the face recognition server accepts and stores the registration of face photo data and user information from a user terminal not only of customers who have made a payment, but also of customers who have not made a payment, and awards points to the users.When the user visits the store for the second time or thereafter, the face recognition is performed by comparing the user's face photo data taken by a store camera with the registered user's face photo data, and the relevant user information is displayed and output on the store terminal.

[0013] The present invention is characterized in that, in the above-mentioned facial recognition point awarding system, the facial recognition server stores history information of a user's visit to a store, and when the user visits a store, displays and outputs the user information and the history information of the visit to a store terminal, and awards points to the user.

[0014] The present invention is characterized in that in the face recognition point giving system, the face recognition server stores the user's payment method input from the store terminal in association with the user information.

[0015] The present invention is characterized in that, in the above-mentioned facial recognition point awarding system, when the payment method used by the user for the second or subsequent payment is different from the payment method stored in association with the user information, the facial recognition server displays on the store terminal a message indicating that the payment method is different.

[0016] The present invention is characterized in that in the above-mentioned facial recognition point awarding system, the facial recognition server converts the point rate so that the points awarded to the user can be used in places other than the store visited.

[0017] The present invention is a processing program that operates on a face authentication server that performs face authentication and awards points to users, and is characterized in that the face authentication server is configured to accept and store the registration of face photo data and user information from a user terminal not only of customers who have made a payment, but also of customers who have not made a payment, award points to the user, and when the user visits the store for the second time or thereafter, perform face authentication by comparing the user's face photo data taken by a store camera with the registered user's face photo data, and display and output the relevant user information on the store terminal.

[0018] The present invention is characterized in that, in the above program, the face recognition server is caused to function to store history information of a user's visit to a store, and when the user visits a store, to display and output the user information and the history information of the visit to a store terminal, and to award points to the user.

[0019] The present invention is characterized in that the program causes the face authentication server to function to store the user's payment method input from the store terminal in association with the user information.

[0020] The present invention is characterized in that, in the above program, the facial recognition server is caused to function to display on the store terminal a message indicating that the payment method used in the user's second or subsequent payments differs from the payment method stored in association with the user information.

[0021] The present invention is characterized in that the above program causes the face recognition server to function to convert the point rate so that the points granted to the user can be used in stores other than the one visited. Effect of the Invention

[0022] According to the present invention, the facial recognition server accepts and stores the registration of facial photo data and user information from the user terminal not only of customers who have made a payment, but also of customers who have not made a payment, and awards points to the users.When the user visits the store for the second time or thereafter, the facial photo data of the user taken by the store camera is compared with the registered user facial photo data to perform facial recognition, and the relevant user information is displayed and output on the store terminal, resulting in a facial recognition point awarding system and program that can be used for customer service as well as marketing. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is a schematic diagram of the present system. [Diagram 2] FIG. 11 is a flow diagram of a user registration process. [Diagram 3] FIG. 11 is a flow diagram showing a process for a user's second or subsequent visits to a store. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described with reference to the drawings. [Outline of the embodiment] In a facial recognition point-granting system (this system) according to an embodiment of the present invention, a user (store visitor) reads a two-dimensional barcode provided by the system operator with a user terminal such as their smartphone, and when they move to an initial registration site, the user takes multiple photos of their face with the camera on their user terminal and enters a few of their favorite photos, which awards the user points. When the user uses the system for the second time or later, a photo of the user is taken with a camera installed in the store and facial recognition is performed. If the user is registered on the site, data on past usage history (past store visit dates and times, usage details, etc.) is displayed on the store's terminal (store terminal), which can be used for customer service as well as marketing.

[0025] Furthermore, the user terminal is linked to information on electronic money, credit card, etc. used for payment, and when electronic money, etc. is used at the time of payment, the relationship between the user's facial photo data and the payment method is determined. For payments from the second time onwards, the payment method to be used for payment is identified by authenticating the user's facial data taken by the store's camera with the facial photo data registered on the site, making it possible to make payment easily and safely.

[0026] [This system: Figure 1] The configuration of this system will be described with reference to Fig. 1. Fig. 1 is a schematic diagram of the system. As shown in FIG. 1, the system includes a face authentication server 1, a user terminal 2 such as a user's smartphone, a store terminal 3, a store camera 4, and a network 5. The face authentication server 1, the user terminal 2, the store terminal 3, and the store camera 4 are connected to a network 5. In reality, there are many user terminals 2, store terminals 3, and store cameras 4, but for simplicity, only one of each is shown in FIG.

[0027] [Face recognition server 1] The face recognition server 1 includes a control unit 11, a memory unit 12, and an interface unit 13, and realizes the following characteristic processing when a processing program stored in the memory unit 12 is executed by the control unit 11. The storage unit 12 also stores data necessary for processing, such as user information including facial photograph data, user name, user ID (email address), password, payment method, and usage history information. The interface unit 13 is an interface that connects the face authentication server 1 to the network 5 .

[0028] The face authentication server 1 is a server managed by the operator of this system, which allows users to register face photo data and associates it with a payment method, facilitating payment the next time the user uses the system. Specifically, a paper with a two-dimensional barcode printed on it is distributed to stores, and the user terminal 2 reads the two-dimensional barcode and is directed to the face authentication server 1 website.

[0029] For initial registration, users are encouraged to take multiple photos of their face and register their favorite photos. As an incentive for registration, points are awarded that can be exchanged for money (points in the form of coupons with a limited time period can also be used), and users are asked to register their name, date of birth, email address, etc.

[0030] The payment method may be preset by the user, but when an actual payment occurs, the user's face photo data is linked to the payment method (credit card, debit card, code payment electronic money, transportation electronic money, distribution electronic money, credit card electronic money, bank online payment, carrier payment, etc.) In addition to the payment method, the user's ID number, etc. are also linked and stored. In addition, even if a user does not actually make a payment, they can register as a face recognition user and will still be awarded points.

[0031] When a user visits another store, such as a chain store, that has introduced this system, the user accesses the website of the face authentication server 1 using the two-dimensional barcode printed on paper at the store, checks the box for "already registered," photographs his / her face, and transmits the facial photo data to the face authentication server 1 for face authentication processing, allowing the user to receive services of this system at the store. Of course, the system may be made available at all stores with only the initial registration.

[0032] When the user visits the store for the second or subsequent time, the face authentication server 1 inputs the user's facial photo data taken by the store camera 4, compares it with the user's registered facial photo data, and displays information about the authenticated user and information about past usage history on the store terminal 3. When making a payment from the second time onwards, the system prompts the user to launch the app for the electronic money or other device used for the previous payment, making the payment easy.

[0033] [User device 2] The user terminal 2 is an information processing device equipped with a camera, such as a smartphone, a tablet, or a notebook PC, that is used by a user. When the user terminal 2 reads the 2D barcode placed in the store, it accesses the face authentication server 1 and moves to the initial registration process. During the initial registration, a dedicated application for accessing the face authentication server 1 is downloaded to the user terminal 2, and the user sets a user ID such as an email address, a password, a payment method, and the like using the dedicated application.

[0034] In this system, initial registration is performed on the user terminal 2, but for customers who do not have a smartphone or the like, the store terminal 3 may be used to take a photo of the customer with the store camera 4 and register their facial photo data for the first time.

[0035] In addition, when the user terminal 2 uses electronic money on the smartphone to make a payment, an association (link) is established between the electronic money and the facial photo data, and the user is prompted to use the previous electronic money the next time he or she makes a payment.

[0036] [Store terminal 3] The store terminal 3 displays information about the user who has been photographed by the store camera 4 and has been authenticated by the face authentication server 1, as well as information about the past usage history (date and time of usage, amount used, payment method, order details, etc.). This display allows store staff to provide detailed service to customers, and allows them to prepare for payment by referring to the payment methods used in the past.

[0037] The store terminal 3 also performs accounting and bills the user for the usage fee. Furthermore, the store terminal 3 can obtain information on the user's store usage record from the face authentication server 1 and use the information for marketing purposes to deliver effective direct mail.

[0038] [Store Camera 4] The store camera 4 is a camera installed inside the store, particularly at the entrance, and takes pictures of users who visit the store, acquires facial photo data, and transmits the acquired facial photo data to the face authentication server 1.

[0039] In this system, the user can register face photograph data taken with his / her own user terminal 2, so that the registration work can be easily completed during the spare time while the ordered food is being served at the restaurant, and the user can provide face photograph data without any hesitation.

[0040] In this system, any user who visits the store can register their facial photo data, regardless of whether they have made a payment or not, and from their second visit onwards, the user can be identified by facial recognition using the store camera 4 and the user's information and history information can be displayed on the store terminal 3, making it possible to provide registered users with detailed services.

[0041] Furthermore, in this system, when a specific payment method, for example a credit card, is used, the user at the time of use is identified by facial photograph data, thereby preventing impersonation. In addition, when the same credit card is used (payment) by a different user, the face recognition server 1 may display that the user who visits the store terminal 3 is different from the previous user who used the credit card, or may notify the financial institution of the payment (e.g., the credit card company).

[0042] Furthermore, when the user makes a payment for the second or subsequent times, if the payment method differs from the payment method stored in association with the user information, the face recognition server 1 may display on the store terminal 3 a message indicating that the payment method is different from the previous payment method, and prompt the store staff to confirm the payment method. Specifically, not only when the payment method is different from the previous payment method, but also when the payment method is the same credit card but the user ID number (credit card number) is different, the store terminal 3 displays and outputs the information.

[0043] [User registration process in this system: Figure 2] The user registration process in this system will be described with reference to Fig. 2. Fig. 2 is a flow diagram of the user registration process. When the user terminal 2 reads the two-dimensional barcode of a store, the face authentication server 1 guides the user to a registration site (S1).

[0044] Then, the face authentication server 1 inputs and registers a plurality of face photograph data of the user taken by the user terminal 2 (S2). Furthermore, as a condition for giving points to the user, the face authentication server 1 registers user information such as the user name, email address (user ID), password, and payment method from the user terminal 2 (S3). When the face authentication server 1 completes the registration of the user information, it gives points to the user ID (S4) and ends the process.

[0045] [Processing a user's second or subsequent visits in this system: Figure 3] The process of a user's second or subsequent visits in this system will be described with reference to Fig. 3. Fig. 3 is a flow diagram showing the process of a user's second or subsequent visits. The face authentication server 1 inputs face photo data of a customer captured by the store camera 4 (S11) and verifies whether the customer is a registered user (S12).

[0046] Then, it is determined by face authentication whether the customer is a registered user (S13), and if the customer is not a registered user (No), the process ends. If the user is registered (Yes), the face recognition server 1 acquires the accumulated user information and displays it on the store terminal 3 (S14), then acquires the user's history information and displays it on the store terminal 3 (S15), awards points to the user (S16), and ends the processing.

[0047] [Application example] [Check user points] By accessing the face authentication server 1 with the user terminal 2 and inputting the user ID and password, the points acquired by the user can be displayed, the points can be confirmed, and the points can be used.

[0048] [Check points at chain stores] By accessing the face authentication server 1 with the user terminal 2 and entering the user ID and password, the points earned at each store in the chain can be displayed in a list and checked. In addition, points acquired at a specific store in a chain can be transferred so that they can be used at other stores. However, when points are transferred from the transfer source to the transfer destination, a rate conversion may be performed in which the points are discounted based on a conversion rate. The rate conversion may be not only a discount but also an increase.

[0049] [Check points at stores where you used this system] By accessing the face recognition server 1 with the user terminal 2 and inputting the user ID and password, the points earned at different stores that are not part of a chain can be displayed and checked in a list. If points are transferred between different stores, they can be transferred. The conversion rate can be set arbitrarily by each store.

[0050] [Check points at domestic and international chain stores] By accessing the face recognition server 1 with the user terminal 2 and inputting a user ID and password, the points earned at chain stores operating worldwide can be displayed in a list for each store. It will be possible to transfer points to chain stores both in Japan and overseas. Because of the influence of foreign exchange rates both domestically and internationally, the conversion rate will reflect the foreign exchange rate.

[0051] [Services used] This system can be used in a variety of stores, including restaurants, convenience stores, supermarkets, florists, bookstores, record stores, dry cleaners, beauty salons, electronics retailers, department stores, liquor stores, pet shops, sports facilities, studios, delivery companies, food delivery services, and transportation services (trains, buses, taxis, airplanes, etc.).

[0052] Some of the above services may be set up so that payment is automatically made by facial recognition at the time of use using a pre-registered payment method. For example, passenger convenience can be greatly improved by using facial recognition automatic payment on trains, buses, and other transportation services.

[0053] In addition, the dedicated facial recognition app works in conjunction with a payment app that corresponds to a pre-registered payment method, so that when the payment process begins, the app switches to the payment app linked to the payment method, making it easy to complete the payment.

[0054] In other words, the facial recognition app manages various payment methods, facilitates switching to different payment methods, monitors for fraud, and allows earned points to be transferred and used at various stores and services.

[0055] [Effects of the embodiment] According to this system, not only users who make payments but also users who do not make payments can be awarded points by registering face photo data, and when a registered user visits a store, user information is obtained through facial recognition and displayed on the store terminal 3 so that store staff can serve the user, thereby improving service.

[0056] Furthermore, according to this system, a user takes a photo of their own face using the user terminal 2, and the facial photo data they like is registered in the facial recognition server 1 and linked to the payment method. Therefore, since the user's face is recognized in advance at the store or financial institution that handles the payment, impersonation can be eliminated, improving the safety of use, and making it easier for the user and the store to make payments. [Industrial Applicability]

[0057] The present invention is suitable for a facial recognition point-granting system and program that facilitates payment by facial recognition and grants points to the person making the payment, and also grants points to customers who have not made a payment to the store, allowing the store to use a wide range of information about customers to improve service. [Explanation of symbols]

[0058] REFERENCE SIGNS LIST 1: face recognition server; 2: user terminal; 3: store terminal; 4: store camera; 5: network; 11: control unit; 12: memory unit; 13: interface unit

Claims

1. A face recognition point-granting system having a face recognition server that performs face recognition and grants points to a user, The facial recognition server accepts and stores the registration of facial photo data and user information from the user terminal of not only customers who have made a payment, but also customers who have not made a payment, and awards points to the user.When the user visits the store for the second time or later, the facial photo data of the user taken by a store camera is compared with the registered user's facial photo data to perform facial authentication, and the corresponding user information is displayed and output on the store terminal.This is a facial recognition point awarding system.

2. The facial recognition point-granting system according to claim 1, characterized in that the facial recognition server stores history information of a user's visit to a store, and when the user visits a store, displays and outputs the user information and the history information of the visit to a store terminal, and grants points to the user.

3. 3. The face recognition point giving system according to claim 1, wherein the face recognition server stores the user's payment method input from the store terminal in association with the user information.

4. The facial recognition point-granting system according to claim 3, characterized in that, when the payment method used in the second or subsequent payment by the user differs from the payment method stored in association with the user information, the facial recognition server displays on the store terminal a message indicating that the payment method is different.

5. 3. The face recognition point-granting system according to claim 1, wherein the face recognition server converts the rate of points so that the points granted to the user can be used at a store other than the store visited.

6. A processing program that operates on a face recognition server that performs face recognition and grants points to a user, The program causes the face recognition server to accept and store the registration of facial photo data and user information from a user terminal not only of customers who have made a payment but also of customers who have not made a payment, to award points to the user, and when the user visits the store for the second time or thereafter, to perform facial recognition by comparing the user's facial photo data taken by a store camera with the registered user's facial photo data, and to display and output the corresponding user information on the store terminal.

7. The program according to claim 6, characterized in that the facial recognition server is configured to store a user's store visit history information, and when the user visits a store, to display and output the user information and the store visit history information on a store terminal, and to award points to the user.

8. 8. The program according to claim 6, further comprising causing the face authentication server to function to store a payment method of the user input from the store terminal in association with the user information.

9. The program according to claim 8, characterized in that it causes the facial recognition server to function in such a way that, when the payment method used in a user's second or subsequent payment is different from the payment method stored in association with the user information, the store terminal is caused to display a message indicating that the payment method is different.

10. The program according to claim 6 or 7, characterized in that it causes the face recognition server to function to convert the rate of points so that the points granted to the user can be used at stores other than the one visited.

Images