Information processing device, information processing method, and program

Abstract

This information processing device (1) includes: a managing unit (11) that associates biometric information about users with member information and manages the information for each store; an acquiring unit (12) that acquires the biometric information about a user from a terminal installed at each store; an identifying unit (13) that identifies the member information on the basis of the acquired biometric information about the user; and a processing unit (14) that uses the identified member information and causes the terminal to execute a settlement process. The processing unit (14) is able to cause the terminal to output information desired to be reported to the user for the settlement to which the member information is applied.

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium on which a program is stored. [Background technology]

[0002] There are systems in place that allow customers to use membership cards or coupons to receive points, discounts, and other benefits when purchasing products at stores. To use these systems, customers must present a different membership card or coupon to each store clerk or have it scanned by a POS (Point of Sales) terminal. This can be inconvenient for customers, as they end up carrying membership cards from multiple stores.

[0003] Patent Document 1 discloses an information processing system that can identify a customer's membership code at the time of payment, even if the customer does not have a medium showing the membership code. This information processing system includes an authentication device and a server. The authentication device acquires a facial photograph of the customer and reads a barcode attached to a shopping basket that the customer can carry when shopping, and then associates the facial photograph with the barcode and transmits them to the server.

[0004] The server stores pre-registered member codes and facial photographs in association with each other. When the server acquires the facial photograph from the authentication device, it identifies the customer's membership code from the facial photograph and associates the membership code with the barcode. At the time of payment, the server transmits the customer's membership code associated with the barcode of the shopping cart read by the POS terminal to the POS terminal. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-135591 Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, it is necessary to associate the customer's membership code with the barcode on the shopping cart, which is inconvenient.

[0007] In view of the above-mentioned problems, an object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a program that improve convenience for users when purchasing products in a store. [Means for solving the problem]

[0008] An information processing device according to one aspect of the present disclosure includes: a management means for associating user biometric information with membership information and managing the information for each store; an acquisition means for acquiring biometric information of a user from a terminal installed in each store; An identification means for identifying member information based on the acquired biometric information of the user; a processing means for causing the terminal to execute a payment process using the identified member information; Includes.

[0009] An information processing system according to one aspect of the present disclosure includes: Terminals installed at each store, an information processing device, The information processing device includes: a management means for associating user biometric information with membership information and managing the information for each store; an acquisition means for acquiring biometric information of a user from the terminal; An identification means for identifying member information based on the acquired biometric information of the user; a processing means for causing the terminal to execute a payment process using the identified member information; Includes.

[0010] An information processing method according to one aspect of the present disclosure includes: The computer The user's biometric information is associated with the member information and managed for each store. The user's biometric information is acquired from a terminal installed in each store, Identifying member information based on the acquired user's biometric information, The terminal is caused to execute a payment process using the identified member information.

[0011] A program according to one embodiment of the present disclosure includes: A process of associating the user's biometric information with membership information and managing it for each store; A process of acquiring biometric information of a user from a terminal installed in each store; A process of identifying member information based on the acquired user's biometric information; a process of causing the terminal to execute a payment process using the identified member information; to be executed by the computer. [Effects of the Invention]

[0012] The present disclosure can improve convenience for users when purchasing products in stores. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to a first embodiment. [Figure 2] 1 is a flowchart illustrating the flow of an information processing method according to the first embodiment. [Figure 3] FIG. 10 is a block diagram showing the overall configuration of an information processing system according to a second embodiment. [Figure 4] FIG. 4 is a block diagram showing the configuration of the user terminal of FIG. 3. [Figure 5] FIG. 4 is a block diagram showing the configuration of the authentication terminal of FIG. 3. [Figure 6] FIG. 4 is a block diagram showing the configuration of the authentication device of FIG. 3. [Figure 7] 10 is a flowchart showing the flow of a face information registration process performed by the authentication device according to the second embodiment. [Figure 8] FIG. 4 is a block diagram showing the configuration of the server in FIG. 3. [Figure 9]FIG. 10 is a sequence diagram showing the flow of payment processing according to the second embodiment. [Figure 10] 10 is a flowchart showing the flow of face authentication processing by the authentication device according to the second embodiment. [Figure 11] 10 is an example of a coupon selection screen. [Figure 12] 10 is an example of a screen displaying a payment result. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0015] <Embodiment 1> 1 is a block diagram showing the configuration of an information processing device 1 according to embodiment 1. The information processing device 1 is a device that can apply benefit information available to a user when purchasing a product in a store. The information processing device 1 stores and manages user membership information in a database.

[0016] Users to be managed are those who have registered for a membership system that allows them to use special privilege information. Special privilege information is, for example, points awarded according to payments (number of payments, payment amount, etc.) or discounts on product prices through coupons. Member users can receive certain services according to their accumulated points, for example.

[0017] A user is registered as a member by, for example, filling out an application form with their name, contact information (address, telephone number, email address, etc.), and other predetermined information about the user (user information) and submitting it at the store's service counter. The predetermined information may be sent from a web page for member registration using a user terminal owned by the user. Alternatively, the user may send the predetermined information via an application using their user terminal.

[0018] Furthermore, when registering as a member, the user can also register in advance payment information such as a valid credit card or electronic money that can be used for payment. Such payment information is also included in the user information.

[0019] Each member is assigned a user ID such as a membership number as unique identification information. In addition to the user information described above, each user ID is linked to various attribute information, including the user's store visit history, purchase history, payment amount, and information on benefits acquired and used (points, coupons, etc.). Member information includes user information such as name, contact information, and payment information, as well as various attribute information.

[0020] In related technology, a medium (such as a membership card) storing membership information that identifies a user is issued for each store that the user visits, so that the user, who is a member of that store, has to carry membership cards from multiple stores. As a result, when using special offers when purchasing products, the user must present a different membership card for each store, which is cumbersome.

[0021] Furthermore, there are a wide variety of coupons that can be used in stores, including electronic coupons obtained through apps and paper coupons. If a customer obtains multiple coupons at one store, they must select and present the usable ones, which can be difficult to use when the cash register is busy. Meanwhile, store clerks must deal with each membership card, coupon, and payment method presented by members, which makes cash register operations and responses complicated and burdensome.

[0022] In view of these circumstances, the present inventors have devised the following configuration. An information processing device 1 according to a first embodiment is a device that can apply available benefit information when purchasing a product at a store, even if the user does not have a medium indicating the benefit information. The information processing device 1 performs biometric authentication using biometric information to verify the identity of the user.

[0023] When registering as a member, users register their own biometric information (face, fingerprint, etc.) in advance. Various technologies using captured images can be applied to biometric authentication using biometric information. Data (features) based on physical characteristics unique to an individual, such as face, fingerprint, voiceprint, veins, retina, and iris, can be used as biometric information.

[0024] For example, a user can take a picture of his / her face with a camera installed in his / her user terminal and transmit the generated face image as biometric information (for registration) to the information processing device 1 or the authentication device. Note that a face image of the user may also be taken with a terminal installed in a store and transmitted to the information processing device 1 or the authentication device.

[0025] The information processing device 1 is connected to a predetermined terminal via a network (not shown) or predetermined wireless communication. The network may be wired or wireless, and the type of communication protocol may be any. The terminal transmits the user's biometric information (for authentication) to the information processing device 1. The terminal also performs processing based on the output from the information processing device 1 according to the authentication result. The terminal may include a store terminal installed in a store, a user terminal carried by a user, etc.

[0026] As shown in FIG. 1, the information processing device 1 includes a management unit 11, an acquisition unit 12, an identification unit 13, and a processing unit 14. The management unit 11 associates a user's biometric information (for registration) with membership information and manages the information for each store. The management unit 11 associates the user's biometric information with membership information for each store and stores the information in an internal or external storage device. Here, "for each store" may mean "for each individual store" or "for each group consisting of multiple stores in the same chain." For example, if the store is a chain store or a franchise store, the user's biometric information may be associated with membership information for each individual store, or the user's biometric information may be associated with membership information for a group that includes multiple stores. As described above, the membership information includes user information and various attribute information.

[0027] Furthermore, a user's biometric information and member information may be associated with each other for each store and stored as Table 1, and a table 2 may be created that associates the user's biometric information with member information without including store information. When making a payment at a store not stored in Table 1, the payment can be made by referring to Table 2. Table 2 may also include payment information and information indicating the priority of the recipients (point cards) of points earned through payment.

[0028] The acquisition unit 12 acquires biometric information (for authentication) of a user from a store terminal installed in each store. As an example, the biometric information may be a facial image, and the authentication for identity confirmation may be facial authentication. For example, the store terminal may have an imaging device such as a camera, and may generate a facial image by capturing an image. The user's biometric information may be generated automatically by the store terminal, or may be generated in response to input by the user or a store clerk. Such a store terminal may be fixed at a necessary location in the store, or may be carried by a store clerk. A portable store terminal may be, for example, a mobile phone, a smartphone, a tablet, etc.

[0029] The identification unit 13 identifies the member information based on the acquired user biometric information (for authentication). The identification unit 13 compares the authentication biometric information with the registration biometric information, and if the two match, can identify the member information. The store terminal may transmit the acquired biometric information to an authentication device in which the user's registration biometric information is registered in advance, and the authentication result may be transmitted to the information processing device 1. The information processing device 1 may receive the authentication result and perform processing according to the received authentication result.

[0030] The processing unit 14 causes the store terminal to execute payment processing using the identified member information. In the first embodiment, if the user's identity is successfully authenticated, the benefit information included in the member information can be automatically applied at the time of payment.

[0031] 2 is a flowchart showing the flow of the information processing method according to the first embodiment. First, the biometric information of a user is associated with the membership information of the user and stored for each store (S11). Next, the acquisition unit 12 acquires the biometric information of the user from a terminal installed in each store (S12).

[0032] Then, the identification unit 13 identifies member information based on the acquired biometric information of the user (S13). Thereafter, the processing unit 14 causes the terminal to execute payment processing using the identified member information (S14).

[0033] In this way, the information processing device 1 according to the first embodiment performs identity verification using biometric authentication using the user's biometric information when purchasing a product at a store. This allows a store terminal installed in the store to execute a payment process that applies the benefit information, even if the user does not have a medium indicating the benefit information that the user can use. For example, points that can be earned at the time of payment can be automatically awarded without the user having to present a membership card. Also, a coupon that can be used at the time of payment can be automatically applied to receive a discount on the product price, without the user having to present the coupon to a store clerk.

[0034] The information processing device 1 includes a processor, a memory, and a storage device, which are not shown in the figure. The storage device stores a program that causes a computer to execute each process of the information processing method according to the first embodiment. The processor loads the program from the storage device into the memory and executes the program. As a result, the processor controls the management unit 11, the acquisition unit 12, and the like. 、 It realizes the functions of the identification unit 13 and the processing unit 14.

[0035] Alternatively, each component of the information processing device 1 may be realized by dedicated hardware. exclusiveThe devices may be realized by a circuit, a processor, or a combination thereof. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits and programs. Furthermore, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (quantum computer control chip), etc. may be used as the processor.

[0036] Furthermore, when some or all of the components of the information processing device 1 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each is connected via a communication network. Furthermore, the functions of the information processing device 1 may be provided in a SaaS (Software as a Service) format.

[0037] <Embodiment 2> The second embodiment is a specific example of the first embodiment described above. Fig. 3 is a block diagram showing the overall configuration of an information processing system 100 according to the second embodiment. The information processing system 100 includes a server 10, a user terminal 20, a store terminal 30, and an authentication device 40. The server 10, the store terminal 30, the user terminal 20, and the authentication device 40 are each connected via a network N. Here, the network N is a wired or wireless communication line, for example, the Internet.

[0038] The information processing system 100 is a system for identifying member information by biometric authentication of a store member (user) and performing payment processing using the member information. Here, an example will be described in which a user registers his or her own biometric information (for registration) when registering as a store member using a user terminal 20 possessed by the user.

[0039] The biometric information used for biometric authentication is information used for authentication of identity confirmation (identification of identity, identity identification process, etc.) and is information for uniquely identifying an individual. In the second embodiment, facial authentication, which is an example of biometric authentication, is described, and the biometric information is a facial image. In other words, the facial image (for registration) is identification information for identifying a user who is to be registered as a member.

[0040] Note that other technologies that use photographed images of a person can be applied to biometric authentication and biometric information. For example, biometric information may be data (features) calculated from physical characteristics unique to an individual, such as fingerprints, voiceprints, veins, retinas, irises, and palm patterns.

[0041] <User terminal 20>

[0042] The user terminal 20 is an information terminal that is carried and operated by a user and transmits and receives data to and from the server 10 via the network N by wireless communication. The user terminal 20 is a mobile phone terminal, a smartphone, a tablet terminal, etc. FIG. 4 is a block diagram showing the configuration of the user terminal 20 in FIG. 3.

[0043] The user terminal 20 includes a camera 21, a storage unit 22, a memory 23, a communication unit 24, an input / output unit 25, and a control unit 26. The camera 21 is a photographing device that takes photographs under the control of the control unit 26. The storage unit 22 is an example of a storage device that includes a non-volatile memory such as a flash memory or an SSD (Solid State Drive). The storage unit 22 stores a program that implements processes including a process for registering face images and user information, a process for displaying information about benefits applied in a payment process by the store terminal 30, and the like.

[0044] The memory 23 is a volatile storage device such as RAM (Random Access Memory), and is a storage area for temporarily storing information when the control unit 26 is operating. The communication unit 24 is a communication interface with the network N. The communication unit 24 may also establish a short-range wireless communication connection with the store terminal 30 to perform communication. Here, various standards such as Bluetooth (registered trademark), BLE (Bluetooth Low Energy), and UWB (Ultra Wide Band) can be applied to the short-range wireless communication.

[0045] The input / output unit 25 is, for example, a touch panel, and includes a display device and an input device. The control unit 26 is a processor that controls the hardware of the user terminal 20. The control unit 26 loads a program from the storage unit 22 into the memory 23 and executes it. In this way, the control unit 26 realizes the functions of a registration unit 261 and a display control unit 262.

[0046] The registration unit 261 performs a process of registering user information and a facial image required for member registration. Specifically, the registration unit 261 accepts user information and a facial image input by a user. The registration unit 261 transmits a registration request for the accepted user information and facial image to the server 10 via the network N. The user can also register their own payment information in advance. The payment information may be credit card information, electronic money payment information, two-dimensional code (QR code (registered trademark)) payment information, etc., but these are merely examples.

[0047] When registering as a member, the user may register multiple pieces of payment information in advance, prioritizing them. The server 10 associates the user's biometric information with the multiple pieces of payment information, and manages them for each store along with priority information that specifies the priority of the multiple pieces of payment information.

[0048] As will be described later, the facial feature information of the user is registered in the facial information DB 41 of the authentication device 40, and the member information is registered in the member DB 112 of the server 10. The facial feature information and the member information are linked by a user ID issued when the user information is registered.

[0049] The registration unit 261 may receive a user ID from the server 10 via the network N and register it in the storage unit 22. The display control unit 262 may display, from the member information transmitted from the server 10 via the network N, benefit information applied to the payment process.

[0050] <Store terminal 30> The store terminal 30 is installed in a store and operated by a user or a store clerk. The store terminal 30 transmits and receives data to and from the server 10 via the network N. The store terminal 30 is a POS terminal including an authentication terminal 30a and a payment terminal 30b. The store terminal 30 uses the results of the user's biometric authentication to perform product registration processing, payment processing, etc. for the sale of products in the store. The store terminal 30 may also be used to pay for the provision of services.

[0051] Fig. 5 is a block diagram showing a schematic configuration of the authentication terminal 30a of Fig. 3. As shown in Fig. 5, the authentication terminal 30a includes a camera 31, a storage unit 32, a memory 33, a communication unit 34, an input / output unit 35, and a control unit 36. The camera 31 is an imaging device that takes images under the control of the control unit 36. The storage unit 32 is an example of a storage device that includes a non-volatile memory such as a flash memory or an SSD (Solid State Drive). The storage unit 32 stores a program that implements various processes, including an authentication request process for executing the payment process described below.

[0052] The memory 33 is a volatile storage device such as RAM (Random Access Memory), and is a storage area for temporarily storing information when the control unit 36 ​​is operating. The communication unit 34 is a communication interface with the network N. The input / output unit 35 is, for example, a touch panel that includes a display device (display unit) such as a screen and an input device (input unit).

[0053] The control unit 36 ​​is a processor that controls the hardware of the authentication terminal 30a. The control unit 36 ​​loads a program from the storage unit 32 into the memory 33 and executes it. As a result, the control unit 36 ​​realizes the functions of a display control unit 361, an authentication request unit 362, and a process control unit 363.

[0054] The display control unit 361 displays a screen generated by executing the program on the input / output unit 35. The display control unit 361 may display a message prompting the user to take a picture of their face for face authentication. The display control unit 361 may also display, from among the member information transmitted from the server 10, benefit information applied to the payment process.

[0055] The authentication request unit 362 extracts a human face area as a face image from the image of the user captured by the camera 31, and transmits an authentication request to the server 10. The authentication request unit 362 may transmit an authentication request including the face image to the authentication device 40. When the authentication is successful, the server 10 transmits member information associated with the face image to the process control unit 363.

[0056] The process control unit 363 controls processing specific to the payment terminal 30b connected to the authentication terminal 30a. For example, when authentication is successful, the process control unit 363 causes the payment terminal 30b to execute a payment process using the member information. Furthermore, when the process control unit 363 receives from the server 10 information to be notified to the user in a payment using the member information, the process control unit 363 causes the display control unit 361 to display the information. Furthermore, when the process control unit 363 receives from the server 10 information to be notified to the user in a payment using the member information, the process control unit 363 may output the information to the user terminal 20.

[0057] The information to be notified to the user includes, for example, at least one of the benefit information applied for each payment, the benefit information acquired, and the cumulative value of the benefit information. Specifically, the information to be notified to the user may be the points awarded for the current purchase, the cumulative value of the points awarded for a predetermined period, or a coupon that can be used for the next purchase.

[0058] The payment terminal 30b is a device that accepts payments for the purchase of goods, etc. This payment may be made in cash, or by other means such as credit card, debit card, or electronic money. To accept payments by cash or card, the payment terminal 30b is equipped with a cash slot, an automatic change dispenser, a card reader, etc. The payment terminal 30b also has a display device such as an LCD display for displaying information about the goods to be purchased, information about applicable benefits, payment information used in the payment process, etc.

[0059] As described above, payment information such as valid credit cards and electronic money that can be used for payment can be registered in advance when registering as a member. In this case, payment terminal 30b can automatically perform payment processing if facial authentication is successful. If authentication is successful, payment processing is performed using the registered payment information. If multiple payment information items are registered along with priority information, and payment cannot be performed using payment information with a higher priority, the process control unit 363 causes payment terminal 30b to perform payment processing using payment information with the next higher priority.

[0060] If payment cannot be made using the payment information with the highest priority, the process control unit 363 may notify the user of this fact and that payment information with the next highest priority will be used. Also, if the payment information with the highest priority is electronic money and the electronic money has an insufficient balance, the process control unit 363 may output information prompting the user to select whether to charge the electronic money and pay, or to use the payment information with the next highest priority.

[0061] <Authentication device 40> The authentication device 40 is an information processing device that manages facial feature information of users and performs facial authentication. In response to an authentication request received from the outside, the authentication device 40 compares a facial image (for authentication) included in the request with the facial feature information of the user that it manages, and returns the comparison result (authentication result) to the request source.

[0062] FIG. 6 is a block diagram showing the configuration of the authentication device 40 of FIG. 3. The authentication device 40 includes a face information database (DB) 41, a face detection unit 42, a feature point extraction unit 43, a registration unit 44, and an authentication unit 45. The face information DB 41 stores face feature information, which is a collection of feature points extracted from a face image (for registration). The face information DB 41 stores a user ID (described later) and the face feature information in association with each other. The authentication device 40 may delete face feature information from the face feature DB 41 in response to a request from a user or the like corresponding to the face feature information. Alternatively, the authentication device 40 may delete face feature information after a certain period of time has elapsed since registration.

[0063] The face detection unit 42 detects a facial area included in a facial image (for registration) for registering facial feature information, and outputs the detected area to the feature point extraction unit 43. The feature point extraction unit 43 extracts feature points from the facial area of ​​the facial image (for registration) received from the user terminal 20 or the like, and outputs the facial feature information to the registration unit 44. The registration unit 44 issues a new user ID when registering the facial feature information. The registration unit 44 associates the issued user ID with the facial feature information extracted from the facial image (for registration), and registers the associated information in the facial information DB 41.

[0064] The face detection unit 42 detects a face area included in a face image (for authentication) used in authentication processing, and outputs the detected face area to the feature point extraction unit 43. The feature point extraction unit 43 extracts feature points included in the face image (for authentication) received from the server 10 or the like, and outputs facial feature information to the authentication unit 45.

[0065] The authentication unit 45 performs face authentication using facial feature information. Specifically, the authentication unit 45 compares the facial feature information extracted from the face image (for authentication) with the facial feature information in the face information DB 41. The authentication unit 45 returns a match or non-match of the facial feature information to the request source as the face authentication result. The match or non-match of the facial feature information corresponds to the success or failure of authentication. Note that a match of the facial feature information refers to a case where the degree of match is equal to or greater than a threshold. Furthermore, if face authentication is successful, the face authentication result includes the identified user ID.

[0066] For example, when an authentication request is sent from the server 10, the authentication unit 45 performs face authentication on the face image included in the authentication request and returns the authentication result to the server 10. If the authentication is successful, the identification unit 13 of the server 10 identifies the member information associated with the matched facial feature information.

[0067] 7 is a flowchart showing the flow of face information registration processing by the authentication device 40 according to the second embodiment. The authentication device 40 first receives a face image registration request transmitted from the user terminal 20 (S21). In this example, the authentication device 40 receives the face image registration request transmitted from the user terminal 20 via the server 10. Next, the face detection unit 42 detects a face area from the face image included in the face information registration request (S22). Then, the feature point extraction unit 43 extracts feature points (facial feature information) from the face area detected in step S22 (S23). Then, the registration unit 44 issues a user ID (S24), associates it with the extracted facial feature information, and registers it in the face information DB 41 (S25).

[0068] Thereafter, the registration unit 44 returns the issued user ID to the request source (e.g., the server 10) (S26). Note that the authentication device 40 may perform face information registration processing in response to a face information registration request received from any information registration terminal. For example, the information registration terminal may be the user terminal 20 or the store terminal 30.

[0069] <Server 10> The server 10 corresponds to the information processing device 1. The server 10 is an information processing device that performs biometric information registration processing, member information identification processing, etc. (information processing method according to the second embodiment). In the first embodiment, the information processing device 1 associates and stores biometric information with management information, but in the second embodiment, the server 10 manages the biometric information and management information in cooperation with the authentication device 40. Note that the server 10 may be configured with multiple servers, and each functional block may be realized by multiple computers.

[0070] Fig. 8 is a block diagram showing the configuration of the server 10 in Fig. 3. The server 10 includes a storage unit 110, a memory 120, a communication unit 130, and a control unit 140. The storage unit 110 is an example of a storage device such as a hard disk or flash memory. The storage unit 110 stores a program 111 and a member DB 112. The program 111 is a computer program that implements parts of processes such as registration of facial images and user information, facial authentication processing, and payment processing.

[0071] The member DB 112 is a database that manages information on users of the store who are registered as members. The member DB 112 manages user IDs and member information in association with each other. That is, in the second embodiment, biometric information and member information are linked to user IDs and managed for each store in the member DB 112 of the server 10 and the face information DB 41 of the authentication device 40. The biometric information here is a facial image. As described above, the member information includes various attribute information such as user information and benefit information, and payment information. The payment information is credit card information, electronic payment information, etc., used by the payment terminal 30b when performing payment processing in response to successful biometric authentication.

[0072] The memory 120 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily storing information during operation of the control unit 140. The communication unit 130 is a communication interface with the network N.

[0073] The control unit 140 is a processor that controls each component of the server 10. The control unit 140 loads the program 111 from the storage unit 110 into the memory 120 and executes the program 111. In this way, the control unit 140 realizes the functions of the registration unit 141, the authentication control unit 142, and the processing unit 143.

[0074] Registration unit 141 corresponds to management unit 11 in FIG. 1. Registration unit 141 receives a member registration request including a facial image and predetermined items (user information) related to the user required for member registration from any user terminal 20, and performs a registration process for the facial image and user information. Specifically, registration unit 141 acquires a facial image from the member registration request, and transmits a facial information registration request including the acquired facial image to authentication device 40. Then, registration unit 141 receives from authentication device 40 a user ID issued when the facial information was registered. Then, registration unit 141 acquires the user information from the member registration request, associates the received user ID with the user information, and registers it in member DB 112.

[0075] The authentication control unit 142 corresponds to the acquisition unit 12 and identification unit 13 in Fig. 1. When the authentication control unit 142 receives an authentication request including a facial image of a member from the store terminal 30, it transmits the authentication request including the facial image to the authentication device 40. Then, the authentication control unit 142 receives a facial authentication result from the authentication device 40. When facial authentication is successful, the authentication control unit 142 identifies member information associated with the matched facial feature information.

[0076] The processing unit 143 corresponds to the processing unit 14 in FIG. 1. The processing unit 143 executes a payment process using the member information identified by the store terminal 30. Specifically, the processing unit 143 can execute a payment process that applies the benefit information included in the member information when making a payment at the payment terminal 30b. For example, a user can earn points according to the amount paid when making a payment without presenting a membership card. Furthermore, a user can receive a discount on a product price by automatically applying a coupon that can be used when making a payment, without presenting the coupon to a store clerk.

[0077] Furthermore, if payment information has been registered in advance in the member DB 112, the processing unit 143 can read out the payment information linked to the user ID identified upon successful face authentication and transmit it to the payment terminal 30b. The payment terminal 30b can use this payment information to process the payment amount. Note that the member DB 112 may store multiple pieces of payment information for one user ID, along with priority information that specifies the priority of these pieces of information, for each store. In this case, if the processing unit 143 cannot perform payment using the payment information with the highest priority, it can cause the payment terminal 30b to execute payment processing using the payment information with the next highest priority.

[0078] 9 is a sequence diagram showing the flow of payment processing. First, the authentication terminal 30a of the store terminal 30 photographs the user's face with the camera 31 (S31). Then, the authentication terminal 30a outputs the facial image to the server 10 (S32). The server 10 acquires the facial image from the authentication terminal 30a and transmits a facial authentication request including the acquired facial image to the authentication device 40 via the network N (S33). Upon receiving the facial authentication request, the authentication device 40 performs facial authentication processing (S34).

[0079] 10 is a flowchart showing the flow of face authentication processing by the authentication device 40. First, the authentication device 40 receives a face authentication request from the server 10 via the network N (S41). Note that the authentication device 40 may also receive a face authentication request from a store terminal 30 or the like. Next, the authentication device 40 extracts facial feature information from the face image included in the face authentication request. Then, the authentication unit 45 of the authentication device 40 compares the facial feature information extracted from the face image included in the face authentication request with the facial feature information in the face information DB 41 (S42) and calculates the degree of match.

[0080] Then, the authentication unit 45 determines whether the degree of match is equal to or greater than a threshold (S43). If the facial feature information matches, that is, if the degree of match of the facial feature information is equal to or greater than a threshold, the authentication unit 45 identifies a user ID associated with the facial feature information (S44). Then, the authentication unit 45 returns a facial authentication result indicating that facial authentication was successful, including the identified user ID, to the server 10 via the network N (S45). If the degree of match is less than the threshold in step S43, the authentication unit 45 returns a facial authentication result indicating that facial authentication was unsuccessful, including a message to the server 10 via the network N (S46).

[0081] 9, the server 10 receives the face authentication result from the authentication device 40 via the network N (S35). Then, the server 10 executes a member information identification process according to the face authentication result (S36). If the face authentication is successful, the server 10 reads out the member information associated with the user ID included in the face authentication result from the member DB 112, and transmits the member information to the store terminal 30 (S37).

[0082] If facial authentication fails, the server 10 can transmit a message to the store terminal 30 indicating that authentication has failed. The store terminal 30 displays on its screen a message indicating that the member information cannot be applied by facial authentication. The store terminal 30 may also notify the user terminal 20 by short-range wireless communication or the like that the member information cannot be identified by facial authentication. Note that a facial authentication request may be transmitted directly from the authentication terminal 30a of the store terminal 30 to the authentication device 40 without going through the server 10, and the authentication device 40 may then transmit the facial authentication result to the server 10.

[0083] Then, the payment terminal 30b of the store terminal 30 applies the member information and executes the payment process (S38). Here, it is assumed that the following attribute information is stored in the member DB 112 for the stores A and B. Store A · Coupons: Automatically apply available coupons Points: Store points are automatically awarded Payment method: Electronic payment Store B · Coupons: Automatically apply available coupons Points: Store points and partner points are automatically awarded Payment method: Credit card

[0084] For example, when performing payment processing at the above-mentioned store B, the store terminal 30 checks the conditions (expiration date, application conditions, etc.) of the coupons linked to the member's facial image and automatically applies all available coupons. Note that if there are multiple available coupons but they cannot be used in duplicate, the store terminal 30 may send selectable coupon information to the user terminal 20. The user can select the coupon they want to use from the multiple coupons and apply it at the time of payment.

[0085] FIG. 11 is a diagram showing an example of a coupon selection screen 200 displayed on the user terminal 20. The coupon selection screen 200 includes an applicable store display 201 where the payment to which the coupon is applied is made, and a selectable coupon information display 202. In the example shown in FIG. 11, the store where the payment is made is Store A. The coupon information display 202 includes a list of information on selectable coupons. When the user presses the button of the coupon they wish to use from these coupons, the information on the coupon to be used can be sent from the user terminal 20 to the store terminal 30.

[0086] The store terminal 30 automatically awards store points specific to the store and affiliated points that can be used at affiliated stores according to the payment amount. The store terminal 30 also performs settlement processing for the payment amount using credit card information registered in the member DB 112.

[0087] The store terminal 30 then displays the payment result (S39). The store terminal 30 may notify the user terminal 20 of the payment result via short-range wireless communication. Alternatively, the store terminal 30 may notify the user of the payment result via an application or email. When notified via an application or email, the user can check the payment result and the accumulated number of earned points at any time. An example of a screen displaying this payment result is shown in FIG. 12. As shown in FIG. 12, the screen of the store terminal 30 displays information to be notified to the user regarding the payment using the member information. Note that information to be notified to store staff may be displayed on the store's display device.

[0088] The payment result screen 300 includes an applicable store display 301, a payment notification information display 302, and a discount notification information display 303. In the example of Figure 12, it is shown that the store where the payment was made is store A out of multiple stores.

[0089] In the example of Fig. 12, a payment notification information display 302 including the payment amount and payment method is displayed, along with a discount notification information display 303 including the discount amount for the coupon applied to the current purchase, the number of points used for the current purchase, and the points earned for the current purchase. The earned points may include points that can be used only at store A and common points that can be used at multiple stores. This allows the user, who is a member, to know how much money he or she has saved from the current purchase, which can increase the user's desire to purchase at the store. The store terminal 30 may also display the cumulative value of the earned points.

[0090] Note that the attribute information shown in Fig. 12 is an example, and other information may be displayed in addition to or instead of the information shown here. Also, the screen shown in Fig. 12 may be displayed not only on the user side but also on a display for store staff.

[0091] Furthermore, the store terminal 30 can also issue coupons that can be used for the next purchase. The control unit 36 ​​of the store terminal 30 issues a coupon corresponding to the purchased product, for example, and transmits it to the server 10. The server 10 can store the received coupon in the member DB 112 as attribute information (member information) of the member. The store terminal 30 can also notify the user terminal 20 of the acquired coupon via short-range wireless communication. For example, issuing a coupon containing information about a discount on a product related to the purchased product can increase the user's purchasing motivation and promote sales of the product at the store. It can also earn advertising revenue from businesses that manufacture the products related to the coupon.

[0092] As described above, according to the second embodiment, payment processing can be completed by simply performing face authentication on the store terminal 30 installed in the store, with benefit information such as coupons and points automatically applied. This eliminates the need to carry a membership card and prevents forgetting to use available coupons, reducing the user's effort and enabling convenient and easy use of benefits. By promoting the use of such point and coupon services, it becomes possible to retain customers.

[0093] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0094] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0095] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Appendix A1) a management means for associating user biometric information with membership information and managing the information for each store; an acquisition means for acquiring biometric information of a user from a terminal installed in each store; An identification means for identifying member information based on the acquired biometric information of the user; a processing means for causing the terminal to execute a payment process using the identified member information; An information processing device comprising: (Appendix A2) the management means associates the user's biometric information with a plurality of pieces of payment information, and manages the biometric information and the plurality of pieces of payment information for each store together with priority information that specifies the priority of the plurality of pieces of payment information; the processing means, when payment cannot be made using the payment information with the highest priority, causes the terminal to execute payment processing using the payment information with the next highest priority; 10. The information processing device according to claim 1, (Appendix A3) The processing means causes the terminal to output information to be notified to the user regarding the payment to which the member information is applied. An information processing device according to appendix A1 or A2. (Appendix A4) The information includes at least one of benefit information applied for each payment, benefit information acquired, and a cumulative value of benefit information. 10. The information processing device according to claim 9, wherein the information processing device is a (Appendix B1) Terminals installed at each store, an information processing device, The information processing device includes: a management means for associating user biometric information with membership information and managing the information for each store; an acquisition means for acquiring biometric information of a user from the terminal; an identification means for identifying member information based on the acquired biometric information of the user; The terminal uses the specified member information , decided Execute the completed process, Information processing system. (Appendix B2) the management means associates the user's biometric information with a plurality of pieces of payment information, and manages the biometric information and the plurality of pieces of payment information for each store together with priority information that specifies the priority of the plurality of pieces of payment information; When the terminal is unable to perform payment using the payment information with the highest priority, the terminal performs payment processing using the payment information with the next highest priority. 1. An information processing system as described in Appendix B1. (Appendix B3) The terminal outputs information to be notified to the user regarding the payment using the member information. 1. An information processing system according to claim 1 or B2. (Appendix B4) The information includes at least one of benefit information applied for each payment, benefit information acquired, and a cumulative value of benefit information. 1. An information processing system as described in Appendix B3. (Appendix C1) The computer The user's biometric information is associated with the member information and managed for each store. The user's biometric information is acquired from a terminal installed in each store, Identifying member information based on the acquired user's biometric information, causing the terminal to execute a payment process using the identified member information; Information processing methods. (Appendix D1) A process of associating the user's biometric information with membership information and managing it for each store; A process of acquiring biometric information of a user from a terminal installed in each store; A process of identifying member information based on the acquired user's biometric information; a process of causing the terminal to execute a payment process using the identified member information; A non-transitory computer-readable medium storing a program for causing a computer to execute the above.

[0096] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-described embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0097] 1. Information processing equipment 10 Servers 11 Management Department 12 Acquisition Department 13 Specific section 14 Processing section 20 User terminal 21 Camera 22 Memory section 23 Memory 24 Communications Department 25 Input / output section 26 Control Unit 261 Registration Department 262 Display control unit 30 store terminals 30a Authentication terminal 30b Payment terminal 31 Camera 32 Storage section 33 Memory 34 Communications Department 35 Input / output section 36 Control Unit 361 Display control unit 362 Authentication Request Section 363 Processing Control Unit 40 Authentication Device 41 Face Information DB 42 Face detection unit 43 Feature point extraction unit 44 Registration Department 45 Authentication Section 100 Information Processing Systems 110 Storage section 111 Program 112 Member DB 120 memory 130 Communications Department 140 Control Unit 141 Registration Department 142 Authentication control section 143 Processing section 200 Coupon selection screen 201 Applicable store display 202 Coupon information display 300 Payment result screen 301 Applicable store display 302 Payment notification information display 303 Display of discount notification information N Network

Claims

1. A receiving means for receiving designation information designated by a user for each store, including a payment method to be applied to payment at the store, whether or not a benefit will be used for the payment, and the recipient of the benefit obtained by the payment; a management means for associating the user's biometric information with the designated information for each store that has received the biometric information, and managing the information for each store; an acquisition means for acquiring biometric information of a user from a terminal installed in each store; an identification means for identifying the specified information based on the acquired biometric information of the user; a processing means for causing the terminal to execute a payment process using the specified information; An information processing device comprising:

2. the management means associates the user's biometric information with a plurality of payment methods, and manages the biometric information and priority order information that specifies the priority order of the plurality of payment methods for each store; When payment cannot be made using a payment method with a higher priority, the processing means causes the terminal to execute payment processing using a payment method with a next higher priority. The information processing device according to claim 1 .

3. When the specified designation information indicates that a benefit will be used for the payment, the processing means causes the terminal to execute a payment process using the specified payment means and the benefit available for the payment, and when the specified designation information includes a recipient of a benefit obtained by the payment, grants the benefit obtained by the payment to the specified recipient; outputting, to the terminal, information including at least one of applied benefit information, acquired benefit information, and accumulated value of benefit information in a payment made using the payment means; 3. The information processing device according to claim 1 or 2.

4. the management means manages the user's biometric information and the payment method accepted by each store as a first table by associating the user's biometric information with the payment method accepted by each store, and manages the user's biometric information and the payment method as a second table without including store information; the acquiring means acquires first biometric information of the user from a terminal installed in a store included in the first table, or acquires second biometric information of the user from a terminal installed in a store not included in the first table; the identification means identifies the payment method by referring to the first table based on the first biometric information, or identifies the payment method by referring to the second table based on the second biometric information; The information processing device according to claim 1 .

5. The second table includes information indicating the priority of recipients of points acquired through payment, the processing means awards points to the award recipient determined based on the information indicating the priority order; The information processing device according to claim 4 .

6. The computer Accepts designation information designated by the user for each store, including the payment method to be applied to the payment at the store, whether or not a benefit will be used for the payment, and the recipient of the benefit obtained from the payment; The biometric information of the user is associated with the designated information for each store where the biometric information is received, and the associated information is managed for each store; The user's biometric information is acquired from a terminal installed in each store, Identifying the specified information based on the acquired biometric information of the user; causing the terminal to execute a payment process using the specified information; Information processing methods.

7. A process of accepting designation information designated by the user for each store, including the payment method to be applied to the payment at the store, whether or not to use a benefit for the payment, and the recipient of the benefit obtained from the payment; a process of associating the user's biometric information with the designated information for each store that received the biometric information and managing the information for each store; A process of acquiring biometric information of a user from a terminal installed in each store; A process of identifying the specified information based on the acquired biometric information of the user; a process of causing the terminal to execute a payment process using the specified information; A program that causes a computer to execute the following.

Images