Information processing device, information processing method, and program

Abstract

To provide a visit promotion device for providing information in which visit of respective points is recorded, to a user who has actually visited the respective points.SOLUTION: A visit promotion device (100) comprises: an acquisition unit (130) that acquires a photographed image obtained by photographing a user; an authentication control unit (140) that extracts a face area or face feature information of the user from the photographed image and causes an authentication device (200) to perform face authentication; an image creation unit (170) that, when a predetermined image creation condition based on the face authentication at a plurality of points is satisfied, creates a composite image including the photographed images at respective points for the user who has succeeded in the face authentication; and an output unit (180) that transmits the composite image created by the image creation unit (170) to a predetermined display terminal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a non-transitory computer-readable medium storing a visit promotion device, system, method, and program, and particularly relates to a non-transitory computer-readable medium storing a visit promotion device, system, method, and program for promoting user visits. [Background Art]

[0002] Patent Document 1 discloses a technique in which, in a so-called stamp rally (point rally) where the objective is achieved by visiting a plurality of points, face authentication is performed by a camera installed at each point to obtain confirmation of a visit to each point. [Prior Art Literature] [Patent Literature]

[0003] [Patent Document 1] Japanese Unexamined Patent Publication No. 2013-41416 [Summary of the Invention] [Problem to be Solved by the Invention]

[0004] Here, for purposes such as regional revitalization, utilizing a stamp rally can be cited to promote the purchase of goods (settlement) when users actually visit each point within the region. However, the technique disclosed in Patent Document 1 does not sufficiently utilize the stamp rally.

[0005] The present disclosure has been made to solve such problems, and an object of the present disclosure is to provide a non-transitory computer-readable medium storing a visit promotion device, system, method, and program for providing information recording visits to each point to a user who has actually visited each point. [Means for Solving the Problem]

[0006] The visit promotion device according to this disclosure includes: an acquisition unit that acquires a captured image taken by a user; an authentication control unit that extracts the user's face region or facial feature information from the captured image and causes an authentication device to perform facial authentication; an image generation unit that generates a composite image including captured images of the user at each location when predetermined image generation conditions based on the facial authentication at multiple locations are met; and an output unit that transmits the composite image generated by the image generation unit to a predetermined display terminal.

[0007] The visit promotion system according to this disclosure comprises a predetermined shooting device that captures an image including the user's face region, a visit promotion device that can communicate with the predetermined shooting device, and an authentication device that stores the user's facial feature information and can communicate with the visit promotion device, wherein the visit promotion device comprises an acquisition unit that acquires a captured image taken by the predetermined shooting device of the user, an authentication control unit that extracts the user's face region or facial feature information from the captured image and causes the authentication device to perform facial authentication, an image generation unit that generates a composite image including captured images of each location of the user who has successfully achieved facial authentication when predetermined image generation conditions based on the facial authentication at multiple locations are met, and an output unit that transmits the composite image generated by the image generation unit to a predetermined display terminal.

[0008] The visit promotion method relating to this disclosure comprises the steps of: a computer acquiring a photograph taken by a user; extracting the user's face region or facial feature information from the photograph and having an authentication device perform facial authentication; generating a composite image including the photograph taken at each location of the user who successfully achieved facial authentication, when predetermined image generation conditions based on the facial authentication at multiple locations are met; and transmitting the generated composite image to a predetermined display terminal.

[0009] The non-temporary computer-readable medium relating to this disclosure records a program that performs the following steps: acquiring a photograph taken by a user; extracting the user's face region or facial feature information from the photograph and causing an authentication device to perform facial authentication; generating a composite image including photographs taken at each location of the user who successfully achieved facial authentication, when predetermined image generation conditions based on the facial authentication at multiple locations are met; and transmitting the generated composite image to a predetermined display terminal.

[0010] The visit promotion device according to this disclosure comprises: an acquisition unit that acquires a captured image taken by a user; an extraction unit that extracts a face region or face feature information from the captured image; a face recognition unit that performs face recognition based on the face region or face feature information; an image generation unit that generates a composite image including captured images of the user at each location when predetermined image generation conditions based on the face recognition at multiple locations are met; and an output unit that transmits the composite image generated by the image generation unit to a predetermined display terminal.

[0011] The visit promotion method relating to this disclosure comprises the steps of: a computer acquiring a captured image taken by a user; extracting a face region or face feature information from the captured image; performing face authentication based on the face region or face feature information; generating a composite image including captured images of the user at each location when predetermined image generation conditions based on the face authentication at multiple locations are met; and transmitting the generated composite image to a predetermined display terminal.

[0012] The non-temporary computer-readable medium relating to this disclosure records a program that causes the user to perform the following steps: acquire a captured image taken by the user; extract a face region or face feature information from the captured image; perform face authentication based on the face region or face feature information; generate a composite image including captured images of the user at each location when predetermined image generation conditions based on the face authentication at multiple locations are met; and transmit the generated composite image to a predetermined display terminal. [Effects of the Invention]

[0013] According to the present disclosure, there can be provided a non-transitory computer-readable medium storing a visit promotion apparatus, system, method and program for providing information that records visits to each point to users who have actually visited each point. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] [Figure 1] FIG. 1 is a block diagram showing the configuration of the visit promotion apparatus according to Embodiment 1. [Figure 2] FIG. 2 is a flowchart showing the flow of the visit promotion method according to Embodiment 1. [Figure 3] FIG. 3 is a block diagram showing the configuration of the visit promotion system according to Embodiment 2. [Figure 4] FIG. 4 is a block diagram showing the configuration of an authentication apparatus. [Figure 5] FIG. 5 is a block diagram showing the configuration of a face authentication terminal. [Figure 6] FIG. 6 is a block diagram showing the configuration of a user terminal. [Figure 7] FIG. 7 is a flowchart showing the flow of facial feature information registration processing. [Figure 8] FIG. 8 is a flowchart showing the flow of face authentication processing. [Figure 9] FIG. 9 is a flowchart showing the flow of authentication record processing. [Figure 10] FIG. 10 is a flowchart showing the flow of payment record processing. [Figure 11] FIG. 11 is a flowchart showing the flow of image generation processing. [Figure 12] FIG. 12 is an example of a composite image. [Figure 13] FIG. 13 is a sequence chart showing an operation example of the visit promotion system according to Embodiment 2. [Figure 14] FIG. 14 is a sequence chart showing an operation example of the visit promotion system according to Embodiment 2. [Figure 15] FIG. 15 is a sequence chart showing an operation example of the visit promotion system according to Embodiment 2. [Figure 16] It is a diagram illustrating an example of a map displayed on a display terminal. [Figure 17] It is a diagram illustrating an example of a payment history displayed on a display terminal. [Figure 18] It is a diagram illustrating an example of a visit promotion screen displayed on a display terminal. [Figure 19] It is a diagram illustrating an example of a visit promotion screen displayed on a display terminal. [Figure 20] It is a diagram illustrating an example of a visit promotion screen displayed on a display terminal. [Figure 21] It is a block diagram showing the configuration of a visit promotion device according to Embodiment 3. [Figure 22] It is a block diagram showing the configuration of a visit promotion system according to Embodiment 3. MODE FOR CARRYING OUT THE INVENTION

[0015] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, identical or corresponding elements are assigned the same reference signs, and duplicate descriptions are omitted as necessary for clarification of explanation.

[0016] <Embodiment 1> FIG. 1 is a block diagram showing the configuration of a visit promotion device 100 according to Embodiment 1. The visit promotion device 100 includes an acquisition unit 130, an authentication control unit 140, an image generation unit 170, and an output unit 180. The visit promotion device 100 is connected to a network 500 (not shown). The network 500 may be wired or wireless. An authentication device 200 and a face authentication terminal 300, which are not shown, are connected to the network 500.

[0017] The acquisition unit 130 acquires the captured image taken by the user. The captured image is an image that includes the user's face. The captured image is taken by a predetermined shooting device. The predetermined shooting device is, for example, the camera equipped on the face recognition terminal 300 and the camera on the user terminal such as a smartphone held by the user. The authentication control unit 140 extracts the user's face region or face feature information from the captured image and causes the authentication device 200 to perform face recognition. The authentication device 200 stores the user ID and the user's face feature information in association with each other in advance.

[0018] The image generation unit 170 generates a composite image including images taken at each location of a user who has successfully undergone facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met. The predetermined image generation conditions are the conditions for generating a composite image to be presented to the user. For example, the predetermined image generation conditions include performing facial recognition at a specific location, performing facial recognition at a predetermined number of locations or more, and performing payment at any of the locations. The output unit 180 transmits the composite image generated by the image generation unit 170 to a predetermined display terminal. The predetermined display terminal is, for example, a facial recognition terminal 300, a user terminal, a store terminal, or street signage. A user terminal is a communication terminal such as a smartphone owned by the user. A store terminal is a terminal installed in each store, and for example, displays "How about going to XX next?" when a user leaves the store.

[0019] The designated display terminal may be the designated shooting device described above, or it may be a different terminal. For example, if a user terminal takes a picture, the output unit 180 may send the composite image to the user terminal, or it may send the composite image to the face recognition terminal 300, etc. If a face recognition terminal 300 takes a picture, the output unit 180 may send the composite image to the face recognition terminal 300, or it may send the composite image to the user terminal, etc.

[0020] Figure 2 is a flowchart illustrating the flow of the visit promotion method according to Embodiment 1. First, the acquisition unit 130 acquires the captured image taken by the user (step S101). Next, the authentication control unit 140 extracts the user's face region or face feature information from the captured image acquired by the acquisition unit 130 and causes the authentication device 200 to perform face authentication (step S102). The authentication device 200 compares the face region or face feature information received from the authentication control unit 140 with the face feature information registered in the authentication device 200, determines whether authentication is successful or not based on whether there is a match, and returns the determination result. The authentication device 200 is assumed to store the user ID and face feature information in association. If face authentication is successful, the authentication device 200 returns the successful user ID in the determination result.

[0021] Next, the image generation unit 170 generates a composite image including images taken at each location of the user who successfully achieved facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met (step S103). Next, the output unit 180 transmits the composite image generated by the image generation unit 170 to a predetermined display terminal (step S104). In this way, the visit promotion method according to this embodiment can provide information recording the visit to each location to users who have actually visited each location.

[0022] In addition to the configuration shown in Figure 1, the visit promotion device 100 may also include a history storage unit, a location storage unit, an authentication record unit, and a payment record unit.

[0023] The history storage unit stores the user's ID, passing locations, date and time of passing, captured images, and payment history. The location storage unit stores location IDs in association with access information for those locations. When facial recognition is successful, the authentication record unit records the user ID and captured image associated with the successful facial recognition in the history storage unit. The payment record unit records the payment history and the user ID included in that payment history in the history storage unit.

[0024] The visit promotion device 100 includes a processor, memory, and storage device (not shown in the figures). The storage device stores a computer program that implements the processing of the visit promotion method according to this embodiment. The processor loads the computer program from the storage device into the memory and executes the computer program. In this way, the processor realizes the functions of the acquisition unit 130, the authentication control unit 140, the authentication recording unit, the settlement recording unit, the image generation unit 170, and the output unit 180.

[0025] Alternatively, the acquisition unit 130, authentication control unit 140, authentication recording unit, payment recording unit, image generation unit 170, and output unit 180 may each be implemented with dedicated hardware. Furthermore, some or all of the components of each device may be implemented by general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be configured by a single chip or by multiple chips connected via a bus. Some or all of the components of each device may be implemented by a combination of the above-mentioned circuits, etc., and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (field-programmable gate array), etc., can be used as the processor.

[0026] Furthermore, if some or all of the components of the visit promotion device 100 are realized by multiple information processing devices or circuits, these multiple information processing devices or circuits may be centrally located or distributed. For example, the information processing devices or circuits may be realized in a form in which each is connected via a communication network, such as a client-server system or a cloud computing system. Also, the functions of the visit promotion device 100 may be provided in SaaS (Software as a Service) format.

[0027] <Embodiment 2> Embodiment 2 is a specific example of Embodiment 1 described above. Figure 3 is a block diagram showing the configuration of the visit promotion system 600 according to Embodiment 2. The visit promotion system 600 comprises at least a visit promotion device 100a and an authentication device 200, and further comprises at least one of a facial recognition terminal 300 and a user terminal 400. The visit promotion device 100a, the authentication device 200, the facial recognition terminals 300 (300A0, 300A1, 300A2, and 300An), and the user terminal 400 are each connected via a network 500. Descriptions that overlap with Embodiment 1 will be omitted as appropriate.

[0028] The visit promotion device 100a comprises a history DB (DataBase) 110a, a location DB 120a, an acquisition unit 130, an authentication control unit 140, an authentication recording unit 150, a payment recording unit 160, an image generation unit 170, and an output unit 180. The visit promotion device 100a is an information processing device that generates and presents the user's visit history, payment history, and composite images, and is, for example, a server device implemented by a computer.

[0029] History DB 110a is a database for storing a user's travel locations, captured images, and payment history. Note that History DB 110a is an example of a history storage unit. History DB 110a stores the user ID, the user's travel locations, the date and time of travel at each location, the captured images at each location, and the user's payment history in association with each other. A user's travel locations are, for example, the locations where the facial recognition terminal 300 was successfully used for facial recognition. The locations of the facial recognition terminal 300 are, for example, the identification information of locations A0, A1, A2, and An (where n is a natural number; hereinafter referred to as "locations A0-An"), i.e., the location IDs. The travel date and time are the date and time when the user visited each location A0-An.

[0030] Locations A0 to An are, for example, checkpoints for a stamp rally using facial recognition within region A. Users can record their passage through each of these locations (A0 to An) by visiting them and performing facial recognition using the facial recognition terminal 300 or user terminal 400, which can be recorded in the visit promotion device 100a. Users can register their facial information at the starting point (e.g., location A0) and obtain a composite image upon successful facial recognition at the goal point (e.g., location An). Furthermore, if each of the locations A0 to An is a store, users can perform payments such as purchasing goods in conjunction with facial recognition.

[0031] The date and time of the visit may include, for example, the date and time the user successfully performed facial recognition and the date and time the user took the captured image. The captured image is an image taken during facial recognition and may include at least the user's face and possibly the background of the location. The payment history includes information such as the user's user ID, the location ID of the facial recognition terminal, the date and time of payment, and payment information. The payment information may include, for example, the purchased items and the purchase amount. The payment history registered in the history DB110a may be for facial recognition payments or payments made by other methods.

[0032] Location DB120a is a database that manages the correspondence between location IDs (A0-An) and access information. Note that Location DB120a is an example of a location storage unit. Access information includes, for example, link information to web information corresponding to each location (A0-An), specifically URLs (uniform resource locators).

[0033] The acquisition unit 130 receives facial recognition requests, history registration requests, and composite image requests from the facial recognition terminal 300 or user terminal 400 via the network 500. In other words, the acquisition unit 130 acquires images captured by the camera 310 or 410, and installation location information of the camera 310 or 410 (hereinafter simply referred to as "installation location") from the facial recognition terminal 300 or user terminal 400.

[0034] The authentication control unit 140 extracts the face region or facial feature information from the authentication image included in the face authentication request and transmits the face region or facial feature information to the authentication device 200 to perform face authentication. The authentication control unit 140 also receives the success or failure of face authentication from the authentication device 200 and returns the face authentication result to the requesting terminal. If face authentication is successful, the face authentication result will include the user ID.

[0035] If facial recognition is successful, the authentication record unit 150 records the user ID that was successfully recognized, the captured image, the location passed through, and the date and time of passage in the history DB 110a, associating them. The captured image is, for example, the one used for facial recognition. As will be described in detail later, if facial recognition is successful, the facial recognition terminal 300 or the user terminal 400 performs various processes such as payment processing. Once various processes such as payment processing are performed, the authentication record unit 150 records the user ID that was successfully recognized, the captured image, the location passed through, and the date and time of passage in the history DB 110a, associating them. If the payment record unit 160 receives a payment history recording request, it identifies the user ID included in the payment history. The payment record unit 160 then records the identified user ID and the payment history in the history DB 110a, associating them.

[0036] When the image generation unit 170 receives a composite image request, it determines predetermined image generation conditions. The image generation unit 170 determines predetermined image generation conditions based on the results of face recognition performed at multiple locations. The predetermined image generation conditions include, for example, that face recognition is successful at two or more of the multiple locations, and that a payment history exists for the user at at least one of those two or more locations. The predetermined image generation conditions may also include, for example, that the number of locations passed through is greater than a predetermined number N.

[0037] When predetermined image generation conditions are met, the image generation unit 170 retrieves multiple captured images associated with the user ID from the history DB 110a and generates a composite image including these multiple captured images. At this time, it is preferable that the image generation unit 170 identifies the location ID corresponding to each captured image, retrieves access information associated with the identified location ID from the location DB 120a, and generates the composite image by setting the access information corresponding to the area of ​​each captured image. By generating a composite image incorporating the access information corresponding to the area of ​​each captured image, the user can access store information, event information, etc. related to the location by clicking on each captured image embedded in the acquired composite image. Therefore, it is possible to encourage users to revisit each location.

[0038] The predetermined image generation conditions may further include payment history conditions. The payment history conditions may include, for example, that there is a payment history at at least one of the transit points and that the payment amount in the payment history is equal to or greater than a predetermined amount. In this case, the image generation unit 170 determines whether the payment history of the user who successfully performed facial recognition satisfies the conditions of the payment history.

[0039] The predetermined image generation conditions may further include successful facial recognition at a predetermined location. Successful facial recognition at a predetermined location means, for example, successful facial recognition at a specific location such as the final point of a stamp rally. In this case, the image generation unit 170 obtains the location ID of the captured image in which facial recognition was successful from the location DB 120a and determines whether the location ID is the location ID of the predetermined location.

[0040] The output unit 180 transmits the composite image generated by the image generation unit 170 to the terminal that successfully performed facial recognition or the terminal that requested the composite image via the network 500. The output unit 180 may also transmit the composite image to terminals other than the terminal that performed facial recognition and requested the composite image. For example, if facial recognition is performed from a store terminal, the output unit 180 may transmit the composite image to the store terminal, or it may transmit the composite image to a user terminal owned by the user who successfully performed facial recognition.

[0041] The authentication device 200 is a device that performs facial recognition of a user. The authentication device 200 is equipped with a facial feature database 210. The facial feature database 210 is a facial feature database that stores user IDs in association with the facial feature information of the user. The facial feature database 210 is an example of a facial feature information storage unit. The facial recognition terminal 300 is a terminal that takes images to be used for facial recognition. The facial recognition terminal 300 is a terminal that transmits the captured images to the visit promotion device 100a and makes a facial recognition request. The facial recognition terminals 300 are installed at each point A0 to An within region A. Specifically, facial recognition terminal 300A0 is installed at point A0, facial recognition terminal 300A1 is installed at point A1, facial recognition terminal 300A2 is installed at point A2, and facial recognition terminal 300An is installed at point An. When a user visits any of the locations A0 to An, they face the camera of the installed facial recognition terminal 300A0 to 300An to have their picture taken, and then make a purchase or other action at that location.

[0042] The user terminal 400 is a device owned by the user. The user terminal 400 is, for example, a communication device such as a smartphone, tablet, or PC. The user takes an image that includes their face using the facial recognition terminal 300 or the user terminal 400. The facial recognition terminal 300 or the user terminal 400 transmits the captured image to the visit promotion device 100a.

[0043] Next, the configuration of the authentication device 200 will be described in detail with reference to Figure 4. Figure 4 is a block diagram showing the configuration of the authentication device 200. The authentication device 200 comprises a face feature DB 210, a face detection unit 220, a feature point extraction unit 230, a registration unit 240, and an authentication unit 250.

[0044] The face feature database 210 is a face feature database that stores user IDs in association with the face feature information of the user. The face detection unit 220 detects the face region contained in the captured image and outputs it to the feature point extraction unit 230. The feature point extraction unit 230 extracts feature points from the face region detected by the face detection unit 220 and outputs face feature information to the registration unit 240. Face feature information is a collection of extracted feature points.

[0045] The registration unit 240 issues a new user ID when registering facial feature information. The registration unit 240 associates the issued user ID with the facial feature information extracted from the registered image and registers it in the facial feature DB 210. The authentication unit 250 compares the facial feature information extracted from the face image with the facial feature information in the facial feature DB 210. The authentication unit 250 determines that facial authentication was successful if the facial feature information matches, and that facial authentication failed if the facial feature information does not match. The authentication unit 250 returns the success or failure of facial authentication to the visit promotion device 100a. Whether or not the facial feature information matches corresponds to the success or failure of authentication. Furthermore, if facial authentication is successful, the authentication unit 250 identifies the user ID associated with the successful facial feature information and returns the authentication result, including the identified user ID and a statement that authentication was successful, to the visit promotion device 100a.

[0046] Referring to Figure 7, the operation of the authentication device 200 when registering the user ID and facial feature information in the facial feature database 210 will be explained. Figure 7 is a flowchart showing the flow of the facial feature information registration process. Figure 7 explains the case where the facial authentication terminal 300 takes an image and registers the facial feature information, but the same procedure can be used to register the facial feature information when the user terminal 400 takes an image.

[0047] When registering facial feature information, the facial recognition terminal 300 takes an image including the user's face as a registration image and sends a facial feature information registration request to the authentication device 200 via the network 500. The facial feature information registration request includes the registration image. First, the authentication device 200 obtains the registration image from the facial recognition terminal 300 or the user terminal 400 via the network 500 (step S201).

[0048] Next, the face detection unit 220 detects the face region included in the registration image (step S202) and outputs the detected face region to the feature point extraction unit 230. Next, the feature point extraction unit 230 extracts feature points from the face region and outputs face feature information to the registration unit 240 (step S203). Next, the registration unit 240 issues a user ID corresponding to the output face feature information and registers the user ID and face feature information in the face feature DB 210 (step S204).

[0049] Referring to Figure 8, the operation of the authentication device 200 during facial recognition will be explained. Figure 8 is a flowchart of the facial recognition process. Figure 8 explains the case when the facial recognition terminal 300 requests facial recognition, but the same procedure can be used when the user terminal 400 requests facial recognition.

[0050] When performing facial recognition, the facial recognition terminal 300 captures an image including the user's face as an authentication image and sends a facial recognition request to the visit promotion device 100a via the network 500. The facial recognition request includes the authentication image. First, the visit promotion device 100a transmits the facial region or facial feature information extracted from the authentication image to the authentication device 200. The feature point extraction unit 230 acquires facial feature information by extracting facial feature information from the received facial region or by receiving facial feature information (step S301).

[0051] Next, the authentication unit 250 compares the facial feature information acquired by the feature point extraction unit 230 with the facial feature DB 210 (step S302). If the facial feature information matches (step S303 Yes), the authentication unit 250 identifies the user ID of the user whose facial feature information matches (step S304) and sends a message to the visit promotion device 100a indicating that facial authentication was successful and the identified user ID (step S305). If no matching facial feature information is found (step S303 No), the authentication unit 250 sends a message to the visit promotion device 100a indicating that facial authentication failed (step S306).

[0052] Next, with reference to Figure 5, the configuration of the facial recognition terminal 300 will be described in detail. The facial recognition terminal 300 comprises, as a hardware configuration, a camera or other imaging device, a display device, and a computer. The facial recognition terminal 300 is a device that performs facial feature information registration requests and facial recognition requests. Examples of the facial recognition terminal 300 include, but are not limited to, a terminal that performs payment by facial recognition, a terminal that performs entry control by facial recognition, and digital signage that displays information in response to facial recognition.

[0053] Figure 5 is a block diagram showing the configuration of the facial recognition terminal 300. The facial recognition terminal 300 comprises a camera 310, a storage unit 320, a communication unit 330, a display unit 340, and a control unit 350. The camera 310 is an imaging device that captures images. The storage unit 320 is a storage device that stores programs for realizing each function of the facial recognition terminal 300. The communication unit 330 is a communication interface with the network 500. The display unit 340 is a display device that shows facial recognition results and composite images to the user. The control unit 350 controls the hardware of the facial recognition terminal 300. The control unit 350 comprises an imaging unit 352, a registration unit 353, an authentication unit 354, a payment unit 355, and a composite image request unit 356.

[0054] The imaging unit 352 requests the camera 310 to take a picture. The camera 310 takes an image including the user's face. The image taken by the camera 310 is used as a registration image and an authentication image. The registration unit 353 sends a face feature information registration request to the authentication device 200 via the network 500. The face feature information registration request includes the registration image taken by the camera 310. The authentication unit 354 sends a face authentication request to the visit promotion device 100a via the network 500. The face authentication request includes the authentication image taken by the camera 310. The authentication unit 354 receives the success or failure of face authentication from the visit promotion device 100a and displays the result on the display unit 340.

[0055] The settlement unit 355 executes the settlement process when facial recognition is successful. The control unit 350 may also include a recording unit (not shown) instead of the settlement unit 355. The recording unit records the user's entry and exit from the facility where the facial recognition terminal 300 is installed when facial recognition is successful. The composite image request unit 356 transmits a composite image request to the visit promotion device 100a via the network 500. The composite image request includes the settlement history, which is the result of the settlement process. The settlement history includes information such as the date and time of settlement, the amount, the item, and the user ID.

[0056] Next, the configuration of the user terminal 400 will be described in detail with reference to Figure 6. Figure 6 is a block diagram showing the configuration of the user terminal 400. The user terminal 400 includes a camera 410, a storage unit 420, a communication unit 430, a display unit 440, and a control unit 450. The control unit 450 includes a shooting unit 452, a registration unit 453, an authentication unit 454, a payment unit 455, and a composite image request unit 456. The functions of each component of the user terminal 400 are the same as those of each component of the facial recognition terminal 300, so their explanation will be omitted.

[0057] If facial recognition is successful, the facial recognition terminal 300 and the user terminal 400 perform payment processing and request history registration to register the history in the visit promotion device 100a. The operation of the facial recognition terminal 300 when requesting history registration will be explained below with reference to Figure 9. Figure 9 is a flowchart of the history registration process. Figure 9 explains the case where the facial recognition terminal 300 requests history registration, but the user terminal 400 can also make a history registration request using the same procedure.

[0058] First, the imaging unit 352 requests the camera 310 to take a picture, and the camera 310 takes an authentication image including the user's face (step S401). Next, the authentication unit 354 sends a face authentication request to the authentication device 200 via the network 500 (step S402) and receives the success or failure from the authentication device 200 (step S403). If face authentication is successful (step S404 Yes), the settlement unit 355 executes the settlement process (step S405), and the settlement unit 355 requests the visit promotion device 100a to register the history via the network 500 (step S406). If face authentication fails (step S405 No), the settlement unit 355 causes the display unit 340 to display that face authentication failed.

[0059] Although Figure 9 illustrates the case where payment processing is performed when facial recognition is successful, the facial recognition terminal 300 or user terminal 400 registers the history of various processes other than payment processing in the visit promotion device 100a using the same procedure. Examples of other processes include taking commemorative photos of users who have successfully undergone facial recognition.

[0060] Figure 10 is a flowchart showing the payment record processing flow. The history registration request transmitted in step S406 above includes the payment history. The payment history includes the user ID for successful facial recognition, the location ID of the facial recognition terminal 300, the date and time of payment, and payment information. When the visit promotion device 100a receives the history registration request, it retrieves the payment history included in the history registration request (step S501) and identifies the user ID included in the payment history (step S502). Next, it associates the identified user ID with the payment history and registers it in the history DB 110a (step S503). The same procedure is followed to register the history when performing various processing other than payment processing.

[0061] The visit promotion device 100a generates a composite image when facial recognition is successful or when a composite image request is received. For example, the visit promotion device 100a generates a composite image when the user successfully performs facial recognition at all points A0 to An within area A. The timing of the composite image request may also be arbitrarily specified by the user. The operation of the visit promotion device 100a when generating a composite image in response to a composite image request will be explained below with reference to Figure 11. Figure 11 is a flowchart showing the flow of the image generation process.

[0062] In the example shown in Figure 11, the predetermined image generation conditions are that facial recognition has been successful at m or more locations including the specific location, and that there is a payment history at any of the locations where facial recognition was successful (where m is a natural number between 2 and n, inclusive). First, when the acquisition unit 130 receives a composite image request (step S601), the image generation unit 170 determines whether or not facial recognition was successful at the specific location (step S602). Specifically, the image generation unit 170 reads the transit points associated with the user ID included in the composite image request from the history DB 110a and determines whether or not the specific location is included in the read transit points. Since the transit points registered in the history DB 110a are locations where facial recognition was successful, if the specific location is included in the transit points, it can be said that facial recognition was successful at the specific location. If facial recognition was not successful at the specific location (step S602No), the image generation unit 170 outputs a statement indicating that it cannot provide a composite image (step S608).

[0063] If facial recognition is successful at a specific location (step S602 Yes), the image generation unit 170 determines whether the number of locations visited by the user is m or more (step S603). If the number of locations visited is less than m (step S603 No), the image generation unit 170 outputs that it cannot provide a composite image (step S608). If the number of locations visited is m or more (step S603 Yes), the image generation unit 170 determines whether there is a payment history at any of the locations where facial recognition was successful (step S604). If there is no payment history at any of the locations where facial recognition was successful (step S604 No), the image generation unit 170 outputs that it cannot provide a composite image (step S608).

[0064] If there is a payment history at any point where facial recognition was successful (step S604 Yes), the image generation unit 170 retrieves multiple captured images associated with the user ID from the history DB 110a (step S605). Next, the image generation unit 170 generates a composite image including the retrieved multiple captured images (step S606) and outputs the composite image to a predetermined display terminal (step S607). The predetermined display terminal receives the composite image via the network 500 and displays it on its screen.

[0065] Figure 12 shows an example of a composite image. As shown in Figure 12, the composite image has images taken by the user at each location embedded within it. By embedding images taken by the user, the originality of the composite image can be increased. The composite image may also include the date, the user's name, and the names of each location.

[0066] Furthermore, each image and the name of each location included in the composite image may have a link to access detailed information about that location. Examples of detailed information for each location include the type of store and a map. When a user clicks a link, for example, detailed information about the location and payment information for that location may be displayed. Alternatively, when a user clicks a link, a screen for posting to a social networking service (SNS) may be displayed. If a user posts from this posting screen, the system may support the presentation of recommendation information to other users based on that post.

[0067] Next, referring to Figures 13-15, we will explain the operation of the visit promotion system 600 when a user visits each location A0, A1, A2, and An in that order and makes a payment at location A2. Figures 13-15 are sequence charts showing an example of the operation of the visit promotion system according to Embodiment 2.

[0068] As shown in Figure 13, the user first takes a picture using the facial recognition terminal 300A0 or the user terminal 400. The terminal that took the picture sends a facial information registration request to the authentication device 200 via the network 500 (step S701). The facial information registration request is a request to register the user's facial feature information. The facial information registration request includes the captured image. When the authentication device 200 receives the facial information registration request, it issues a new user ID and registers the user ID and the facial feature information extracted from the captured image in the facial feature DB 210.

[0069] Next, the user moves to location A1 and takes a picture using the facial recognition terminal 300A1 or the user terminal 400. The terminal that took the picture sends a facial recognition request to the visit promotion device 100a via the network 500 (step S702). When the visit promotion device 100a receives the facial recognition request, it extracts the face region or facial feature information from the captured image included in the facial recognition request and sends it to the authentication device 200 (step S703). If the authentication device 200 receives a face region, it extracts facial feature information from the face region and performs facial recognition by comparing the facial feature information with the facial feature information registered in the facial feature DB 210. If the authentication device 200 receives facial feature information, it performs facial recognition by comparing the facial feature information with the facial feature information registered in the facial feature DB 210.

[0070] Next, the authentication device 200 transmits the facial recognition result to the visit promotion device 100a (step S704). If facial recognition is successful, the facial recognition result includes a message indicating that facial recognition was successful and the user ID of the user whose facial recognition was successful. The visit promotion device 100a transmits the received facial recognition result to the facial recognition terminal 300A1 or the user terminal 400 (step S705). The visit promotion device 100a also associates the captured image received in step S702 with the user ID included in the facial recognition result received in step S704 and records it in the history DB 110a. Next, the user moves to location A2.

[0071] Next, as shown in Figure 14, the user takes a picture using the facial recognition terminal 300A2 or the user terminal 400. The terminal that took the picture sends a facial recognition request to the visit promotion device 100a via the network 500 (step S801). When the visit promotion device 100a receives the facial recognition request, it extracts the face region or face feature information from the captured image included in the facial recognition request and sends it to the authentication device 200 (step S802). The authentication device 200 performs facial recognition based on the received face region or face feature information and sends the facial recognition result to the visit promotion device 100a (step S803).

[0072] The visit promotion device 100a transmits the received facial recognition result to the facial recognition terminal 300A2 or the user terminal 400 (step S804). The visit promotion device 100a also associates the captured image received in step S801 with the user ID included in the facial recognition result received in step S803 and records it in the history DB 110a. Next, the user performs payment processing at the facial recognition terminal 300A2 or the user terminal 400. The terminal that performed the payment processing sends a history registration request to the visit promotion device 100a via the network 500 (step S805). The history registration request includes the user ID that successfully performed facial recognition, the location ID of the facial recognition terminal 300, the payment date and time, and payment information, etc. When the visit promotion device 100a receives the history registration request, it associates the user ID included in the history registration request with the payment history and records it in the history DB 110a. Next, the user moves to location An.

[0073] Next, as shown in Figure 15, the user takes a picture using the facial recognition terminal 300An or the user terminal 400. The terminal that took the picture sends a facial recognition request to the visit promotion device 100a via the network 500 (step S901). When the visit promotion device 100a receives the facial recognition request, it extracts the face region or face feature information from the captured image included in the facial recognition request and sends it to the authentication device 200 (step S902). The authentication device 200 performs facial recognition based on the received face region or face feature information and sends the facial recognition result to the visit promotion device 100a (step S903).

[0074] The visit promotion device 100a transmits the received facial recognition result to the facial recognition terminal 300An or the user terminal 400 (step S904). The visit promotion device 100a also associates the captured image received in step S901 with the user ID included in the facial recognition result received in step S903 and records it in the history DB 110a. Next, the facial recognition terminal 300An or the user terminal 400 transmits a composite image request to the visit promotion device 100a via the network 500, as specified by the user (step S905). The composite image request includes the user ID. The facial recognition terminal 300An or the user terminal 400 may transmit a composite image request to the visit promotion device 100a without user specification if predetermined image generation conditions are met.

[0075] When the visit promotion device 100a receives a composite image request, it retrieves the passpoints and payment history associated with the user ID included in the composite image request from the history DB 110a and determines whether the predetermined image generation conditions are met. If the predetermined image generation conditions are met, the visit promotion device 100a retrieves multiple captured images associated with the user ID from the history DB 110a and generates a composite image. Next, the visit promotion device 100a transmits the generated composite image to the face recognition terminal 300An or the user terminal 400 (step S906). The terminal that receives the composite image displays the composite image on its screen.

[0076] Furthermore, if the user's transit points and payment history do not meet the predetermined image generation conditions, the output unit 180 may transmit information indicating the conditions necessary to satisfy the predetermined image generation conditions (for example, visit promotion information described later) to the facial recognition terminal 300An or the user terminal 400.

[0077] Here, Figure 16 is an example of a map displayed on a display terminal. Figure 16 shows the case where payment history is displayed on the user terminal 400. As shown in Figure 16, the user terminal 400 may display the user's transit points and payment history on the map. Figure 17 is an example of a payment history displayed on a display terminal. As shown in Figure 17, the user terminal 400 may display the user's payment history in chronological order.

[0078] Figures 16 and 17 show a case where only the user's payment history is displayed on the display terminal, but in addition to the payment history, visit promotion information may also be displayed on the display terminal. Visit promotion information is information about visit promotion locations. Visit promotion locations are, for example, locations that the user has not yet visited and that need to be visited in order to meet predetermined image generation conditions. Visit promotion locations may also be locations that the user has already visited and for which a payment exceeding a predetermined amount has not been made.

[0079] Furthermore, the information on recommended visit locations may include route guidance from the user's current location to the recommended visit location. Route guidance may include the distance and estimated time from the user's current location to the recommended visit location. In addition, multiple recommended visit information items may be displayed on the display terminal. When multiple recommended visit information items are displayed, the details and route guidance of each recommended visit information item may be displayed simultaneously. The user can review the details and route guidance of each recommended visit information item and compare them with each other.

[0080] Figures 18-20 illustrate example visit promotion screens displayed on a display terminal. These screens may display at least visit promotion information, and may also display the user's visited locations and payment history. Furthermore, the visit promotion screens shown in Figures 18-20 may include links to access detailed information for each location. When the user clicks a link to a location, the visit promotion screen may display detailed information for that location.

[0081] Figure 18 shows an example of a visit promotion screen when the predetermined image generation condition is to visit all 10 locations A0 to A9. As shown in Figure 18, the visit promotion screen displays, for example, which locations the user has visited so far. The visit promotion screen may also display which locations need to be visited to satisfy the predetermined image generation condition, and the number of locations that need to be visited to satisfy the predetermined image generation condition. Specifically, as shown in Figure 18, the number of locations that need to be visited to satisfy the predetermined image generation condition is 10, and the user has visited 3 locations so far. In this case, it may display that the composite image can be obtained after visiting 7 more locations.

[0082] Figure 19 shows an example of a visit promotion screen when the predetermined image generation condition is that the total amount of payments made at five locations A0 to A4 is 2000 yen or more. As shown in Figure 19, the visit promotion screen displays, for example, the amount of payments made by the user at each location A0 to A4. The visit promotion screen may also display the purchase amount required to satisfy the predetermined image generation condition. Specifically, as shown in Figure 19, if the total purchase amount required to satisfy the predetermined image generation condition is 2000 yen, and the current total purchase amount is 1500 yen, it may display that the composite image can be obtained by purchasing an additional 500 yen.

[0083] Figure 20 shows an example of a visit promotion screen when the predetermined image generation condition is to make a payment of 500 yen or more at each location A0 to A4. As shown in Figure 20, the visit promotion screen displays, for example, the amount of payment made by the user at each location A0 to A4. The visit promotion screen may also display the purchase amount at each location A0 to A4 required to satisfy the predetermined image generation condition, and the number of locations that need to be visited to satisfy the predetermined image generation condition. Specifically, as shown in Figure 20, suppose the purchase amount required to satisfy the predetermined image generation condition is 500 yen or more at each location, and currently the purchase amount at two locations is 500 yen or more, and the purchase amount at one location is 200 yen. In this case, it may display that a composite image can be obtained by visiting two more locations and making a purchase of 500 yen or more, and then making an additional purchase of 300 yen at the location where a 200 yen purchase has already been made.

[0084] <Embodiment 3> Embodiment 3 is a modification of Embodiments 1 and 2 described above. The visit promotion devices 100, 100a and 700 in Embodiments 1 and 2 performed facial recognition using an external authentication device 200. On the other hand, the visit promotion device 800 according to this embodiment performs facial recognition internally.

[0085] Figure 21 is a block diagram showing the configuration of the visit promotion device 800 according to Embodiment 3. Compared to the configuration of the visit promotion device 100 shown in Figure 1, the visit promotion device 800 has the authentication control unit 140 replaced by a face feature extraction unit 140a and a face authentication unit 190, and a face feature DB 191 (not shown) is added. The face feature DB 191 is an example of a face feature information storage unit. For each component of the visit promotion device 800, explanations that overlap with Embodiment 2 will be omitted as appropriate. Figure 22 is a block diagram showing the configuration of the visit promotion system 900 according to Embodiment 3. The visit promotion system 900 differs from the visit promotion system 600 in that it does not have an authentication device 200 and has a visit promotion device 800. Other components are the same, so explanations will be omitted as appropriate.

[0086] The face feature extraction unit 140a extracts face regions or face feature information from the captured image. The face authentication unit 190 performs face authentication based on the extracted face regions or face feature information. The face feature DB 191 is a face feature database that stores user IDs in association with the user's face feature information. The visit promotion device 800 generates a composite image in the same manner as the visit promotion device 100, following the flow shown in Figure 2. However, in step S103, the face feature extraction unit 140a extracts face regions or face feature information from the captured image acquired by the acquisition unit 130, and the face authentication unit 190 performs face authentication based on the extracted face regions or face feature information. Furthermore, the visit promotion device according to this embodiment can achieve the same effects as those described in Embodiments 1 and 2.

[0087] Although the above embodiments were described as hardware configurations, the invention is not limited thereto. This disclosure can also be implemented by having the CPU execute computer programs to perform any desired processing.

[0088] In the above example, the program can be stored and supplied to the computer using various types of non-transitory computer-readable medium. Non-transitory computer-readable medium includes various types of tangible storage medium. Examples of non-transitory computer-readable medium include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, DVDs (Digital Versatile Discs), and semiconductor memory (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs (Random Access Memory)). Alternatively, the program may be supplied to the computer by various types of transient computer-readable medium. Examples of transient computer-readable medium include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable medium can be supplied to the computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels.

[0089] This disclosure is not limited to the embodiments described above, and may be modified as appropriate without departing from its spirit. Furthermore, this disclosure may be implemented by combining the respective embodiments as appropriate.

[0090] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0091] (Note A1) An acquisition unit that acquires images taken by the user, An authentication control unit that extracts the user's face region or facial feature information from the captured image and causes the authentication device to perform facial authentication, An image generation unit that generates a composite image including images taken at each location of a user who has successfully undergone facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met. An output unit that transmits the composite image generated by the image generation unit to a designated display terminal, A visit-promoting device equipped with the following features.

[0092] (Appendix A2) The predetermined image generation conditions include the successful completion of facial recognition at two or more of the multiple locations, and the existence of a payment history for the user at at least one of those two or more locations. The visitation support device described in Appendix A1.

[0093] (Note A3) The output unit is, If the predetermined image generation conditions are not met at the location where facial recognition was successful, information indicating the conditions necessary to satisfy those image generation conditions is transmitted to the display terminal. Visiting propulsion device as described in Appendix A1 or A2.

[0094] (Note A4) moreover, The system includes an authentication recording unit that, upon successful facial recognition, records the user ID of the successful facial recognition and the captured image in association with each other in a history storage unit. The image generation unit obtains a captured image associated with the user ID of the user who successfully performed the facial recognition from the history storage unit, and generates a composite image using the captured image. A visit-promotion device as described in any one of the appendices A1 to A3.

[0095] (Note A5) Furthermore, the system includes a payment recording unit that records the payment history and the user ID included in the payment history in association with each other in the history storage unit. The aforementioned predetermined image generation conditions include payment history conditions, The image generation unit determines whether the payment history of the user who successfully performed the facial recognition satisfies the predetermined conditions for payment history. Visiting support device as described in Appendix A4.

[0096] (Note A6) Furthermore, it includes a location storage unit that stores the location ID in the captured image in association with the access information of that location. The image generation unit obtains access information associated with the location ID of the captured image from the location storage unit, and generates the composite image by incorporating the access information. A visit-promotion device as described in any one of the appendices A1 to A5.

[0097] (Note A7) The predetermined image generation conditions include successful facial recognition at a predetermined location. The image generation unit obtains the location ID in the captured image for which facial recognition was successful from the location storage means, and determines whether the location ID is the location ID of the predetermined location. Visiting propulsion device as described in Appendix A6.

[0098] (Note B1) A predetermined imaging device that captures an image including the user's face area, A visitor propulsion device capable of communicating with the aforementioned predetermined imaging device, The system includes an authentication device that stores the user's facial feature information and can communicate with the visit promotion device, The aforementioned visit promotion device is An acquisition unit that acquires images captured by the user using the predetermined shooting device, An authentication control unit that extracts the user's face region or facial feature information from the captured image and causes the authentication device to perform facial authentication, An image generation unit that generates a composite image including images taken at each location of a user who has successfully undergone facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met. An output unit that transmits the composite image generated by the image generation unit to a designated display terminal, A visit promotion system equipped with the following features.

[0099] (Note B2) The predetermined image generation conditions are that facial recognition is successful at two or more of the multiple locations, and that a payment history exists for the user at at least one of those two or more locations. The visit promotion system described in Appendix B1.

[0100] (Note C1) Computers The process of acquiring images taken by the user, The process involves extracting the user's face region or facial feature information from the captured image and having the authentication device perform facial authentication. A step of generating a composite image including images taken at each location of the user who successfully achieved facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met, The steps include transmitting the generated composite image to a designated display terminal, A visit promotion method that includes the following features.

[0101] (Note D1) The process of acquiring images taken by the user, The process involves extracting the user's face region or facial feature information from the captured image and having the authentication device perform facial authentication. A step of generating a composite image including images taken at each location of the user who successfully achieved facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met, The steps include transmitting the generated composite image to a designated display terminal, A non-temporary, computer-readable medium containing a visit promotion program that causes a computer to execute a certain action.

[0102] (Note E1) An acquisition unit that acquires images taken by the user, An extraction unit that extracts a face region or facial feature information from the aforementioned captured image, A face recognition unit that performs face recognition based on the aforementioned face region or the aforementioned face feature information, An image generation unit that generates a composite image including images taken at each location of a user who has successfully undergone facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met. An output unit that transmits the composite image generated by the image generation unit to a designated display terminal, A visit-promoting device equipped with the following features.

[0103] (Note E2) The predetermined image generation conditions are that facial recognition is successful at two or more of the multiple locations, and that a payment history exists for the user at at least one of those two or more locations. Visiting propulsion device as described in Appendix E1.

[0104] (Note F1) Computers The process of acquiring images taken by the user, A step of extracting a face region or facial feature information from the aforementioned captured image, A step of performing facial recognition based on the aforementioned facial region or facial feature information, A step of generating a composite image including images taken at each location of the user who successfully achieved facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met, The steps include transmitting the generated composite image to a designated display terminal, A visit promotion method that includes the following features.

[0105] (Note G1) The process of acquiring images taken by the user, A step of extracting a face region or facial feature information from the aforementioned captured image, A step of performing facial recognition based on the aforementioned facial region or facial feature information, A step of generating a composite image including images taken at each location of the user who successfully achieved facial recognition, when predetermined image generation conditions based on facial recognition at multiple locations are met, The steps include transmitting the generated composite image to a designated display terminal, A non-temporary, computer-readable medium containing a visit promotion program that causes a computer to execute a certain action.

[0106] Although the present invention has been described above with reference to embodiments (and examples), the present invention is not limited to the above embodiments (and examples). Various modifications to the structure and details of the present invention can be made, which can be understood by those skilled in the art within the scope of the present invention. [Explanation of Symbols]

[0107] 100, 100a, 800 visit propulsion device 600, 900 Visit Promotion System 110a History DB 120a Point DB 130 Acquisition Department 140 Authentication Control Unit 140a Facial Feature Extraction Unit 150 Authentication Record Section 160 Payment Records Department 170 Image generation unit 180 Output section 190 Facial Recognition Section 191 Facial Features Database 200 Authentication Devices 210 Facial Feature Database 220 Face detection unit 230 Feature point extraction unit 240 Registration Department 250 Certification Department 300 (300A0~300An) Facial Recognition Terminal 310 Camera 320 Storage section 330 Communications Department 340 Display section 350 Control Unit 352 Photography Department 353 Registration Department 354 Certification Department 355 Payment Department 356 Composite Image Request Unit 400 user terminals 410 Camera 420 Storage section 430 Communications Department 440 Display section 450 Control Unit 452 Photography Department 453 Registration Department 454 Authentication Department 455 Payment Department 456 Composite Image Request Unit 500 Networks

Claims

1. An acquisition unit that acquires facial information from terminals installed at multiple locations, capturing the user's face. An authentication control unit that performs facial authentication by matching the aforementioned facial information with pre-registered facial information, If the number of locations where a predetermined amount or more has been paid based on the facial recognition is two or more predetermined numbers, the predetermined service is provided to the user, and if the number of locations where the payment has been made is less than the predetermined number, the output unit provides the user with visit promotion information necessary for the user to receive the predetermined service. An information processing device equipped with the following features.

2. The visit promotion information includes route guidance information from the user's current location to a location that the user has not yet visited. The information processing apparatus according to claim 1.

3. The visit promotion information includes route guidance information from the user's current location to a location that the user has already visited and has not made a payment exceeding a predetermined amount. The information processing apparatus according to claim 1 or 2.

4. Facial information is obtained from terminals installed at multiple locations, capturing the user's face. Facial recognition is performed by comparing the aforementioned facial information with pre-registered facial information. If the number of locations where a payment of a predetermined amount or more has been made based on the facial recognition is two or more predetermined numbers, the predetermined service will be provided to the user. If the number of locations where the payment has been made is less than the predetermined number, the user will be provided with visit promotion information necessary for the user to receive the predetermined service. An information processing method that enables a computer to perform a task.

5. A function to acquire facial information from images of the user's face taken at terminals installed at multiple locations, A function that performs facial recognition by matching the aforementioned facial information with pre-registered facial information, If the number of locations where a payment of a predetermined amount or more has been made based on the facial recognition is two or more predetermined numbers, the predetermined service will be provided to the user; if the number of locations where the payment has been made is less than the predetermined number, the function will provide the user with visit promotion information necessary for the user to receive the predetermined service. A program to make a computer realize this.

Images