Information processing apparatus, information processing method, and program

Abstract

To provide a visit promotion device for providing information in which visit of respective points is recorded, to a user who has actually visited the respective points.SOLUTION: A visit promotion device (100) comprises: an acquisition unit (130) that acquires a photographed image obtained by photographing a user; an authentication control unit (140) that extracts a face area or face feature information of the user from the photographed image and causes an authentication device (200) to perform face authentication; an image creation unit (170) that, when a predetermined image creation condition based on the face authentication at a plurality of points is satisfied, creates a composite image including the photographed images at respective points for the user who has succeeded in the face authentication; and an output unit (180) that transmits the composite image created by the image creation unit (170) to a predetermined display terminal.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a visit promotion device, a system, a method, and a non-transitory computer-readable medium having a program stored thereon, and more particularly to a visit promotion device, a system, a method, and a non-transitory computer-readable medium having a program stored thereon for promoting a user's visit. [Background technology]

[0002] Patent Document 1 discloses a technology for so-called stamp rallies (point rallies), in which participants accomplish a goal by visiting multiple locations, in which facial recognition is performed using cameras installed at each location to verify that the person has visited each location. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-41416 A Summary of the Invention [Problem to be solved by the invention]

[0004] Here, a stamp rally can be used to promote the purchase of goods (payment) when actually visiting various points in the region for the purpose of revitalizing the region, etc. However, the technology disclosed in Patent Document 1 does not fully utilize the stamp rally.

[0005] The present disclosure has been made to solve such problems, and aims to provide a visit promotion device, system, method, and non-transitory computer-readable medium on which a program is stored for providing information recording visits to each location to users who have actually visited each location. [Means for solving the problem]

[0006] The visit promotion device of the present disclosure comprises an acquisition unit that acquires an image taken by a user, an authentication control unit that extracts the user's facial area or facial feature information from the captured image and causes an authentication device to perform facial authentication, an image generation unit that generates a composite image including images taken at each location of the user who has successfully been authenticated when specified image generation conditions based on the facial authentication at multiple locations are satisfied, and an output unit that transmits the composite image generated by the image generation unit to a specified display terminal.

[0007] The visit promotion system of the present disclosure comprises a designated photographing device that captures an image including a user's facial area, a visit promotion device capable of communicating with the designated photographing device, and an authentication device that stores facial feature information of the user and is capable of communicating with the visit promotion device. The visit promotion device comprises an acquisition unit that acquires an image captured by a user using the designated photographing device, an authentication control unit that extracts the user's facial area or facial feature information from the captured image and causes an authentication device to perform facial authentication, an image generation unit that generates a composite image including images captured at each location of a user who has successfully been authenticated when designated image generation conditions based on the facial authentication at multiple locations are satisfied, and an output unit that transmits the composite image generated by the image generation unit to a designated display terminal.

[0008] The visit promotion method according to the present disclosure includes a step of a computer acquiring an image taken by a user, a step of extracting facial areas or facial feature information of the user from the captured image and having an authentication device perform facial authentication, a step of generating a composite image including images taken at each location of the user whose facial authentication was successful when specified image generation conditions based on the facial authentication at multiple locations are satisfied, and a step of transmitting the generated composite image to a specified display terminal.

[0009] A non-transitory computer-readable medium according to the present disclosure has recorded thereon a program that executes the steps of acquiring an image captured by a user, extracting facial area or facial feature information of the user from the captured image and causing an authentication device to perform facial authentication, generating a composite image including captured images captured at each of the locations of the user whose facial authentication was successful when specified image generation conditions based on the facial authentication at multiple locations are satisfied, and transmitting the generated composite image to a specified display terminal.

[0010] The visit promotion device of the present disclosure comprises an acquisition unit that acquires an image taken by a user, an extraction unit that extracts a facial area or facial feature information from the captured image, a facial authentication unit that performs facial authentication based on the facial area or the facial feature information, an image generation unit that generates a composite image including images taken at each location of a user who has successfully been authenticated when specified image generation conditions based on the facial authentication at multiple locations are satisfied, and an output unit that transmits the composite image generated by the image generation unit to a specified display terminal.

[0011] The visit promotion method of the present disclosure includes a step of a computer acquiring a photographed image taken by a user, a step of extracting a facial area or facial feature information from the photographed image, a step of performing facial authentication based on the facial area or the facial feature information, a step of generating a composite image including photographed images taken at each location of the user who has successfully been authenticated when specified image generation conditions based on the facial authentication at multiple locations are satisfied, and a step of transmitting the generated composite image to a specified display terminal.

[0012] A non-transitory computer-readable medium according to the present disclosure has recorded thereon a program that executes the steps of acquiring an image captured by a user, extracting a facial area or facial feature information from the captured image, performing facial authentication based on the facial area or the facial feature information, and, when predetermined image generation conditions based on the facial authentication at multiple locations are satisfied, generating a composite image including images captured at each location of the user whose facial authentication was successful, and transmitting the generated composite image to a predetermined display terminal. Effect of the Invention

[0013] The present disclosure makes it possible to provide a visit promotion device, system, method, and non-transitory computer-readable medium having stored thereon a program for providing information recording visits to each location to users who have actually visited each location. [Brief description of the drawings]

[0014] [Figure 1] 1 is a block diagram showing a configuration of a visit promotion device according to a first embodiment. [Diagram 2] 1 is a flowchart showing the flow of a visit promotion method according to the first embodiment. [Diagram 3] FIG. 11 is a block diagram showing the configuration of a visit promotion system according to a second embodiment. [Figure 4] FIG. 2 is a block diagram showing a configuration of an authentication device. [Diagram 5] FIG. 2 is a block diagram showing a configuration of a face recognition terminal. [Figure 6] FIG. 2 is a block diagram showing the configuration of a user terminal. [Figure 7] 13 is a flowchart showing the flow of a facial feature information registration process. [Figure 8] 11 is a flowchart showing a flow of face authentication processing. [Figure 9] 13 is a flowchart showing the flow of an authentication recording process. [Figure 10] 13 is a flowchart showing the flow of a payment recording process. [Figure 11] 13 is a flowchart showing the flow of an image generating process. [Figure 12] 1 is an example of a composite image. [Figure 13] 13 is a sequence chart showing an example of an operation of the visit promotion system according to the second embodiment. [Figure 14] 13 is a sequence chart showing an example of an operation of the visit promotion system according to the second embodiment. [Figure 15] 13 is a sequence chart showing an example of an operation of the visit promotion system according to the second embodiment. [Figure 16] FIG. 13 is a diagram illustrating an example of a map displayed on a display terminal. [Figure 17] FIG. 13 is a diagram illustrating an example of a payment history displayed on a display terminal. [Figure 18] FIG. 13 is a diagram illustrating an example of a visit promotion screen displayed on a display terminal. [Figure 19] FIG. 13 is a diagram illustrating an example of a visit promotion screen displayed on a display terminal. [Figure 20] FIG. 13 is a diagram illustrating an example of a visit promotion screen displayed on a display terminal. [Figure 21] FIG. 11 is a block diagram showing the configuration of a visit promotion device according to a third embodiment. [Figure 22] FIG. 11 is a block diagram showing the configuration of a visit promotion system according to a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and duplicated descriptions will be omitted as necessary for clarity of explanation.

[0016] <Embodiment 1> Fig. 1 is a block diagram showing the configuration of a visit promotion device 100 according to the first embodiment. The visit promotion device 100 includes an acquisition unit 130, an authentication control unit 140, an image generation unit 170, and an output unit 180. The visit promotion device 100 is connected to a network 500 (not shown). The network 500 may be wired or wireless. An authentication device 200 and a face authentication terminal 300 (not shown) are connected to the network 500.

[0017] The acquisition unit 130 acquires a captured image taken by a user. The captured image is an image including the user's face. The captured image is captured by a predetermined photographing device. The predetermined photographing device is, for example, a camera provided in the face authentication terminal 300 and a camera in a user terminal such as a smartphone carried by the user. The authentication control unit 140 extracts the user's face area or facial feature information from the captured image and causes the authentication device 200 to perform face authentication. The authentication device 200 previously stores a user ID and the facial feature information of the user in association with each other.

[0018] When a predetermined image generation condition based on face authentication at a plurality of points is satisfied, the image generating unit 170 generates a composite image including images taken at each point of the user who has successfully been face authenticated. The predetermined image generation condition is a condition for generating a composite image to be presented to the user. The predetermined image generation condition is, for example, face authentication being performed at a specific point, face authentication being performed at a predetermined number of points or more, and payment being performed at any point. The output unit 180 transmits the composite image generated by the image generating unit 170 to a predetermined display terminal. The predetermined display terminal is, for example, a face authentication terminal 300, a user terminal, a store terminal, or a signage on the street. The user terminal is a communication terminal such as a smartphone carried by the user. The store terminal is a terminal installed in each store, and displays, for example, "How about going to XX next?" when the user leaves the store.

[0019] The predetermined display terminal may be the above-mentioned predetermined photographing device, or may be a different terminal. For example, when a photographed image is photographed by a user terminal, the output unit 180 may transmit the composite image to the user terminal, or may transmit the composite image to the face authentication terminal 300, etc. When a photographed image is photographed by the face authentication terminal 300, the output unit 180 may transmit the composite image to the face authentication terminal 300, or may transmit the composite image to the user terminal, etc.

[0020] FIG. 2 is a flowchart showing the flow of the visit promotion method according to the first embodiment. First, the acquisition unit 130 acquires a photographed image of the user (step S101). Next, the authentication control unit 140 extracts the face area or facial feature information of the user from the photographed image acquired by the acquisition unit 130, and causes the authentication device 200 to perform face authentication (step S102). The authentication device 200 collates the face area or facial feature information received from the authentication control unit 140 with the facial feature information registered in the authentication device 200, judges whether the authentication is successful or not depending on the presence or absence of a match, and returns the judgment result. It is assumed that the authentication device 200 stores the user ID and the facial feature information in association with each other. Then, when the authentication device 200 succeeds in the face authentication, it returns the judgment result including the successful user ID.

[0021] Next, when a predetermined image generation condition based on face authentication at a plurality of locations is satisfied, the image generating unit 170 generates a composite image including images taken at each location of the user who has successfully been face authenticated (step S103). Next, the output unit 180 transmits the composite image generated by the image generating unit 170 to a predetermined display terminal (step S104). In this way, the visit promotion method according to this embodiment can provide information recording visits to each location to users who have actually visited each location.

[0022] The visit promotion device 100 may include components such as a history storage unit, a location storage unit, an authentication recording unit, and a payment recording unit in addition to the components shown in FIG.

[0023] The history storage unit stores the user's ID, passing points, passing date and time, captured images, and payment history. The point storage unit stores the point ID and access information for the point in association with each other. When face authentication is successful, the authentication recording unit records the user ID whose face authentication was successful and the captured image in association with each other in the history storage unit. The payment recording unit records the payment history in association with the user ID included in the payment history in the history storage unit.

[0024] The visit promotion device 100 includes a processor, a memory, and a storage device, which are not shown in the figure. The storage device stores a computer program that implements the processing of the visit promotion method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. As a result, the processor realizes the functions of the acquisition unit 130, authentication control unit 140, authentication recording unit, payment recording unit, image generation unit 170, and output unit 180.

[0025] Alternatively, the acquisition unit 130, the authentication control unit 140, the authentication recording unit, the payment recording unit, the image generation unit 170, and the output unit 180 may each be realized by dedicated hardware. Also, a part or all of the components of each device may be realized by a general-purpose or dedicated circuit, processor, or a combination of these. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. A part or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program. Also, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), etc. may be used as the processor.

[0026] In addition, when some or all of the components of the visit promotion device 100 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally arranged or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., in a form in which each is connected via a communication network. In addition, the functions of the visit promotion device 100 may be provided in a SaaS (Software as a Service) format.

[0027] <Embodiment 2> The second embodiment is a specific example of the first embodiment described above. Fig. 3 is a block diagram showing the configuration of a visit promotion system 600 according to the second embodiment. The visit promotion system 600 includes at least a visit promotion device 100a and an authentication device 200, and further includes at least one of a face authentication terminal 300 and a user terminal 400. The visit promotion device 100a, the authentication device 200, the face authentication terminals 300 (300A0, 300A1, 300A2, and 300An), and the user terminal 400 are each connected via a network 500. Note that explanations that overlap with the first embodiment will be omitted as appropriate.

[0028] The visit promotion device 100a includes a history DB (DataBase) 110a, a location DB 120a, an acquisition unit 130, an authentication control unit 140, an authentication recording unit 150, a payment recording unit 160, an image generation unit 170, and an output unit 180. The visit promotion device 100a is an information processing device that generates and presents a user's visit history, payment history, and composite image, and is, for example, a server device realized by a computer.

[0029] The history DB 110a is a database for storing the user's passing points, captured images, and payment history. The history DB 110a is an example of a history storage unit. The history DB 110a stores a user ID, the user's passing points, the passing date and time at the passing points, the captured images at the passing points, and the user's payment history in association with each other. The user's passing points are, for example, the installation location of the face authentication terminal 300 where the user has successfully undergone face authentication. The installation location of the face authentication terminal 300 is, for example, the identification information of points A0, A1, A2, and An (where n is a natural number, hereinafter referred to as "points A0 to An"), i.e., the point ID. The passing date and time are the date and time when the user visited each of the points A0 to An.

[0030] The points A0 to An are, for example, checkpoints for a stamp rally using face recognition within the area A. The user can record in the visit promotion device 100a that he or she has passed the checkpoint by visiting each of the points A0 to An and performing face recognition with the face recognition terminal 300 or the user terminal 400. The user can register face information at the start point (for example, point A0), and obtain a composite image if face recognition is successful at the goal point (for example, point An). Note that if each of the points A0 to An is a store, the user can make a payment for a product purchase together with face recognition.

[0031] The date and time of visit is, for example, the date and time when the user succeeded in face authentication and the date and time when the user took the captured image. The captured image is an image taken during face authentication, and includes at least the user's face and may also include the background of the location. The payment history is information including the user ID of the user, the location ID of the face authentication terminal, the date and time of payment, and payment information. The payment information is, for example, the purchased items and the purchase amount. The payment history registered in the history DB 110a may be face recognition payment or other payment methods.

[0032] The location DB 120a is a database that manages the location IDs of the locations A0 to An in association with access information. The location DB 120a is an example of a location storage unit. The access information is, for example, link information to web information corresponding to each location A0 to An, specifically, a URL (uniform resource locator) or the like.

[0033] The acquisition unit 130 receives a face authentication request, a history registration request, and a composite image request from the face authentication terminal 300 or the user terminal 400 via the network 500. In other words, the acquisition unit 130 acquires, from the face authentication terminal 300 or the user terminal 400, an image captured by the camera 310 or 410, and installation position information of the camera 310 or 410 (hereinafter simply referred to as "installation position"), etc.

[0034] The authentication control unit 140 extracts a face area or facial feature information from the authentication image included in the face authentication request, and transmits the face area or facial feature information to the authentication device 200 to perform face authentication. The authentication control unit 140 also receives a result of face authentication from the authentication device 200, and returns the face authentication result to the requesting terminal. If face authentication is successful, the face authentication result includes a user ID.

[0035] When the face authentication is successful, the authentication recording unit 150 records the user ID whose face authentication has been successful, the captured image, the passing point, and the passing date and time in the history DB 110a in association with each other. The captured image is, for example, the image used for face authentication. Although details will be described later, when the face authentication is successful, the face authentication terminal 300 or the user terminal 400 performs various processes such as payment processing. When various processes such as payment processing are performed, the authentication recording unit 150 records the user ID whose face authentication has been successful, the captured image, the passing point, and the passing date and time in the history DB 110a in association with each other. When the payment recording unit 160 receives a payment history recording request, it identifies the user ID included in the payment history. Then, the payment recording unit 160 records the identified user ID and the payment history in association with each other in the history DB 110a.

[0036] When the image generating unit 170 receives a composite image request, it judges whether a predetermined image generation condition exists. The image generating unit 170 judges whether a predetermined image generation condition exists based on the results of face authentication performed at a plurality of points. The predetermined image generation condition includes, for example, that the face authentication is successful at two or more of the plurality of points, and that the user has a payment history at at least one of the two or more points. The predetermined image generation condition may be that the number of passing points is greater than a predetermined number N, or the like.

[0037] When a predetermined image generation condition is satisfied, the image generating unit 170 acquires a plurality of photographed images associated with the user ID from the history DB 110a, and generates a composite image including the plurality of photographed images. At this time, it is preferable that the image generating unit 170 specifies a location ID corresponding to each photographed image, acquires access information associated with the specified location ID from the location DB 120a, and sets access information corresponding to an area of ​​each photographed image to generate a composite image. By generating a composite image incorporating access information corresponding to an area of ​​each photographed image, a user can access store information, event information, etc. related to the location by clicking each photographed image embedded in the acquired composite image. This can encourage users to revisit each location.

[0038] The predetermined image generation condition may further include a payment history condition. The payment history condition is, for example, that there is a payment history at at least one of the passing points and that the payment amount in the payment history is a predetermined amount or more. In this case, the image generation unit 170 determines whether or not the payment history of the user who has succeeded in face authentication satisfies the payment history condition.

[0039] The predetermined image generation condition may further include successful face authentication at a predetermined location. Successful face authentication at a predetermined location means, for example, successful face authentication at a specific location such as the final location of a stamp rally. In this case, the image generation unit 170 acquires a location ID of a captured image in which face authentication has been successful from the location DB 120a, and determines whether the location ID is a location ID at a predetermined location.

[0040] The output unit 180 transmits the composite image generated by the image generation unit 170 to a terminal that has successfully performed face authentication or a terminal that has requested a composite image via the network 500. The output unit 180 may transmit the composite image to a terminal other than the terminal that has performed face authentication and requested a composite image. For example, when face authentication is performed from a store terminal, the output unit 180 may transmit the composite image to the store terminal, or may transmit the composite image to a user terminal owned by a user who has successfully performed face authentication.

[0041] The authentication device 200 is a device that performs face authentication of a user. The authentication device 200 includes a face feature DB 210. The face feature DB 210 is a face feature database that stores a user ID and face feature information of the user in association with each other. The face feature DB 210 is an example of a face feature information storage unit. The face authentication terminal 300 is a terminal that takes an image to be used for face authentication. The face authentication terminal 300 is a terminal that transmits the taken image to the visit promotion device 100a and makes a face authentication request. The face authentication terminal 300 is installed at each point A0 to An in the area A. Specifically, a face authentication terminal 300A0 is installed at the point A0, a face authentication terminal 300A1 is installed at the point A1, a face authentication terminal 300A2 is installed at the point A2, and a face authentication terminal 300An is installed at the point An. When a user visits each of the points A0 to An, the user faces the camera of the installed face authentication terminal 300A0 to 300An to take a photograph, and purchases products at the point.

[0042] The user terminal 400 is a terminal carried by a user. The user terminal 400 is, for example, a communication terminal such as a smartphone, a tablet, or a PC. The user takes an image including the user's face using the face authentication terminal 300 or the user terminal 400. The face authentication terminal 300 or the user terminal 400 transmits the taken image to the visit promotion device 100a.

[0043] Next, the configuration of the authentication device 200 will be described in detail with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the authentication device 200. The authentication device 200 includes a facial feature DB 210, a face detection unit 220, a feature point extraction unit 230, a registration unit 240, and an authentication unit 250.

[0044] The facial feature DB 210 is a facial feature database that stores a user ID and facial feature information of the user in association with each other. The face detection unit 220 detects a face area included in a photographed image and outputs the face area to the feature point extraction unit 230. The feature point extraction unit 230 extracts feature points from the face area detected by the face detection unit 220 and outputs the facial feature information to the registration unit 240. The facial feature information is a collection of the extracted feature points.

[0045] The registration unit 240 issues a new user ID when registering the facial feature information. The registration unit 240 registers the issued user ID in the facial feature DB 210 in association with the facial feature information extracted from the registration image. The authentication unit 250 compares the facial feature information extracted from the face image with the facial feature information in the facial feature DB 210. If the facial feature information matches, the authentication unit 250 determines that the facial authentication has been successful, and if the facial feature information does not match, the authentication unit 250 determines that the facial authentication has failed. The authentication unit 250 returns the success or failure of the facial authentication to the visit promotion device 100a. The presence or absence of a match in the facial feature information corresponds to the success or failure of the authentication. In addition, if the facial authentication is successful, the authentication unit 250 identifies the user ID associated with the successful facial feature information, and returns the authentication result including the identified user ID and the fact that the authentication was successful to the visit promotion device 100a.

[0046] The operation of the authentication device 200 when registering a user ID and facial feature information in the facial feature DB 210 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of the facial feature information registration process. Fig. 7 describes a case where the facial authentication terminal 300 takes an image and registers the facial feature information, but the facial feature information can also be registered in a similar procedure when the user terminal 400 takes an image.

[0047] When registering facial feature information, the face authentication terminal 300 captures an image including the user's face as a registration image, and sends a facial feature information registration request to the authentication device 200 via the network 500. The facial feature information registration request includes the registration image. First, the authentication device 200 acquires the registration image from the face authentication terminal 300 or the user terminal 400 via the network 500 (step S201).

[0048] Next, the face detection unit 220 detects a face region included in the registration image (step S202), and outputs the detected face region to the feature point extraction unit 230. Next, the feature point extraction unit 230 extracts feature points from the face region, and outputs facial feature information to the registration unit 240 (step S203). Next, the registration unit 240 issues a user ID corresponding to the output facial feature information, and associates the user ID with the facial feature information and registers it in the facial feature DB 210 (step S204).

[0049] The operation of the authentication device 200 when performing face authentication will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of face authentication processing. Fig. 8 describes a case where the face authentication terminal 300 requests face authentication, but face authentication can also be performed in a similar procedure when the user terminal 400 requests face authentication.

[0050] When performing face authentication, the face authentication terminal 300 captures an image including the user's face as an authentication image, and sends a face authentication request to the visit promotion device 100a via the network 500. The face authentication request includes the authentication image. First, the visit promotion device 100a transmits a face area or face feature information extracted from the authentication image to the authentication device 200. The feature point extraction unit 230 acquires face feature information by extracting face feature information from the received face area, or by receiving face feature information (step S301).

[0051] Next, the authentication unit 250 collates the facial feature information acquired by the feature point extraction unit 230 with the facial feature DB 210 (step S302). If the facial feature information matches (step S303 Yes), the authentication unit 250 identifies the user ID of the user whose facial feature information matches (step S304) and returns a message to the visit promotion device 100a indicating that the facial authentication was successful and the identified user ID (step S305). If there is no matching facial feature information (step S303 No), the authentication unit 250 returns a message to the visit promotion device 100a indicating that the facial authentication was unsuccessful (step S306).

[0052] Next, the configuration of the face authentication terminal 300 will be described in detail with reference to Fig. 5. The face authentication terminal 300 includes, as a hardware configuration, a photographing device such as a camera, a display device, and a computer. The face authentication terminal 300 is a device that issues a facial feature information registration request and a face authentication request. Examples of the face authentication terminal 300 include, but are not limited to, a terminal that performs payment by face authentication, a terminal that performs admission control by face authentication, and a digital signage that presents information according to face authentication.

[0053] 5 is a block diagram showing the configuration of the face authentication terminal 300. The face authentication terminal 300 includes a camera 310, a storage unit 320, a communication unit 330, a display unit 340, and a control unit 350. The camera 310 is an image capturing device that captures an image. The storage unit 320 is a storage device that stores programs for implementing each function of the face authentication terminal 300. The communication unit 330 is a communication interface with the network 500. The display unit 340 is a display device that displays the face authentication result and the composite image to the user. The control unit 350 controls the hardware included in the face authentication terminal 300. The control unit 350 includes an image capturing unit 352, a registration unit 353, an authentication unit 354, a settlement unit 355, and a composite image request unit 356.

[0054] The photographing unit 352 requests the camera 310 to photograph. The camera 310 photographs an image including the user's face. The image photographed by the camera 310 is used as a registration image and an authentication image. The registration unit 353 transmits a facial feature information registration request to the authentication device 200 via the network 500. The facial feature information registration request includes the registration image photographed by the camera 310. The authentication unit 354 transmits a facial authentication request to the visit promotion device 100a via the network 500. The facial authentication request includes the authentication image photographed by the camera 310. The authentication unit 354 receives a success or failure of the facial authentication from the visit promotion device 100a, and causes the display unit 340 to display the result.

[0055] The payment unit 355 executes payment processing when the face authentication is successful. The control unit 350 may include a recording unit (not shown) instead of the payment unit 355. The recording unit records the user's entry and exit into the facility where the face authentication terminal 300 is installed when the face authentication is successful. The composite image request unit 356 transmits a composite image request to the visit promotion device 100a via the network 500. The composite image request includes a payment history that is the result of the payment processing. The payment history is information including, for example, the date and time of the payment, the amount, the item, and the user ID.

[0056] Next, the configuration of the user terminal 400 will be described in detail with reference to Fig. 6. Fig. 6 is a block diagram showing the configuration of the user terminal 400. The user terminal 400 includes a camera 410, a storage unit 420, a communication unit 430, a display unit 440, and a control unit 450. The control unit 450 includes a photographing unit 452, a registration unit 453, an authentication unit 454, a settlement unit 455, and a composite image request unit 456. The functions of each component included in the user terminal 400 are similar to those of each component included in the face authentication terminal 300, and therefore descriptions thereof will be omitted.

[0057] If face authentication is successful, the face authentication terminal 300 and the user terminal 400 perform a payment process and make a history registration request to register the history in the visit promotion device 100a. Hereinafter, with reference to FIG. 9, the operation of the face authentication terminal 300 when making a history registration request will be described. FIG. 9 is a flowchart showing the flow of the history registration process. In FIG. 9, a case where the face authentication terminal 300 makes a history registration request will be described, but the user terminal 400 can also make a history registration request in a similar procedure.

[0058] First, the photographing unit 352 requests the camera 310 to photograph, and the camera 310 photographs an authentication image including the user's face (step S401). Next, the authentication unit 354 transmits a face authentication request to the authentication device 200 via the network 500 (step S402), and receives the success or failure from the authentication device 200 (step S403). If the face authentication is successful (step S404 Yes), the settlement unit 355 executes the settlement process (step S405), and the settlement unit 355 requests the visit promotion device 100a to register a history via the network 500 (step S406). If the face authentication is unsuccessful (step S405 No), the settlement unit 355 causes the display unit 340 to display the fact that the face authentication has failed.

[0059] 9, the case where payment processing is performed when face authentication is successful has been described, but the face authentication terminal 300 or the user terminal 400 registers the history in the visit promotion device 100a in the same manner when performing various processing other than payment processing. As various processing other than payment processing, for example, commemorative photography of a user who has succeeded in face authentication can be considered.

[0060] FIG. 10 is a flowchart showing the flow of the payment recording process. The history registration request sent in the above-mentioned step S406 includes the payment history. The payment history includes the user ID of the user who succeeded in face authentication, the location ID of the face authentication terminal 300, the date and time of payment, and payment information. When the visit promotion device 100a receives the history registration request, it acquires the payment history included in the history registration request (step S501) and identifies the user ID included in the payment history (step S502). Next, the identified user ID and the payment history are associated with each other and registered in the history DB 110a (step S503). Note that when various processes other than the payment process are performed, the history is registered in the same procedure.

[0061] The visit promotion device 100a generates a composite image when face authentication is successful or when a composite image request is received. The visit promotion device 100a generates a composite image, for example, when the user is successful in face authentication at all points A0 to An in the area A. The user may also specify the timing of making a composite image request as desired. Hereinafter, with reference to FIG. 11, the operation of the visit promotion device 100a when generating a composite image in response to a composite image request will be described. FIG. 11 is a flowchart showing the flow of the image generation process.

[0062] In the example shown in FIG. 11, the predetermined image generation condition is that face authentication has been successful at m or more points including the specific point, and that there is a payment history at any of the points where face authentication has been successful (note that m is a natural number between 2 and n). First, when the acquisition unit 130 receives a composite image request (step S601), the image generation unit 170 determines whether face authentication has been successful at the specific point (step S602). Specifically, the image generation unit 170 reads out a pass point associated with the user ID included in the composite image request from the history DB 110a, and determines whether the read pass point includes the specific point. Since the pass point registered in the history DB 110a is a point where face authentication has been successful, if the pass point includes the specific point, it can be said that face authentication has been successful at the specific point. If face authentication has not been successful at the specific point (step S602 No), the image generation unit 170 outputs a message that a composite image cannot be provided (step S608).

[0063] If face authentication is successful at a specific location (step S602 Yes), the image generation unit 170 determines whether the number of visited locations of the user is m or more (step S603). If the number of visited locations is less than m (step S603 No), the image generation unit 170 outputs a message that a composite image cannot be provided (step S608). If the number of visited locations is m or more (step S603 Yes), the image generation unit 170 determines whether there is a payment history at any of the locations where face authentication was successful (step S604). If there is no payment history at any of the locations where face authentication was successful (step S604 No), the image generation unit 170 outputs a message that a composite image cannot be provided (step S608).

[0064] If there is a payment history at any point where face authentication was successful (Yes in step S604), the image generating unit 170 acquires multiple captured images associated with the user ID from the history DB 110a (step S605). Next, the image generating unit 170 generates a composite image including the acquired multiple captured images (step S606) and outputs the composite image to a predetermined display terminal (step S607). The predetermined display terminal receives the composite image via the network 500 and displays it on the screen.

[0065] Fig. 12 is an example of a composite image. As shown in Fig. 12, images taken by a user at each location are embedded in the composite image. By embedding images taken by a user, the originality of the composite image can be increased. In addition, the composite image may include a date, the user's name, the name of each location, and the like.

[0066] Each image and each location name included in the composite image may have a link to access detailed information about the location. Examples of detailed information about each location include the type of store and a map. When a user clicks on a link, for example, detailed information about the location and payment information at the location are displayed. When a user clicks on a link, a screen for posting to a social networking service (SNS) or the like may be displayed. When a user posts from the posting screen, recommended information to be presented to other users may be supported based on the post.

[0067] Next, the operation of the visit promotion system 600 when a user visits points A0, A1, A2, and An in this order and makes a payment at point A2 will be described with reference to Figures 13 to 15. Figures 13 to 15 are sequence charts showing an example of the operation of the visit promotion system according to the second embodiment.

[0068] As shown in FIG. 13, a user first captures an image using the face authentication terminal 300A0 or the user terminal 400. The terminal that captured the image transmits a face information registration request to the authentication device 200 via the network 500 (step S701). The face information registration request is a request to register facial feature information of the user. The face information registration request includes the captured image. Upon receiving the face information registration request, the authentication device 200 issues a new user ID and registers the user ID and facial feature information extracted from the captured image in the facial feature DB 210 in association with each other.

[0069] Next, the user moves to point A1 and takes a photographed image using the face authentication terminal 300A1 or the user terminal 400. The terminal that took the photograph transmits a face authentication request to the visit promotion device 100a via the network 500 (step S702). When the visit promotion device 100a receives the face authentication request, it extracts a face area or face feature information from the photographed image included in the face authentication request and transmits it to the authentication device 200 (step S703). When the authentication device 200 receives a face area, it extracts face feature information from the face area and performs face authentication by comparing the face feature information with face feature information registered in the face feature DB 210. When the authentication device 200 receives face feature information, it performs face authentication by comparing the face feature information with face feature information registered in the face feature DB 210.

[0070] Next, the authentication device 200 transmits the face authentication result to the visit promotion device 100a (step S704). If the face authentication is successful, the face authentication result includes a message indicating that the face authentication was successful and the user ID of the user whose face authentication was successful. The visit promotion device 100a transmits the received face authentication result to the face authentication terminal 300A1 or the user terminal 400 (step S705). In addition, the visit promotion device 100a records the captured image received in step S702 and the user ID included in the face authentication result received in step S704 in association with each other in the history DB 110a. Next, the user moves to point A2.

[0071] Next, as shown in Fig. 14, the user takes a photographed image using the face authentication terminal 300A2 or the user terminal 400. The terminal that took the photograph transmits a face authentication request to the visit promotion device 100a via the network 500 (step S801). Upon receiving the face authentication request, the visit promotion device 100a extracts face area or face feature information from the photographed image included in the face authentication request and transmits it to the authentication device 200 (step S802). The authentication device 200 performs face authentication based on the received face area or face feature information, and transmits the face authentication result to the visit promotion device 100a (step S803).

[0072] The visit promotion device 100a transmits the received face authentication result to the face authentication terminal 300A2 or the user terminal 400 (step S804). The visit promotion device 100a also records the captured image received in step S801 and the user ID included in the face authentication result received in step S803 in association with each other in the history DB 110a. Next, the user performs a payment process using the face authentication terminal 300A2 or the user terminal 400. The terminal that performed the payment process transmits a history registration request to the visit promotion device 100a via the network 500 (step S805). The history registration request includes a payment history such as the user ID of the user whose face authentication was successful, the location ID of the face authentication terminal 300, the date and time of payment, and payment information. When the visit promotion device 100a receives the history registration request, it records the user ID included in the history registration request in association with the payment history in the history DB 110a. Next, the user moves to location An.

[0073] Next, as shown in Fig. 15, the user takes a photographed image using the face authentication terminal 300An or the user terminal 400. The terminal that took the photograph transmits a face authentication request to the visit promotion device 100a via the network 500 (step S901). Upon receiving the face authentication request, the visit promotion device 100a extracts face area or face feature information from the photographed image included in the face authentication request and transmits it to the authentication device 200 (step S902). The authentication device 200 performs face authentication based on the received face area or face feature information, and transmits the face authentication result to the visit promotion device 100a (step S903).

[0074] The visit promotion device 100a transmits the received face authentication result to the face authentication terminal 300An or the user terminal 400 (step S904). The visit promotion device 100a also records the captured image received in step S901 in association with the user ID included in the face authentication result received in step S903 in the history DB 110a. Next, the face authentication terminal 300An or the user terminal 400 transmits a composite image request to the visit promotion device 100a via the network 500 at the user's specification (step S905). The composite image request includes the user ID. Note that, if a predetermined image generation condition is satisfied, the face authentication terminal 300An or the user terminal 400 may transmit a composite image request to the visit promotion device 100a regardless of the user's specification.

[0075] When the visit promotion device 100a receives a composite image request, it acquires from the history DB 110a the passing points and payment history associated with the user ID included in the composite image request, and determines whether or not a predetermined image generation condition is met. If the predetermined image generation condition is met, the visit promotion device 100a acquires multiple captured images associated with the user ID from the history DB 110a, and generates a composite image. Next, the visit promotion device 100a transmits the generated composite image to the face authentication terminal 300An or the user terminal 400 (step S906). The terminal that receives the composite image displays the composite image on the screen.

[0076] In addition, if the user's passing points and payment history, etc. do not satisfy the specified image generation conditions, the output unit 180 may transmit information indicating the conditions necessary to satisfy the specified image generation conditions (for example, visit promotion information described later) to the facial recognition terminal 300An or the user terminal 400.

[0077] Here, Fig. 16 is a diagram illustrating a map displayed on a display terminal. Fig. 16 shows a case where a payment history is displayed on a user terminal 400. As shown in Fig. 16, the user terminal 400 may display the user's passing points and payment history on a map. Fig. 17 is a diagram illustrating a payment history displayed on a display terminal. As shown in Fig. 17, the user terminal 400 may display the user's payment history in chronological order.

[0078] 16 and 17 show a case where only the user's payment history is displayed on the display terminal, but in addition to the payment history, visit promotion information may also be displayed on the display terminal. Visit promotion information is information about visit promotion locations. A visit promotion location is, for example, a location that the user has not yet visited and that needs to be visited in order to satisfy a specified image generation condition. A visit promotion location may also be a location that the user has already visited and has not yet made a payment of more than a specified amount.

[0079] The information on the visit promotion location may include route guidance from the user's current location to the visit promotion location. The route guidance may include the distance and the required time from the user's current location to the visit promotion location. Furthermore, multiple pieces of visit promotion information may be displayed on the display terminal. When multiple pieces of visit promotion information are displayed, details of each piece of visit promotion information and route guidance, etc. may be displayed simultaneously. The user can review the details and route guidance, etc. of each piece of visit promotion information and compare the visit promotion information with each other.

[0080] 18 to 20 are diagrams illustrating a visit promotion screen displayed on a display terminal. At least visit promotion information is displayed on the visit promotion screen, and the user's visited locations and payment history, etc. may be further displayed. Note that the visit promotion screens shown in FIGS. 18 to 20 may have links to access detailed information about each location. When the user clicks on a link to each location, detailed information about the location may be displayed on the visit promotion screen.

[0081] FIG. 18 is an example of a visit promotion screen in a case where the predetermined image generation condition is to visit all ten locations A0 to A9. As shown in FIG. 18, the visit promotion screen may display, for example, which locations the user has already visited at the present time. The visit promotion screen may also display which locations need to be visited to satisfy the predetermined image generation condition, and the number of locations that need to be visited to satisfy the predetermined image generation condition. Specifically, as shown in FIG. 18, the number of locations that need to be visited to satisfy the predetermined image generation condition is ten, and the user has visited three locations at the present time. In this case, it may be displayed that a composite image can be obtained if seven more locations are visited.

[0082] FIG. 19 is an example of a visit promotion screen when the predetermined image generation condition is that the total amount of payments at five locations A0 to A4 is 2000 yen or more. As shown in FIG. 19, the visit promotion screen displays, for example, the amount of payments made by the user at each of the locations A0 to A4. The visit promotion screen may also display the purchase amount required to satisfy the predetermined image generation condition. Specifically, as shown in FIG. 19, if the total purchase amount required to satisfy the predetermined image generation condition is 2000 yen and the current total purchase amount is 1500 yen, it may display that a composite image can be obtained by purchasing another 500 yen.

[0083] FIG. 20 is an example of a visit promotion screen in the case where the predetermined image generation condition is a payment of 500 yen or more at each of the points A0 to A4. As shown in FIG. 20, the visit promotion screen displays, for example, the amount of payment made by the user at each of the points A0 to A4. The visit promotion screen may also display the purchase amount at each of the points A0 to A4 required to satisfy the predetermined image generation condition and the number of points required to be visited to satisfy the predetermined image generation condition. Specifically, as shown in FIG. 20, the purchase amount required to satisfy the predetermined image generation condition is 500 yen or more at each of the points, the purchase amount at two points at the present time is 500 yen or more, and the purchase amount at one point is 200 yen. In this case, it may be displayed that a composite image can be obtained by visiting two more points and purchasing 500 yen or more, and purchasing an additional 300 yen at the point where 200 yen has already been purchased.

[0084] <Embodiment 3> The third embodiment is a modified example of the above-mentioned first and second embodiments. The visit promotion devices 100, 100a, and 700 according to the first and second embodiments perform face authentication using an external authentication device 200. On the other hand, the visit promotion device 800 according to the present embodiment performs face authentication inside the device.

[0085] FIG. 21 is a block diagram showing the configuration of a visit promotion device 800 according to the third embodiment. Compared to the configuration of the visit promotion device 100 shown in FIG. 1, the visit promotion device 800 has the authentication control unit 140 replaced with a facial feature extraction unit 140a and a facial authentication unit 190, and a facial feature DB 191 (not shown) added. The facial feature DB 191 is an example of a facial feature information storage unit. For each component of the visit promotion device 800, descriptions that overlap with those of the second embodiment will be omitted as appropriate. FIG. 22 is a block diagram showing the configuration of a visit promotion system 900 according to the third embodiment. The visit promotion system 900 differs from the visit promotion system 600 in that it does not include an authentication device 200 and includes a visit promotion device 800. Since the other components are similar, descriptions will be omitted as appropriate.

[0086] The facial feature extraction unit 140a extracts a facial area or facial feature information from the captured image. The facial authentication unit 190 performs facial authentication based on the extracted facial area or facial feature information. The facial feature DB 191 is a facial feature database that stores a user ID and the facial feature information of the user in association with each other. The visit promotion device 800 generates a composite image in the same manner as the visit promotion device 100, as shown in FIG. 2. However, in step S103, the facial feature extraction unit 140a extracts a facial area or facial feature information from the captured image acquired by the acquisition unit 130, and the facial authentication unit 190 performs facial authentication based on the extracted facial area or facial feature information. Furthermore, the visit promotion device according to this embodiment can achieve the same effects as those described in the first and second embodiments.

[0087] In the above embodiment, the present disclosure has been described as a hardware configuration, but is not limited to this. Any process of the present disclosure can be realized by causing a CPU to execute a computer program.

[0088] In the above example, the program can be stored and provided to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, DVD (Digital Versatile Disc), and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electric signals, optical signals, and electromagnetic waves. The transitory computer readable media can provide the program to the computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0089] The present disclosure is not limited to the above-described embodiment, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0090] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0091] (Appendix A1) An acquisition unit that acquires a photographed image taken by a user; an authentication control unit that extracts a face area or facial feature information of the user from the captured image and causes an authentication device to perform face authentication; an image generation unit that generates a composite image including images taken at each of the locations of a user who has been successfully face-recognized, when a predetermined image generation condition based on the face recognition at each of the locations is satisfied; an output unit that transmits the composite image generated by the image generation unit to a predetermined display terminal; A visiting propulsion device equipped with the device.

[0092] (Appendix A2) The predetermined image generation condition includes a case where the face authentication is successful at two or more of the plurality of locations, and the user has a payment history at at least one of the two or more locations. 13. A visit propulsion device as described in Appendix A1.

[0093] (Appendix A3) The output unit is If the predetermined image generation condition is not satisfied at the point where the face authentication is successful, information indicating a condition required to satisfy the image generation condition is transmitted to the display terminal. 13. A visit propulsion device according to claim A1 or A2.

[0094] (Appendix A4) moreover, an authentication recording unit that, when the face authentication is successful, records the user ID of the user who has succeeded in the face authentication and the captured image in a history storage unit in association with each other; the image generation unit acquires from the history storage unit a captured image associated with a user ID of the user who has succeeded in the face authentication, and generates a composite image using the captured image; A visit promotion device according to any one of appendices A1 to A3.

[0095] (Appendix A5) Further, a payment recording unit is provided which records a payment history and a user ID included in the payment history in the history storage unit in association with each other, The predetermined image generation conditions include a payment history condition, The image generation unit determines whether or not a payment history of the user who has succeeded in the face authentication satisfies the predetermined payment history condition. A visit propulsion device as described in Appendix A4.

[0096] (Appendix A6) Further, a location storage unit is provided for storing a location ID in the photographed image and access information of the location in association with each other, The image generation unit acquires access information associated with the location ID of the captured image from the location storage unit, and generates the composite image by incorporating the access information. A visit promotion device according to any one of appendices A1 to A5.

[0097] (Appendix A7) the predetermined image generation condition includes successful face authentication at a predetermined location; The image generation unit acquires a location ID in the captured image where the face authentication has succeeded from the location storage means, and determines whether the location ID is a location ID in the predetermined location. A visit propulsion device as described in Appendix A6.

[0098] (Appendix B1) A predetermined photographing device that photographs an image including a face area of ​​a user; A visit promotion device capable of communicating with the predetermined photographing device; An authentication device that stores facial feature information of the user and is capable of communicating with the visit promotion device; The visiting propulsion device is An acquisition unit that acquires a photographed image taken by a user using the predetermined photographing device; an authentication control unit that extracts a face area or facial feature information of the user from the captured image and causes an authentication device to perform face authentication; an image generation unit that generates a composite image including images taken at each of the locations of a user who has been successfully face-recognized, when a predetermined image generation condition based on the face recognition at each of the locations is satisfied; an output unit that transmits the composite image generated by the image generation unit to a predetermined display terminal; A visit promotion system equipped with:

[0099] (Appendix B2) The predetermined image generation condition is that the face authentication is successful at two or more of the plurality of locations, and the user has a payment history at at least one of the two or more locations. A visit promotion system as described in Appendix B1.

[0100] (Appendix C1) The computer A step of acquiring a photographed image taken by a user; extracting a face area or facial feature information of the user from the captured image and having an authentication device perform face authentication; generating a composite image including images taken at each of the locations of a user who has been successfully face-authenticated, when a predetermined image generation condition based on the face authentication at the locations is satisfied; transmitting the generated composite image to a predetermined display terminal; A method of promoting visits that includes the following:

[0101] (Appendix D1) A step of acquiring a photographed image taken by a user; extracting a face area or facial feature information of the user from the captured image and having an authentication device perform face authentication; generating a composite image including images taken at each of the locations of a user who has been successfully face-authenticated, when a predetermined image generation condition based on the face authentication at the locations is satisfied; transmitting the generated composite image to a predetermined display terminal; A non-transitory computer-readable medium having stored thereon a visit promotion program that causes a computer to execute the above.

[0102] (Appendix E1) An acquisition unit that acquires a photographed image taken by a user; an extraction unit that extracts a face area or face feature information from the captured image; a face authentication unit that performs face authentication based on the face area or the face feature information; an image generation unit that generates a composite image including images taken at each of the locations of a user who has been successfully face-recognized, when a predetermined image generation condition based on the face recognition at each of the locations is satisfied; an output unit that transmits the composite image generated by the image generation unit to a predetermined display terminal; A visiting propulsion device equipped with the device.

[0103] (Appendix E2) The predetermined image generation condition is that the face authentication is successful at two or more of the plurality of locations, and the user has a payment history at at least one of the two or more locations. 2. A visit propulsion device as described in appendix E1.

[0104] (Appendix F1) The computer A step of acquiring a photographed image taken by a user; extracting a face area or facial feature information from the captured image; performing face authentication based on the face area or the face feature information; generating a composite image including images taken at each of the locations of a user who has been successfully face-authenticated, when a predetermined image generation condition based on the face authentication at the locations is satisfied; transmitting the generated composite image to a predetermined display terminal; A method for promoting visits that includes the following:

[0105] (Appendix G1) A step of acquiring a photographed image taken by a user; extracting a face area or facial feature information from the captured image; performing face authentication based on the face area or the face feature information; generating a composite image including images taken at each of the locations of a user who has been successfully face-authenticated, when a predetermined image generation condition based on the face authentication at the locations is satisfied; transmitting the generated composite image to a predetermined display terminal; A non-transitory computer-readable medium having stored thereon a visit promotion program that causes a computer to execute the above.

[0106] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-mentioned embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0107] 100, 100a, 800 visit propulsion device 600, 900 Visit Promotion System 110a History DB 120a Point DB 130 Acquisition Department 140 Authentication control section 140a Facial feature extraction unit 150 Certification Records Section 160 Payment Record Section 170 Image Generation Unit 180 Output section 190 Face Recognition Unit 191 Face Features DB 200 Authentication Device 210 Face Features DB 220 Face detection unit 230 Feature Point Extraction Unit 240 Registration Department 250 Authentication Department 300 (300A0~300An) Face recognition terminal 310 Camera 320 Storage section 330 Communications Department 340 Display section 350 Control section 352 Photography Department 353 Registration Department 354 Authentication Department 355 Payment Department 356 Composite Image Request Unit 400 User terminals 410 Camera 420 Storage section 430 Communications Department 440 Display section 450 Control Unit 452 Photography Department 453 Registration Department 454 Authentication Department 455 Payment Department 456 Composite Image Request Section 500 Network

Claims

1. An acquisition unit that acquires facial information of a user's face from terminals installed at multiple locations; an authentication control unit that performs face authentication by matching the face information with pre-registered face information; an output unit that provides a predetermined service to the user when the number of points at which the payment based on the face authentication is made is equal to or greater than a predetermined number; An information processing device comprising:

2. A guidance information output unit that outputs guidance information from the current location of the user to the plurality of locations. The information processing device according to claim 1 .

3. a service acquisition condition confirmation unit that notifies the user of action information required by the user before the predetermined service is output; 3. The information processing device according to claim 1 or 2.

4. Acquire facial information of a user's face photographed from terminals installed at multiple locations, performing face authentication by matching the face information with preregistered face information; providing a predetermined service to the user when the number of locations where payments based on the face authentication have been made for a predetermined amount or more is a predetermined number or more; Information processing methods.

5. A function for acquiring facial information of a user from terminals installed at multiple locations; A function of performing face authentication by matching the face information with pre-registered face information; a function of providing a predetermined service to the user when the number of locations where the payment based on the face authentication is made for a predetermined amount or more is a predetermined number or more; A program to make the above happen on a computer.

Images