Information processing device, authentication system, authentication method, and program

Abstract

Provided are an information processing device, an authentication system, an authentication method, and a non-transitory computer-readable medium with which it is possible to further improve the attractiveness of recreational facilities. An information processing device (10) comprises an authentication unit (13) that controls face authentication by verification of the face information for authentication of a user having been acquired at each of a plurality of points in a facility against the face information for registration having been registered in advance, a smile degree calculation unit (14) that calculates the smile degree of the user from the face information for authentication, a generation unit (15) that accumulates the smile degrees of the user calculated from the face information for authentication having been acquired at each of the plurality of points in the facility and generates a cumulative smile degree, and an output control unit (16) that controls the output of the result of comparison of the cumulative smile degree of the user with the cumulative smile degrees of other users.

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus, an authentication system, an authentication method, and a non-temporary computer-readable medium.

Background Art

[0002] In entertainment facilities, technologies for performing settlement or admission processing for attractions using face authentication have been developed. Also, attempts have been made to improve the attractiveness of entertainment facilities using face authentication technology. For example, Patent Document 1 describes generating a composite image with a photo frame (template) according to a smile point indicating the degree of smile when the user included in the captured image taken at the final point during face authentication is smiling.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in Patent Document 1, the degree of smile is determined only at the final point of the entertainment facility. It is desired to further improve the attractiveness of the entertainment facility using face authentication technology.

[0005] An object of the present disclosure is to provide an information processing apparatus, an authentication system, an authentication method, and a non-temporary computer-readable medium that can further improve the attractiveness of an entertainment facility.

Means for Solving the Problems

[0006] An information processing device according to a first aspect of this disclosure includes: an authentication means for controlling facial authentication by comparing a user's authentication face information acquired at each of a plurality of locations within a facility with pre-registered registered face information; a smile degree calculation means for calculating the user's smile degree from the authentication face information; a cumulative smile degree generation means for accumulating the user's smile degree calculated from the authentication face information acquired at each of the plurality of locations within the facility to generate a cumulative smile degree; and an output control means for controlling the output of a comparison result between the user's cumulative smile degree and the cumulative smile degrees of other users.

[0007] An authentication system according to a second aspect of the present disclosure comprises authentication terminals installed at multiple locations within a facility, and an information processing device capable of communicating with the authentication terminals, wherein the information processing device includes user information registration means for registering user registration facial information in a storage means, the authentication terminal includes authentication facial information acquisition means for acquiring the user authentication facial information, the information processing device further comprises authentication means for performing facial authentication by comparing the user authentication facial information acquired at each of the multiple locations within the facility with the registered facial information, smile degree calculation means for calculating the user's smile degree from the authentication facial information when the facial authentication is successful, cumulative smile degree generation means for accumulating the user's smile degree calculated from the authentication facial information acquired at each of the multiple locations within the facility to generate a cumulative smile degree, and output control means for causing the authentication terminal to output a comparison result between the user's cumulative smile degree and the cumulative smile degree of other users.

[0008] A third aspect of the present disclosure is an authentication method in which a computer controls facial authentication by comparing a user's authentication facial information acquired at each of several locations within a facility with pre-registered registered facial information, calculates the user's smile level from the authentication facial information, generates a cumulative smile level by accumulating the user's smile levels calculated from the authentication facial information acquired at each of the several locations within the facility, and controls the output of a comparison result between the user's cumulative smile level and the cumulative smile levels of other users.

[0009] A non-temporary computer-readable medium according to a fourth aspect of this disclosure stores a program that causes a computer to execute a process for controlling facial recognition by comparing a user's authentication facial information acquired at each of a plurality of locations within a facility with pre-registered registered facial information; a process for calculating the user's smile level from the authentication facial information; a process for generating a cumulative smile level by accumulating the user's smile levels calculated from the authentication facial information acquired at each of the plurality of locations within the facility; and a process for controlling the output of a comparison result between the user's cumulative smile level and the cumulative smile levels of other users. [Effects of the Invention]

[0010] This invention provides an information processing device, an authentication system, an authentication method, and a non-temporary computer-readable medium that can further enhance the appeal of entertainment facilities. [Brief explanation of the drawing]

[0011] [Figure 1] This is a block diagram showing an example of an information processing device according to Embodiment 1. [Figure 2] This flowchart shows an example of an authentication method according to Embodiment 1. [Figure 3] This is a block diagram showing an example of an authentication system according to Embodiment 2. [Figure 4] This is a block diagram showing an example of an authentication terminal according to Embodiment 2. [Figure 5] This is a block diagram showing an example of an information processing device according to Embodiment 2. [Figure 6] This figure shows an example of the user information data structure according to Embodiment 2. [Figure 7] This figure shows an example of the data structure of cumulative smile level information according to Embodiment 2. [Figure 8] This figure shows an example of the data structure of travel history information according to Embodiment 2. [Figure 9] This figure shows an example of the data structure for the conditions for granting benefits according to Embodiment 2. [Figure 10] It is a flowchart showing an example of the registration process of user information in the authentication method according to Embodiment 2. [Figure 11] It is a flowchart showing an example of the authentication method according to Embodiment 2. [Figure 12] It is a flowchart showing an example of the authentication method according to Embodiment 2. [Figure 13] It is a diagram showing an example of the display unit of the authentication terminal according to Embodiment 2.

Mode for Carrying Out the Invention

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. <Embodiment 1> FIG. 1 is a block diagram showing an example of an information processing apparatus 10 according to Embodiment 1. The information processing apparatus 10 executes face authentication processing of a user acquired at each of a plurality of locations in an entertainment facility such as a theme park. Here, the user is a visitor to the entertainment facility. The information processing apparatus 10 is communicable with an authentication terminal (not shown) installed at each of a plurality of locations in the entertainment facility. Further, the information processing apparatus 10 may be communicable with a user terminal (not shown) carried by the user. Further, the information processing apparatus 10 may be communicable with a registration terminal (not shown) installed inside and outside the entertainment facility.

[0013] As shown in FIG. 1, the information processing apparatus 10 includes a storage unit 11, a registration unit 12, an authentication unit 13, a smile degree calculation unit 14, a generation unit 15, and an output control unit 16.

[0014] The storage unit 11 is also called a storage means. The storage unit 11 stores registration face information.

[0015] The registration unit 12 is also called user information registration means. The registration unit 12 registers user information in the storage unit 11. Here, the user information includes at least the face information for user registration. The face information for user registration is, for example, information extracted from a face image generated by photographing the user's face. Note that a face image obtained by photographing the user's face by one of the authentication terminals installed at each of a plurality of locations in the entertainment facility may be transmitted from the authentication terminal to the information processing device 10. Further, the information processing device 10 may include a camera (not shown), and the camera may photograph the user's face and acquire a face image. Also, the user's face may be photographed by a camera of a user terminal capable of communicating with the information processing device 10, and a face image may be input from the user terminal to the information processing device 10.

[0016] The authentication unit 13 is also called authentication means. The authentication unit 13 controls face authentication by comparing the face information for user authentication acquired by the authentication terminals installed at each of a plurality of locations in the entertainment facility with the face information for registration stored in the storage unit 11. Note that the biometric authentication process may be performed in the information processing device 10 or may be performed in another device, for example, an authentication terminal (not shown).

[0017] The smile degree calculation unit 14 is also called smile degree calculation means. The smile degree calculation unit 14 calculates the smile degree of the user from the face information for authentication when the face authentication is successful. The calculated smile degree is supplied to the generation unit 15.

[0018] The generation unit 15 is also called cumulative smile degree generation means. The generation unit 15 accumulates the smile degrees of the user calculated from the face information for authentication acquired at each of a plurality of locations in the facility to generate a cumulative smile degree. The generated cumulative smile degree is supplied to the output control unit 16.

[0019] The output control unit 16 is also called the output control means. The output control unit 16 controls the output of the comparison result between the user's cumulative smile score and the cumulative smile score of other users at the authentication terminal. Specifically, the output control unit 16 generates a comparison result between the user's cumulative smile score and the cumulative smile score of other users and controls the output of the authentication terminal to display the comparison result.

[0020] Figure 2 is a flowchart of the authentication method according to Embodiment 1. First, the registration unit 12 registers the user's registration face information in the storage unit 11 (step S10). Next, the authentication unit 13, upon receiving authentication face information from authentication terminals installed at various locations within the entertainment facility, performs face authentication by comparing the registration face information with the authentication face information (step S11). If face authentication is unsuccessful (No in step S12), this process is terminated. On the other hand, if face authentication is successful (Yes in step S12), the smile level calculation unit 14 calculates the user's smile level from the authentication face information (step S13). Next, the generation unit 15 generates a cumulative smile level by accumulating the smile levels calculated in step S13 (step S14). Specifically, the generation unit 15 adds the smile level calculated in step S13 to the smile levels accumulated before face authentication in step S11 to generate a cumulative smile level. Next, the output control unit 16 causes the authentication terminal to output the comparison result between the user's cumulative smile score and the cumulative smile scores of other users (step S15), and then terminates this process.

[0021] According to the information processing device 10 of Embodiment 1 described above, the user's smile level at each location is calculated from the authentication facial information received from authentication terminals installed at each of the multiple locations in the entertainment facility, and a cumulative smile level is generated by accumulating the calculated smile levels. The user's cumulative smile level is then compared with the cumulative smile levels of other users (ranking), and the result is output to the authentication terminal. Therefore, compared to determining the smile level only at the final location of the entertainment facility, the appeal of the entertainment facility can be further enhanced using facial recognition technology.

[0022] The information processing device 10 includes a processor, memory, and storage device (not shown in the diagram). The storage device stores a computer program that implements the authentication method according to this embodiment. The processor loads the computer program from the storage device into the memory and executes the computer program. As a result, the processor realizes the functions of the registration unit 12, the authentication unit 13, the smile level calculation unit 14, the generation unit 15, and the output control unit 16.

[0023] Alternatively, the registration unit 12, authentication unit 13, smile level calculation unit 14, generation unit 15, and output control unit 16 may each be implemented with dedicated hardware. Furthermore, some or all of the components of each device may be implemented by general-purpose or dedicated circuits, processors, etc., or combinations thereof. These may be configured by a single chip or by multiple chips connected via a bus. Some or all of the components of each device may be implemented by a combination of the above-mentioned circuits, etc., and programs. In addition, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (field-programmable gate array), etc., can be used as the processor.

[0024] <Embodiment 2> Next, the authentication system 100 according to Embodiment 2 will be described. Figure 3 is a block diagram showing the overall configuration of the authentication system 100 according to Embodiment 2. The authentication system 100 is a computer system that performs biometric authentication of user U in an entertainment facility such as a theme park. In the following, facial recognition will be used as an example of biometric authentication, but the system is not limited to this.

[0025] The authentication system 100 comprises authentication terminals 200-1, 200-2, ...200-i, ...200-n (1 ≤ i ≤ n, n is a positive integer) and an information processing device 300. The authentication terminals 200-1, 200-2, ...200-i, ...200-n and the information processing device 300 are able to communicate with each other via a network N. The information processing device 300 may also be able to communicate with a user terminal (not shown) carried by the user. The information processing device 300 may also be able to communicate with a registration terminal (not shown) installed inside or outside the entertainment facility. Furthermore, the authentication terminals 200-1, 200-2, ...200-i, ...200-n may be able to communicate with the user terminal using a predetermined method of short-range wireless communication. Furthermore, authentication terminals 200-1, 200-2, ...200-i, ...200-n may be able to communicate with the user terminal via network N. Network N is either a wired or wireless communication line.

[0026] Authentication terminals 200-1, 200-2, ...200-i, ...200-n will each be referred to simply as authentication terminal 200 below, without distinction. Authentication terminal 200 is located at multiple points within an entertainment facility. A 1, point A 2,...point A i,...point A For example, each of n will be installed as a digital signage display.

[0027] Figure 4 is a block diagram showing an example of an authentication terminal 200. As shown in Figure 4, the authentication terminal 200 includes a camera 210, a storage unit 220, a memory 230, a communication unit 240, an output unit 250, and a control unit 260.

[0028] Camera 210 takes pictures according to the control unit 260. Camera 210 takes a picture of user U's face according to the control unit 260.

[0029] The memory unit 220 is a storage device that stores programs 221 for realizing the various functions of the authentication terminal 200. The memory 230 is a volatile storage device such as RAM, and is a storage area for temporarily holding information when the control unit 260 is operating. The communication unit 240 is a communication interface with the network N.

[0030] The output unit 250 outputs the information processing results of the control unit 260. For example, the output unit 250 has a display unit 251 and an audio output unit 252. The display unit 251 is a display device that displays the information processing results of the control unit 260. The authentication terminal 200 may be equipped with an input unit (not shown) that accepts input, and the display unit 251 and the input unit may be integrated, such as a touch panel. The audio output unit 252 includes a speaker (not shown) and outputs the information processing results of the control unit 260 as audio.

[0031] The control unit 260 is a processor, or control device, that controls each component of the authentication terminal 200. The control unit 260 loads program 221 from the storage unit 220 into memory 230 and executes program 221. In this way, the control unit 260 realizes the functions of the image acquisition unit 261, the registration information acquisition unit 262, the payment unit 263, and the output control unit 264.

[0032] The image acquisition unit 261 is also called the authentication face information acquisition means. The image acquisition unit 261 controls the camera 210 to capture the face of user U and generate an authentication face image that includes at least the face region of user U. The image acquisition unit 261 then acquires the authentication face image and the date and time of capture from the camera 210. The image acquisition unit 261 supplies the authentication face image and the date and time of capture to the communication unit 240, and transmits the authentication face image and the date and time of capture to the communication unit 240, along with the location information (location) of the authentication terminal 200. A 1, point A 2,...point A i,...point A The information is transmitted to the information processing device 300 along with n). The image acquisition unit 261 may also control the camera 210 to capture the face of user U and generate a registration face image that includes at least the face region of user U. The image acquisition unit 261 may then supply the registration face image to the communication unit 240 and have the communication unit 240 transmit the registration face image to the information processing device 300. The registration facial image may be captured at a user terminal (not shown) and transmitted from the user terminal to the information processing device 300. Alternatively, the registration facial image may be captured at a registration terminal installed inside or outside the entertainment facility and transmitted from the registration terminal to the information processing device 300.

[0033] The registration information acquisition unit 262 acquires the registration information of user U. Here, the registration information of user U includes user U's name, address, telephone number, payment information, payment information, and benefit information. Payment information includes the card number and expiration date used for payment. Payment information includes the name of the product or service purchased by user U, the price of the product or service, and the date and time of purchase. The name of the product purchased by user U is the name of the food or beverage consumed by user U at the entertainment facility. The name of the service purchased by user U is the name of the attraction experienced by user U at the entertainment facility. Benefit information includes the number of points earned and coupons. The registration information may be entered into the authentication terminal 200 by the user U operating the input section (not shown) of the authentication terminal 200. The registration information acquisition unit 262 may be equipped with a card reader and acquire the user U's registration information by reading, for example, a driver's license or credit card. The registration information acquisition unit 262 then supplies the user U's registration information to the communication unit 240, causing the communication unit 240 to transmit the registration information to the information processing device 300. Furthermore, registration information may be transmitted from a user terminal (not shown) to the information processing device 300. Alternatively, registration information may be transmitted from registration terminals installed inside or outside the entertainment facility to the information processing device 300.

[0034] The settlement unit 263 executes the payment when facial recognition for payment is successful at the authentication terminal 200. Specifically, the settlement unit 263 obtains the information necessary for payment of user U whose facial recognition has been successful from the information processing device 300 and executes the payment. The settlement unit 263 obtains the information necessary for payment from the registration information 312C associated with user ID 312A, which is received from the information processing device 300 along with the facial recognition result. After the payment is completed, the settlement unit 263 supplies the payment information of user U to the communication unit 240 and causes the communication unit 240 to transmit the payment information to the information processing device 300.

[0035] The output control unit 264 controls the output unit 250, causing the output unit 250 to output the information processing result, and notifies the user U of the information processing result. For example, when the output control unit 264 receives an output instruction (described later) from the information processing device 300, it causes the output unit 250 to output the comparison result (described later). Furthermore, the output control unit 264 causes the output unit 250 to output the facial recognition result, thereby informing the user U of the facial recognition result.

[0036] Figure 5 is a block diagram showing an example of an information processing device 300. As shown in Figure 5, the information processing device 300 includes a storage unit 310, a memory 320, a communication unit 330, and a control unit 340.

[0037] The memory unit 310 is a storage device that stores programs 311 for realizing each function of the information processing device 300. The memory 320 is a volatile storage device such as RAM, and is a storage area for temporarily holding information when the control unit 340 is operating. The communication unit 330 is a communication interface with the network N.

[0038] The storage unit 310 stores user information 312. Therefore, the storage unit 310 is also called a storage means. Figure 6 shows an example of user information 312. As shown in Figure 6, user information 312 is information that associates user ID 312A, registration face information 312B, and registration information 312C. Note that user information 312 may also include management information such as the date and time the registration face image was taken.

[0039] The memory unit 310 stores the cumulative smile level information 313. Figure 7 shows an example of the cumulative smile level information 313. As shown in Figure 7, the cumulative smile level information 313 is information that associates user ID 313A with cumulative smile level 313B.

[0040] The memory unit 310 stores the travel history information 314. Figure 8 shows an example of the travel history information 314. As shown in Figure 8, the travel history information 314 is information that associates user ID 314A with travel history 314B. The travel history 314B is the travel history of user U at the entertainment facility. Specifically, the travel history 314B is the date and time when the authentication facial image of user U was taken and the location information of the authentication terminal 200, which were received from the authentication terminal 200. In addition to the date and time when the authentication facial image of user U was taken and the location information, the travel history 314B may also include the smile score calculated from the authentication facial image. This allows the memory unit 310 to store the history of user U's smile score as the travel history information 314. Therefore, the operator of the entertainment facility can find out which areas of the entertainment facility have a low smile score, or in other words, where customer satisfaction is low.

[0041] The memory unit 310 stores the reward granting conditions 315. Figure 9 shows an example of the reward granting conditions 315. As shown in Figure 9, the reward granting conditions 315 are information that associates the cumulative smile level 315A with the reward 315B. Alternatively, the reward granting conditions 315 may be information that associates the distance traveled with the reward.

[0042] The control unit 340 is a processor, or control device, that controls each component of the information processing device 300. The control unit 340 loads program 311 from the storage unit 310 into the memory 320 and executes program 311. In this way, the control unit 340 realizes the functions of the registration unit 341, authentication unit 342, smile level calculation unit 343, generation unit 344, history update unit 345, benefit granting unit 346, output control unit 347, and notification unit 348.

[0043] The registration unit 341 is also called the user information registration means. The registration unit 341 registers user information 312 in the storage unit 310. When the registration unit 341 receives a registration face image and registration information from the authentication terminal 200, a user terminal (not shown), or a registration terminal (not shown), it obtains registration face information 312B from the registration face image. Next, the registration unit 341 associates the user ID 312A, the registration face information 312B, and the registration information 312C and stores them in the storage unit 310 as user information 312. As an example, face information may be a set of feature points extracted from a face image. Specifically, the registration unit 341 detects face regions included in the registration face image, extracts feature points from the detected face regions, and uses the information of the extracted feature points as registration face information 312B. Furthermore, the registration unit 341 generates a user ID 312A. User ID 312A may also be input to the authentication terminal 200, user terminal (not shown), or registration terminal (not shown) by user U operating an input unit (not shown) of any of these terminals. Then, user ID 312A, along with the registration face image and registration information, may be transmitted to the information processing device 300 from any of the authentication terminal 200, user terminal (not shown), or registration terminal (not shown). Alternatively, a password may be transmitted to the information processing device 300 along with user ID 312A from any of the authentication terminal 200, user terminal (not shown), or registration terminal (not shown). In other words, the registration unit 341 may associate user ID 312A, password, registration face information 312B, and registration information 312C and store them in the storage unit 310 as user information 312. Furthermore, if management information such as the date and time of taking the registration face image is transmitted from the authentication terminal 200, the user terminal (not shown), or the registration terminal (not shown), the registration unit 341 may associate the user ID 312A with the registration face information 312B, the registration information 312C, and the management information, and store it in the storage unit 310 as user information 312.

[0044] The authentication unit 342 is also called the authentication means. The authentication unit 342 performs facial authentication when it receives an authentication facial image from the authentication terminal 200. The authentication unit 342 then obtains authentication facial information from the authentication facial image transmitted from the authentication terminal 200 and performs facial authentication by comparing the registration facial information 312B with the authentication facial information. The method for obtaining authentication facial information from the authentication facial image is the same as the method for obtaining registration facial information 312B from the registration facial image in the registration unit 341, so the explanation is omitted. Furthermore, if the authentication facial information and the registration facial information 312B match, the authentication unit 342 refers to the user information 312 and obtains the user ID 312A associated with the registration facial information 312B. The authentication unit 342 then supplies the status of the facial information match and the user ID 312A to the notification unit 348. Furthermore, if the authentication facial information and the registration facial information 312B match, the authentication unit 342 supplies the authentication facial information to the smile degree calculation unit 343. Whether or not the facial information matches corresponds to the success or failure of authentication. Note that a match in facial information (match found) means that the degree of match is equal to or greater than a predetermined value. The facial recognition process may also be performed by another device, such as the authentication terminal 200. In this case, the authentication unit 342 only needs to control the facial recognition process performed by the other device.

[0045] The smile degree calculation unit 343 is also called the smile degree calculation means. When face recognition is successful, the smile degree calculation unit 343 calculates the smile degree of user U from the authentication face information. The calculated smile degree is supplied to the generation unit 344. The calculated smile degree may also be supplied to the history update unit 345. Here, a specific example of calculating the smile degree of user U will be described. Generally, when a person smiles, features such as the corners of the mouth turning up, the corners of the eyes turning down, the eyes narrowing, and wrinkles forming around the mouth appear in the face region. For this reason, the smile degree calculation unit 343 may extract feature points of facial organs such as both eyes and the mouth in the face region of user U and calculate the smile degree based on the coordinates of each extracted feature point. Alternatively, the smile degree calculation unit 343 may calculate the smile degree using a trained classifier. The classifier may be a support vector machine (SVM) that takes the feature quantities of facial organs as input and outputs whether or not the smile degree is above a predetermined level. Furthermore, the classifier may be a convolutional neural network (CNN) that takes the face region of the captured image as input and outputs a smile score. Note that the method for calculating the smile score is not limited to the above; existing methods may be used. Furthermore, if the captured image includes the face regions of both user U and their companion, the smile intensity calculation unit 343 may calculate the smile intensity based on the smile intensity of the companion's face region in addition to the smile intensity of user U's face region. For example, the smile intensity calculation unit 343 may calculate the average of the smile intensity of user U's face region and the smile intensity of the companion's face region as the smile intensity.

[0046] The generation unit 344 is also called the cumulative smile score generation means. The generation unit 344 generates a cumulative smile score by accumulating the smile scores of user U calculated from authentication facial information acquired at each of the multiple locations A1, A2, ..., Ai, ...An within the facility. Specifically, the generation unit 344 adds the calculated smile score to the cumulative smile score 313B associated with user ID 313A of user U in the cumulative smile score information 313 shown in Figure 7, to generate a new cumulative smile score. The generation unit 344 also associates the user ID 313A with the generated cumulative smile score 313B and stores it in the storage unit 310 as cumulative smile score information 313. The generated cumulative smile score is then supplied to the benefit granting unit 346 and the output control unit 347.

[0047] The history update unit 345 is also called the history information update means. The history update unit 345 updates the travel history information 314 of user U whose facial recognition was successful when facial recognition is successful. Specifically, the history update unit 345 updates the date and time the facial image was taken and the location information of the authentication terminal 200, which were received from the authentication terminal 200 along with the facial image. A 1, point A 2,...point A i,...point A n) is added to the travel history 314B of the travel history information 314 shown in Figure 8. Furthermore, the history update unit 345 may add the smile score received from the smile score calculation unit 343, along with the date and time and location information of the user U's authentication face image, to the travel history 314B of the travel history information 314.

[0048] The reward granting unit 346 is also called the reward granting means. The reward granting unit 346 grants a reward to user U according to the cumulative smile level. Specifically, the reward granting unit 346 grants user U a reward 315B corresponding to the cumulative smile level 315A received from the generation unit 344, based on the reward granting conditions 315 shown in Figure 9. More specifically, the reward granting unit 346 adds the reward 315B to the rewards included in the user U's registration information 312C in the user information 312. The reward granting unit 346 may also transmit the reward 315B to user U's user terminal (not shown). Furthermore, the reward granting unit 346 may grant rewards to user U according to their travel history. For example, the reward granting unit 346 may refer to the travel history 314B corresponding to user U's user ID 314A, obtain user U's travel distance, and grant user U rewards according to that travel distance. The travel distance is calculated by including each point (location) that user U visited in the travel history 314B. A 1, point A 2,...point A i,...point A The sum of the distances between n) is sufficient.

[0049] The output control unit 347 is also called the output control means. When facial recognition is successful, the output control unit 347 causes the authentication terminal 200 to output the result of comparing the cumulative smile score 313B of user U with the cumulative smile score 313B of other users. Specifically, the output control unit 347 refers to the cumulative smile score information 313 shown in Figure 7 and generates the result of comparing the cumulative smile score 313B of user U with the cumulative smile score 313B of other users. The output control unit 347 then causes the communication unit 330 to send an output instruction including the generated comparison result to the authentication terminal 200. Furthermore, the output control unit 347 may cause the authentication terminal 200 to output the comparison result between user U's travel history 314B and the travel history 314B of other users. Specifically, the output control unit 347 refers to the travel history information 314 shown in Figure 8 and generates a comparison result between user U's travel distance and the travel distance of other users. Then, the output control unit 347 causes the communication unit 330 to send an output instruction including the generated comparison result to the authentication terminal 200.

[0050] If the facial recognition result indicates a match of facial information, i.e., successful facial recognition, the notification unit 348 notifies the authentication terminal 200 of the facial recognition result and the user ID 312A. The user ID 312A may also be included in the facial recognition result. Furthermore, the notification unit 348 may send an error notification to the authentication terminal 200 indicating that facial recognition has failed. The notification unit 348 may, but is not limited to, include the user ID 312A in the error notification.

[0051] Figure 10 is a flowchart illustrating an example of the user information registration process in the authentication method according to Embodiment 2. The following flowchart explains the process using an example where, among the authentication terminals 200-1, 200-2, 200-i, and 200-n installed at multiple locations A1, A2, ..., Ai, ...An of the entertainment facility, the user U's registration face image and registration information are acquired at the first location A1, which is the authentication terminal 200-1. Here, the first location A1 is, for example, the location of the authentication terminal 200-1 installed at or near the gate of the entertainment facility. However, the user U's registration face image and registration information may also be acquired at the user U's user terminal (not shown) or at registration terminals installed inside or outside the entertainment facility and transmitted to the information processing device 300. First, the image acquisition unit 261 of the authentication terminal 200-1 causes the camera 210 to photograph user U's face and acquire a face image for registration (step S101). Next, the registration information acquisition unit 262 of the authentication terminal 200-1 acquires user U's registration information (step S102). Next, the communication unit 240 transmits the face image for registration and the registration information to the information processing device 300 and makes a user registration request (step S103). Next, the registration unit 341 of the information processing device 300 performs user registration (step S104) and terminates this process. Specifically, the registration unit 341 generates registration face information 312B from the registration face image. The registration unit 341 also generates user ID 312A. Then, the registration unit 341 associates the user ID 312A, the registration face information 312B, and the registration information 312C and stores them in the storage unit 310 as user information 312.

[0052] Figures 11 and 12 are flowcharts of the authentication method according to Embodiment 2. The authentication method shown in Figures 11 and 12 is performed after the user information registration process shown in Figure 10 has been completed. First, the image acquisition unit 261 of the authentication terminal 200-i causes the camera 210 to photograph the face of user U and acquires an authentication face image (step S201). Next, the communication unit 240 transmits the authentication face image, the date and time of capture, and location information to the information processing device 300 and makes an authentication request (step S202). Next, the authentication unit 342 of the information processing device 300 performs face authentication (step S203). Specifically, the authentication unit 342 generates authentication face information from the authentication face image, compares the authentication face information with the registration face information 312B of the user information 312, and determines that face authentication has been successful if the degree of matching of the face information is equal to or greater than a predetermined value. Next, the notification unit 348 notifies the authentication terminal 200-i of the authentication result indicating whether or not face authentication was successful, and the user ID 312A (step S204). Next, if face authentication is successful, the smile degree calculation unit 343 calculates the smile degree of user U from the authentication face information (step S205). Between steps S204 and S205, the output control unit 264 of the authentication terminal 200-i may display or output the face authentication result on the output unit 250 to inform user U of the face authentication result. Next, if face authentication is successful, the generation unit 344 accumulates the smile degree of user U to generate a cumulative smile degree (step S206). Specifically, the generation unit 344 adds the smile degree calculated in step S205 to the cumulative smile degree 313B associated with the user ID 313A of user U in the cumulative smile degree information 313. Next, the history update unit 345 updates the travel history information 314 of user U whose face recognition was successful if the face recognition was successful (step S207). Next, the reward granting unit 346 grants user U a reward corresponding to user U's cumulative smile score 313B and travel history 314B (step S208). Next, the output control unit 347 of the information processing device 300 controls the output of the output unit 250 of the authentication terminal 200-i (step S209). Specifically, the output control unit 347 generates a comparison result (ranking) between user U's cumulative smile score 313B and travel history 314B and the cumulative smile score 313B and travel history 314B of other users.Next, the communication unit 330 sends an output instruction including the comparison result to the authentication terminal 200 (step S210). Then, the output control unit 264 of the authentication terminal 200-i causes the output unit 250 to output the comparison result (step S211), and the process ends.

[0053] Figure 13 shows an example of the output unit 250 of the authentication terminal 200 that displays the comparison results. As shown in Figure 13, the display unit 251 of the output unit 250 displays a message 251A that includes the comparison results and the rewards that user U has received. As shown in Figure 13, the message 251A includes the cumulative smile score ranking "Cumulative smile score: 15th place" and the travel history ranking "Travel distance: 13th place" as comparison results. The message 251A also includes "Get 250 points!!" as the rewards that user U has received. The voice output unit 252 of the output unit 250 may also output the message by voice.

[0054] According to the authentication system 100 of this embodiment 2 described above, the smile level of user U at each location is calculated from the authentication facial information received from authentication terminals 200-1, 200-2, 200-i, and 200-n installed at multiple locations A1, A2, ..., Ai, ...An in the entertainment facility, and a cumulative smile level 313B is generated by accumulating the calculated smile levels. The authentication terminal 200 then outputs the comparison result (ranking) of the cumulative smile level 313B of user U with the cumulative smile levels 313B of other users. Therefore, compared to determining the smile level only at the final location of the entertainment facility, the appeal of the entertainment facility can be further enhanced by using facial recognition technology.

[0055] Furthermore, in the authentication system 100 according to this second embodiment, the comparison result between user U's travel history 314B and the travel history 314B of other users is output to the authentication terminal 200. Therefore, the appeal of the entertainment facility can be further enhanced using facial recognition technology.

[0056] Furthermore, in the authentication system 100 according to this second embodiment, the user U's smile score is added to update the travel history information. Specifically, the travel history 314B of the travel history information 314 includes the date and time and location information of the user U's authentication face image, as well as the smile score calculated from the authentication face image. By referring to the travel history information 314, the operator of the entertainment facility can find out which areas of the entertainment facility have a low smile score, or in other words, low customer satisfaction.

[0057] Furthermore, in the authentication system 100 according to this second embodiment, user U is granted benefits corresponding to their accumulated smile score of 313B. This further enhances the appeal of the entertainment facility.

[0058] Furthermore, in the authentication system 100 according to this second embodiment, user U is granted benefits based on their travel history 314B. This further enhances the appeal of the entertainment facilities.

[0059] Although the above embodiments were described in terms of hardware configuration, the invention is not limited thereto. This disclosure can also be implemented by having a processor execute a computer program to perform any desired processing.

[0060] In the above example, the program can be stored and supplied to the computer using various types of non-transitory computer-readable medium. Non-transitory computer-readable medium includes various types of tangible storage medium. Examples of non-transitory computer-readable medium include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, DVDs (Digital Versatile Discs), and semiconductor memory (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, RAMs (Random Access Memory)). Alternatively, the program may be supplied to the computer using various types of transient computer-readable medium. Examples of transient computer-readable medium include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable medium can be supplied to the computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels.

[0061] Although the present invention has been described above with reference to embodiments, the present invention is not limited thereto. Various modifications to the structure and details of the present invention can be made that are understandable to those skilled in the art within the scope of the invention.

[0062] Some or all of the above embodiments may also be described as follows, but are not limited to the following: (Note 1) An authentication means that controls facial recognition by comparing user facial information acquired at multiple locations within the facility with pre-registered registered facial information, A smile degree calculation means for calculating the user's smile degree from the aforementioned authentication facial information, A cumulative smile score generation means generates a cumulative smile score by accumulating the smile score of the user calculated from the authentication facial information acquired at each of the multiple locations within the facility, Output control means for controlling the output of the comparison result between the cumulative smile score of the user and the cumulative smile score of other users, An information processing device equipped with the following features. (Note 2) The system further includes a history information update means for updating travel history information relating to the user's travel history within the facility, The output control means further controls the output of the comparison result between the user's travel history and the travel history of other users. The information processing device described in Appendix 1. (Note 3) The history information updating means updates the travel history information by adding the user's smile level. The information processing device described in Appendix 2. (Note 4) The system further includes a means for granting benefits to the user in accordance with the cumulative smile level. The information processing device described in Appendix 1. (Note 5) The system further includes a means for granting benefits to the user in accordance with their travel history. The information processing device described in Appendix 2. (Note 6) Authentication terminals installed at multiple locations within the facility, The aforementioned authentication terminal and an information processing device capable of communicating with it, Equipped with, The aforementioned information processing device is User information registration means for registering user facial information in a storage means. Equipped with, The aforementioned authentication terminal is Authentication facial information acquisition means for acquiring the user's authentication facial information, Equipped with, The aforementioned information processing device is Authentication means for performing facial authentication by comparing the user's authentication facial information acquired at each of the multiple locations within the facility with the registered facial information, If the facial recognition is successful, a smile degree calculation means calculates the user's smile degree from the facial recognition information, A cumulative smile score generation means generates a cumulative smile score by accumulating the smile score of the user calculated from the authentication facial information acquired at each of the multiple locations within the facility, The authentication terminal includes an output control means that causes the user to output the result of comparing the user's cumulative smile score with the cumulative smile score of other users, An authentication system that further enhances this feature. (Note 7) The aforementioned information processing device is The system further includes a history information update means for updating travel history information relating to the user's travel history within the facility, The output control means causes the authentication terminal to output the result of comparing the user's travel history with the travel history of other users. The authentication system described in Appendix 6. (Note 8) The history information updating means updates the travel history information by adding the user's smile level. The authentication system described in Appendix 7. (Note 9) The aforementioned information processing device is The system further includes a means for granting benefits to the user in accordance with the cumulative smile level. The authentication system described in Appendix 6. (Note 10) The aforementioned information processing device is The system further includes a means for granting benefits to the user in accordance with their travel history. The authentication system described in Appendix 7. (Note 11) Computers The system controls facial recognition by comparing the user's facial information acquired at multiple locations within the facility with pre-registered facial information. The degree of the user's smile is calculated from the aforementioned authentication facial information. The user's smile level, calculated from the authentication facial information acquired at each of the multiple locations within the facility, is accumulated to generate a cumulative smile level. Controls the output of the comparison result between the cumulative smile score of the aforementioned user and the cumulative smile score of other users. Authentication method. (Note 12) The aforementioned computer, The user's travel history information within the facility is updated. Further control the output of the comparison result between the travel history of the aforementioned user and the travel history of other users. The authentication method described in Appendix 11. (Note 13) The aforementioned computer, The user's smile level is added to update the travel history information. The authentication method described in Appendix 12. (Note 14) The aforementioned computer, The user is given a reward corresponding to the cumulative smile level. The authentication method described in Appendix 11. (Note 15) The aforementioned computer, The user is given benefits corresponding to their travel history. The authentication method described in Appendix 12. (Note 16) On the computer, A process that controls facial recognition by comparing the user's authentication facial information acquired at each of multiple locations within the facility with pre-registered registered facial information, A process for calculating the user's smile level from the aforementioned authentication facial information, A process to generate a cumulative smile score by accumulating the smile score of the user calculated from the authentication facial information acquired at each of the multiple locations within the facility, A process for controlling the output of the comparison result between the cumulative smile score of the aforementioned user and the cumulative smile score of other users, A non-temporary, computer-readable medium that stores a program to execute. (Note 17) To the aforementioned computer, A process to update the user's travel history information within the facility, A process to further control the output of the comparison result between the travel history of the aforementioned user and the travel history of other users, A non-temporary computer-readable medium, as described in Appendix 16, that stores a program to execute it. (Note 18) To the aforementioned computer, A process to update the travel history information by adding the user's smile level. A non-temporary computer-readable medium, as described in Appendix 17, that stores the program that executes it. (Note 19) To the aforementioned computer, Process to grant the user a reward corresponding to the cumulative smile level. A non-temporary computer-readable medium, as described in Appendix 16, that stores a program to execute it. (Note 20) To the aforementioned computer, Process to grant the user benefits corresponding to the aforementioned travel history. A non-temporary computer-readable medium, as described in Appendix 17, that stores the program that executes it. [Explanation of symbols]

[0063] 10,300 Information Processing Devices 100 Authentication Systems 200 Authentication Terminals 11 Storage unit (storage means) 310 Storage unit (storage means) 12,341 Registration section (User information registration means) 13,342 Authentication section (authentication means) 14,343 Smile level calculation unit (smile level calculation means) 15,344 Generation Unit (Cumulative Smile Level Generation Means) 16,347 Output control unit (output control means) 345 History update unit (means for updating history information) 346. Reward Granting Section (Method of Granting Rewards) 261 Image acquisition unit (means for acquiring facial information for authentication)

Claims

1. An authentication means that controls facial recognition by comparing user facial information acquired at multiple locations within the facility with pre-registered registered facial information, A smile degree calculation means for calculating the user's smile degree from the aforementioned authentication facial information, A cumulative smile score generation means generates a cumulative smile score by accumulating the smile score of the user calculated from the authentication facial information acquired at each of the multiple locations within the facility, Output control means for controlling the output of the comparison result between the cumulative smile score of the user and the cumulative smile score of other users, A history information update means for updating the travel history information relating to the user's travel history within the facility, Equipped with, The output control means is an information processing device that further controls the output of the comparison result between the user's travel history and the travel history of other users.

2. The history information updating means updates the travel history information by adding the user's smile level. The information processing apparatus according to claim 1.

3. The system further includes a means for granting benefits to the user in accordance with the cumulative smile level. The information processing apparatus according to claim 1.

4. The system further includes a means for granting benefits to the user in accordance with their travel history. The information processing apparatus according to claim 1.

5. Authentication terminals installed at multiple locations within the facility, The aforementioned authentication terminal and an information processing device capable of communicating with it, Equipped with, The aforementioned information processing device is User information registration means for registering user facial information in a storage means. Equipped with, The aforementioned authentication terminal is Authentication facial information acquisition means for acquiring the user's authentication facial information, Equipped with, The aforementioned information processing device is Authentication means for performing facial authentication by comparing the user's authentication facial information acquired at each of the multiple locations within the facility with the registered facial information, If the facial recognition is successful, a smile degree calculation means calculates the user's smile degree from the facial recognition information, A cumulative smile score generation means generates a cumulative smile score by accumulating the smile score of the user calculated from the authentication facial information acquired at each of the multiple locations within the facility, The authentication terminal includes an output control means that causes the user to output the result of comparing the user's cumulative smile score with the cumulative smile score of other users, A history information update means for updating travel history information relating to the user's travel history within the facility, Furthermore, The output control means is an authentication system that causes the authentication terminal to output the result of comparing the user's travel history with the travel history of other users.

6. Computers The system controls facial recognition by comparing the user's facial information acquired at multiple locations within the facility with pre-registered facial information. The degree of the user's smile is calculated from the aforementioned authentication facial information. The user's smile level, calculated from the authentication facial information acquired at each of the multiple locations within the facility, is accumulated to generate a cumulative smile level. Control the output of the comparison result between the cumulative smile score of the aforementioned user and the cumulative smile score of other users. The user's travel history information within the facility is updated. Further control the output of the comparison result between the travel history of the aforementioned user and the travel history of other users. Authentication method.

7. On the computer, A process that controls facial recognition by comparing the user's authentication facial information acquired at each of multiple locations within the facility with pre-registered registered facial information, A process for calculating the user's smile level from the aforementioned authentication facial information, A process to generate a cumulative smile score by accumulating the smile score of the user calculated from the authentication facial information acquired at each of the multiple locations within the facility, A process for controlling the output of the comparison result between the cumulative smile score of the aforementioned user and the cumulative smile score of other users, A process to update the user's travel history information within the facility, A process to further control the output of the comparison result between the travel history of the aforementioned user and the travel history of other users, A program that executes the command.

Images