Information processing device, authentication system, authentication method and program

Abstract

Provided are an information processing device, an authentication system, an authentication method, and a non-transitory computer-readable medium with which it is possible to further improve the attractiveness of recreational facilities. An information processing device (10) comprises an authentication unit (13) that controls face authentication by verification of the face information for authentication of a user having been acquired at each of a plurality of points in a facility against the face information for registration having been registered in advance, a smile degree calculation unit (14) that calculates the smile degree of the user from the face information for authentication, a generation unit (15) that accumulates the smile degrees of the user calculated from the face information for authentication having been acquired at each of the plurality of points in the facility and generates a cumulative smile degree, and an output control unit (16) that controls the output of the result of comparison of the cumulative smile degree of the user with the cumulative smile degrees of other users.

Description

Information processing device, authentication system, authentication method, and non-transitory computer-readable medium

[0001] The present disclosure relates to an information processing device, an authentication system, an authentication method, and a non-transitory computer-readable medium.

[0002] Technologies using facial recognition have been developed for entertainment facilities to make payments and process admissions to attractions. Attempts have also been made to improve the appeal of entertainment facilities by using facial recognition technology. For example, Patent Literature 1 describes a technique for generating a composite image using a photo frame (template) according to a smile point, which indicates the degree of a smile, when a user in an image captured during facial recognition at a final destination is smiling.

[0003] International Publication No. 2021 / 250817

[0004] However, in Patent Document 1, the smile level is determined only at the final point of the amusement facility. It is desirable to further improve the appeal of amusement facilities by using face recognition technology.

[0005] An object of the present disclosure is to provide an information processing device, an authentication system, an authentication method, and a non-transitory computer-readable medium that can further improve the appeal of entertainment facilities.

[0006] An information processing device according to a first aspect of the present disclosure includes an authentication means for controlling face authentication by comparing a user's authentication face information acquired at each of a plurality of locations within a facility with pre-registered registration face information; a smile degree calculation means for calculating the user's smile degree from the authentication face information; a cumulative smile degree generation means for generating a cumulative smile degree by accumulating the user's smile degrees calculated from the authentication face information acquired at each of the plurality of locations within the facility; and an output control means for controlling output of a comparison result between the user's cumulative smile degree and the cumulative smile degrees of other users.

[0007] An authentication system according to a second aspect of the present disclosure comprises authentication terminals installed at multiple locations within a facility, and an information processing device capable of communicating with the authentication terminal, wherein the information processing device comprises user information registration means for registering a user's registration face information in a storage means, and the authentication terminal comprises authentication face information acquisition means for acquiring the user's authentication face information, and the information processing device further comprises authentication means for performing face authentication by comparing the user's authentication face information acquired at each of the multiple locations within the facility with the registration face information, smile degree calculation means for calculating the user's smile degree from the authentication face information if the face authentication is successful, cumulative smile degree generation means for generating a cumulative smile degree by accumulating the user's smile degrees calculated from the authentication face information acquired at each of the multiple locations within the facility, and output control means for causing the authentication terminal to output a comparison result between the user's cumulative smile degree and the cumulative smile degrees of other users.

[0008] An authentication method according to a third aspect of the present disclosure is a method in which a computer controls face authentication by comparing a user's authentication face information acquired at each of a plurality of locations within a facility with pre-registered registration face information, calculates the user's smile level from the authentication face information, accumulates the user's smile levels calculated from the authentication face information acquired at each of the plurality of locations within the facility to generate a cumulative smile level, and controls output of a comparison result between the user's cumulative smile level and the cumulative smile levels of other users.

[0009] A non-transitory computer-readable medium according to a fourth aspect of the present disclosure stores a program that causes a computer to execute the following processes: controlling facial authentication by comparing a user's authentication face information acquired at each of a plurality of locations within a facility with pre-registered registration face information; calculating the user's smile level from the authentication face information; accumulating the user's smile levels calculated from the authentication face information acquired at each of the plurality of locations within the facility to generate a cumulative smile level; and controlling output of a comparison result between the user's cumulative smile level and the cumulative smile levels of other users.

[0010] It is possible to provide an information processing device, an authentication system, an authentication method, and a non-transitory computer-readable medium that can further improve the appeal of entertainment facilities.

[0011] 1 is a block diagram showing an example of an information processing device according to embodiment 1. FIG. 2 is a flowchart showing an example of an authentication method according to embodiment 1. FIG. 3 is a block diagram showing an example of an authentication system according to embodiment 2. FIG. 4 is a block diagram showing an example of an authentication terminal according to embodiment 2. FIG. 5 is a block diagram showing an example of an information processing device according to embodiment 2. FIG. 6 is a diagram showing an example of a data structure of user information according to embodiment 2. FIG. 7 is a diagram showing an example of a data structure of accumulated smile level information according to embodiment 2. FIG. 8 is a diagram showing an example of a data structure of tour history information according to embodiment 2. FIG. 9 is a diagram showing an example of a data structure of reward granting conditions according to embodiment 2. FIG. 10 is a flowchart showing an example of a user information registration process in the authentication method according to embodiment 2. FIG. 11 is a flowchart showing an example of an authentication method according to embodiment 2. FIG. 12 is a flowchart showing an example of an authentication method according to embodiment 2. FIG. 13 is a diagram showing an example of a display unit of the authentication terminal according to embodiment 2.

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. <Embodiment 1> FIG. 1 is a block diagram illustrating an example of an information processing device 10 according to embodiment 1. The information processing device 10 performs face authentication processing of a user acquired at each of a plurality of locations in an entertainment facility such as a theme park. Here, the user refers to a visitor to the entertainment facility. The information processing device 10 is capable of communicating with authentication terminals (not shown) installed at each of a plurality of locations in the entertainment facility. The information processing device 10 may also be capable of communicating with a user terminal (not shown) carried by the user. The information processing device 10 may also be capable of communicating with a registration terminal (not shown) installed inside or outside the entertainment facility.

[0013] As shown in FIG. 1 , the information processing device 10 includes a storage unit 11 , a registration unit 12 , an authentication unit 13 , a smile level calculation unit 14 , a generation unit 15 , and an output control unit 16 .

[0014] The storage unit 11 is also called a storage means and stores face information for registration.

[0015] The registration unit 12 is also referred to as a user information registration means. The registration unit 12 registers user information in the storage unit 11. Here, the user information includes at least the user's facial information for registration. The user's facial information for registration is, for example, information extracted from a facial image generated by photographing the user's face. Note that a facial image acquired by photographing the user's face using one of authentication terminals installed at each of multiple locations in an entertainment facility may be transmitted from the authentication terminal to the information processing device 10. The information processing device 10 may also be equipped with a camera (not shown), which may photograph the user's face and acquire the facial image. Alternatively, the user's face may be photographed using a camera of a user terminal capable of communicating with the information processing device 10, and the facial image may be input from the user terminal to the information processing device 10.

[0016] The authentication unit 13 is also called an authentication means. The authentication unit 13 controls face authentication by comparing the user's authentication face information acquired by authentication terminals installed at multiple locations in the entertainment facility with the registration face information stored in the storage unit 11. Note that the biometric authentication process may be performed in the information processing device 10 or in another device, for example, an authentication terminal (not shown).

[0017] The smile degree calculation unit 14 is also called a smile degree calculation means. When face authentication is successful, the smile degree calculation unit 14 calculates the user's smile degree from the authentication face information. The calculated smile degree is supplied to the generation unit 15.

[0018] The generation unit 15 is also referred to as a cumulative smile degree generation unit. The generation unit 15 generates a cumulative smile degree by accumulating the user's smile degree calculated from the authentication face information acquired at each of multiple points within the facility. The generated cumulative smile degree is supplied to the output control unit 16.

[0019] The output control unit 16 is also called output control means. The output control unit 16 controls the output of the comparison result between the user's cumulative smile degree and the cumulative smile degrees of other users in the authentication terminal. Specifically, the output control unit 16 generates a comparison result between the user's cumulative smile degree and the cumulative smile degrees of other users, and controls the output of the authentication terminal to display the comparison result.

[0020] FIG. 2 is a flowchart illustrating an authentication method according to the first embodiment. First, the registration unit 12 registers the user's registration face information in the storage unit 11 (step S10). Next, when the authentication unit 13 receives the authentication face information from authentication terminals installed at multiple locations in the entertainment facility, it performs face authentication by comparing the registration face information with the authentication face information (step S11). If the face authentication is unsuccessful (No in step S12), the process ends. On the other hand, if the face authentication is successful (Yes in step S12), the smile degree calculation unit 14 calculates the user's smile degree from the authentication face information (step S13). Next, the generation unit 15 accumulates the smile degrees calculated in step S13 to generate a cumulative smile degree (step S14). Specifically, the generation unit 15 adds the smile degree calculated in step S13 to the smile degree accumulated before the face authentication in step S11 to generate a cumulative smile degree. Next, the output control unit 16 causes the authentication terminal to output the comparison result between the user's cumulative smile degree and the cumulative smile degrees of other users (step S15), and ends this process.

[0021] According to the information processing device 10 of the first embodiment described above, the smile degree of a user at each of a plurality of locations in an entertainment facility is calculated from the authentication face information received from the authentication terminals installed at each of the locations, and a cumulative smile degree is generated by accumulating the calculated smile degrees. Then, a comparison result (ranking) of the cumulative smile degree of the user with the cumulative smile degrees of other users is output to the authentication terminal. Therefore, the use of face recognition technology can further enhance the appeal of the entertainment facility compared to when the smile degree is determined only at the final location of the entertainment facility.

[0022] The information processing device 10 includes a processor, memory, and storage device (not shown). The storage device stores a computer program that implements the processing of the authentication method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. This allows the processor to implement the functions of a registration unit 12, authentication unit 13, smile level calculation unit 14, generation unit 15, and output control unit 16.

[0023] Alternatively, the registration unit 12, authentication unit 13, smile level calculation unit 14, generation unit 15, and output control unit 16 may each be realized by dedicated hardware. Furthermore, some or all of the components of each device may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), etc. may be used as the processor.

[0024] Second Embodiment Next, an authentication system 100 according to a second embodiment will be described. Fig. 3 is a block diagram showing the overall configuration of the authentication system 100 according to the second embodiment. The authentication system 100 is a computer system that performs biometric authentication of a user U in an entertainment facility such as a theme park. In the following, facial authentication will be described as an example of biometric authentication, but the present invention is not limited to this.

[0025] The authentication system 100 includes authentication terminals 200-1, 200-2, ... 200-i, ... 200-n (1 ≤ i ≤ n, n is a positive integer) and an information processing device 300. The authentication terminals 200-1, 200-2, ... 200-i, ... 200-n and the information processing device 300 are capable of communicating with each other via a network N. The information processing device 300 may be capable of communicating with a user terminal (not shown) carried by a user. The information processing device 300 may be capable of communicating with a registration terminal (not shown) installed inside or outside the entertainment facility. The authentication terminals 200-1, 200-2, ... 200-i, ... 200-n may be capable of communicating with the user terminal using a predetermined method of short-range wireless communication. Furthermore, the authentication terminals 200-1, 200-2, ... 200-i, ... 200-n may be capable of communicating with the user terminals via a network N. Furthermore, the network N is a wired or wireless communication line.

[0026] Hereinafter, when referring to the authentication terminals 200-1, 200-2, ... 200-i, ... 200-n without distinguishing between them, each of the authentication terminals 200-1, 200-2, ... 200-i, ... 200-n may be simply referred to as the authentication terminal 200. The authentication terminals 200 are, for example, digital signage that are installed at each of a plurality of points 1, 2, ... point i, ... point n in an entertainment facility.

[0027] 4 is a block diagram showing an example of the authentication terminal 200. As shown in FIG. 4, the authentication terminal 200 includes a camera 210, a storage unit 220, a memory 230, a communication unit 240, an output unit 250, and a control unit 260.

[0028] The camera 210 takes an image in accordance with the control of the control unit 260. The camera 210 takes an image of the face of the user U in accordance with the control of the control unit 260.

[0029] The storage unit 220 is a storage device that stores a program 221 for realizing each function of the authentication terminal 200. The memory 230 is a volatile storage device such as RAM, and is a storage area for temporarily storing information when the control unit 260 is operating. The communication unit 240 is a communication interface with the network N.

[0030] The output unit 250 outputs the information processing result of the control unit 260. For example, the output unit 250 has a display unit 251 and an audio output unit 252. The display unit 251 is a display device that displays the information processing result of the control unit 260. The authentication terminal 200 may also include an input unit (not shown) that accepts input, and the display unit 251 and the input unit may be integrated into one unit, such as a touch panel. The audio output unit 252 includes a speaker (not shown) and outputs the information processing result of the control unit 260 as audio.

[0031] The control unit 260 is a processor, i.e., a control device, that controls each component of the authentication terminal 200. The control unit 260 loads the program 221 from the storage unit 220 into the memory 230 and executes the program 221. In this way, the control unit 260 realizes the functions of an image acquisition unit 261, a registration information acquisition unit 262, a settlement unit 263, and an output control unit 264.

[0032] The image acquisition unit 261 is also referred to as an authentication face information acquisition unit. The image acquisition unit 261 controls the camera 210 to capture an image of the face of the user U and generate an authentication face image that includes at least the facial region of the user U. The image acquisition unit 261 then acquires the authentication face image and the capture date and time from the camera 210. The image acquisition unit 261 supplies the authentication face image and the capture date and time to the communication unit 240 and causes the communication unit 240 to transmit the authentication face image and the capture date and time together with location information of the authentication terminal 200 (point 1, point 2, ... point i, ... point n) to the information processing device 300. The image acquisition unit 261 may also control the camera 210 to capture an image of the face of the user U and generate a registration face image that includes at least the facial region of the user U. The image acquisition unit 261 may then supply the registration face image to the communication unit 240 and cause the communication unit 240 to transmit the registration face image to the information processing device 300. The facial image for registration may be captured by a user terminal (not shown) and transmitted from the user terminal to the information processing device 300. Alternatively, the facial image for registration may be captured by a registration terminal installed inside or outside the entertainment facility and transmitted from the registration terminal to the information processing device 300.

[0033] The registration information acquisition unit 262 acquires the registration information of the user U. Here, the registration information of the user U includes the user U's name, address, telephone number, information required for payment, payment information, benefit information, etc. The information required for payment includes the card number used for payment, expiration date, etc. The payment information includes the name of the product or service purchased by the user U, the price of the product or service, the purchase date and time, etc. The name of the product purchased by the user U includes the name of the food and drink consumed by the user U at the entertainment facility, etc. The name of the service purchased by the user U includes the name of the attraction experienced by the user U at the entertainment facility, etc. Benefit information includes the number of points earned, coupons, etc. The registration information may be input to the authentication terminal 200 by the user U operating an input unit (not shown) of the authentication terminal 200. The registration information acquisition unit 262 may include a card reader and acquire the registration information of the user U by reading, for example, a driver's license or a credit card. Then, the registration information acquisition unit 262 supplies the registration information of the user U to the communication unit 240, and causes the communication unit 240 to transmit the registration information to the information processing device 300. The registration information may be transmitted from a user terminal (not shown) to the information processing device 300. The registration information may also be transmitted to the information processing device 300 from a registration terminal installed inside or outside the entertainment facility.

[0034] The payment unit 263 executes payment when facial authentication for making payment at the authentication terminal 200 is successful. Specifically, the payment unit 263 acquires information necessary for payment of user U whose facial authentication was successful from the information processing device 300, and executes payment. The payment unit 263 acquires the information necessary for payment from registration information 312C associated with user ID 312A received from the information processing device 300 together with the facial authentication result. After completing the payment, the payment unit 263 supplies the payment information of the user U to the communication unit 240, and causes the communication unit 240 to transmit the payment information to the information processing device 300.

[0035] The output control unit 264 controls the output unit 250, causes the output unit 250 to output the information processing result, and notifies the user U of the information processing result. For example, when the output control unit 264 receives an output instruction (described later) from the information processing device 300, it causes the output unit 250 to output a comparison result (described later). In addition, the output control unit 264 causes the output unit 250 to output the face authentication result, and notifies the user U of the face authentication result.

[0036] 5 is a block diagram showing an example of the information processing device 300. As shown in FIG. 5, the information processing device 300 includes a storage unit 310, a memory 320, a communication unit 330, and a control unit 340.

[0037] The storage unit 310 is a storage device that stores a program 311 for realizing each function of the information processing device 300. The memory 320 is a volatile storage device such as a RAM, and is a storage area for temporarily storing information when the control unit 340 is operating. The communication unit 330 is a communication interface with the network N.

[0038] The storage unit 310 stores user information 312. Therefore, the storage unit 310 is also referred to as a storage means. Fig. 6 shows an example of the user information 312. As shown in Fig. 6, the user information 312 is information in which a user ID 312A, registration face information 312B, and registration information 312C are associated with each other. Note that the user information 312 may also include management information such as the date and time when the registration face image was captured.

[0039] The storage unit 310 stores cumulative smile level information 313. Fig. 7 shows an example of the cumulative smile level information 313. As shown in Fig. 7, the cumulative smile level information 313 is information in which a user ID 313A is associated with a cumulative smile level 313B.

[0040] The storage unit 310 stores the travel history information 314. FIG. 8 shows an example of the travel history information 314. As shown in FIG. 8, the travel history information 314 is information in which a user ID 314A is associated with a travel history 314B. The travel history 314B is the user U's travel history at the entertainment facility. Specifically, the travel history 314B is the capture date and time of the authentication facial image of the user U and the location information of the authentication terminal 200, which are received from the authentication terminal 200. Note that the travel history 314B may include, in addition to the capture date and time and location information of the authentication facial image of the user U, a smile level calculated from the authentication facial image. This allows the storage unit 310 to store the history of the user U's smile level as the travel history information 314. This allows the operator of the entertainment facility to know in which areas of the entertainment facility the smile level is low, in other words, in which customer satisfaction is low.

[0041] The storage unit 310 stores the reward condition 315. Fig. 9 shows an example of the reward condition 315. As shown in Fig. 9, the reward condition 315 is information in which a cumulative smile level 315A is associated with a reward 315B. The reward condition 315 may also be information in which a travel distance is associated with a reward.

[0042] The control unit 340 is a processor, i.e., a control device, that controls each component of the information processing device 300. The control unit 340 loads the program 311 from the storage unit 310 into the memory 320 and executes the program 311. In this way, the control unit 340 realizes the functions of a registration unit 341, an authentication unit 342, a smile level calculation unit 343, a generation unit 344, a history update unit 345, a reward granting unit 346, an output control unit 347, and a notification unit 348.

[0043] The registration unit 341 is also referred to as a user information registration means. The registration unit 341 registers user information 312 in the storage unit 310. When the registration unit 341 receives a registration face image and registration information from any of the authentication terminal 200, a user terminal (not shown), or a registration terminal (not shown), the registration unit 341 acquires registration face information 312B from the registration face image. Next, the registration unit 341 associates the user ID 312A, the registration face information 312B, and the registration information 312C, and stores them in the storage unit 310 as user information 312. As an example, the face information may be a collection of feature points extracted from a face image. Specifically, the registration unit 341 detects a face area included in the registration face image, extracts feature points from the detected face area, and sets information on the extracted feature points as registration face information 312B. The registration unit 341 also generates a user ID 312A. The user ID 312A may be input to the authentication terminal 200, the user terminal (not shown), or the registration terminal (not shown) by the user U operating an input unit (not shown) of the authentication terminal 200, the user terminal (not shown), or the registration terminal (not shown). The user ID 312A may then be transmitted to the information processing device 300 from the authentication terminal 200, the user terminal (not shown), or the registration terminal (not shown) together with a registration face image and registration information. Furthermore, a password may be transmitted to the information processing device 300 from the authentication terminal 200, the user terminal (not shown), or the registration terminal (not shown) together with the user ID 312A. In other words, the registration unit 341 may associate the user ID 312A, the password, registration face information 312B, and registration information 312C, and store them in the storage unit 310 as user information 312. In addition, when management information such as the date and time of shooting of the registration face image is sent from either the authentication terminal 200, a user terminal (not shown), or a registration terminal (not shown), the registration unit 341 may associate the user ID 312A, registration face information 312B, registration information 312C, and the management information, and store them in the memory unit 310 as user information 312.

[0044] The authentication unit 342 is also referred to as authentication means. When the authentication unit 342 receives an authentication face image from the authentication terminal 200, it performs face authentication. Then, the authentication unit 342 acquires authentication face information from the authentication face image transmitted from the authentication terminal 200 and performs face authentication by comparing the authentication face information with the registration face information 312B. The method for acquiring the authentication face information from the authentication face image is the same as the method for acquiring the registration face information 312B from the registration face image in the registration unit 341, and therefore a description thereof will be omitted. Furthermore, when the authentication face information matches the registration face information 312B, the authentication unit 342 refers to the user information 312 and acquires the user ID 312A associated with the registration face information 312B. Then, the authentication unit 342 supplies the notification unit 348 with the user ID 312A and whether or not the face information matches. Furthermore, if the authentication face information matches the registration face information 312B, the authentication unit 342 supplies the authentication face information to the smile degree calculation unit 343. Whether the face information matches corresponds to whether authentication was successful. Note that the face information matches (matches) when the degree of match is equal to or greater than a predetermined value. Note that the face authentication process may be performed in another device, for example, the authentication terminal 200. In this case, the authentication unit 342 only needs to control the face authentication process performed in the other device.

[0045] The smile degree calculation unit 343 is also referred to as a smile degree calculation unit. If face authentication is successful, the smile degree calculation unit 343 calculates the smile degree of the user U from the authentication face information. The calculated smile degree is supplied to the generation unit 344. The calculated smile degree may also be supplied to the history update unit 345. Here, a specific example of calculating the smile degree of the user U will be described. Generally, when a person smiles, characteristics such as the corners of the mouth turning up, the corners of the eyes drooping, the eyes narrowing, and wrinkles appearing around the mouth appear in the face area. For this reason, the smile degree calculation unit 343 may extract feature points of facial features such as the eyes and mouth from the face area of ​​the user U and calculate the smile degree based on the coordinates of each extracted feature point. The smile degree calculation unit 343 may also calculate the smile degree using a trained classifier. The classifier may be a support vector machine (SVM) that receives feature amounts of facial features and outputs whether the smile degree is equal to or greater than a predetermined value. The classifier may also be a convolutional neural network (CNN) that receives the face region of the captured image as input and outputs a smile degree. The method for calculating the smile degree is not limited to the above, and any existing method may be used. Furthermore, when the captured image includes the face regions of the user U and their companion, the smile degree calculation unit 343 may calculate the smile degree based on the smile degree of the face region of the companion in addition to the smile degree of the face region of the user U. For example, the smile degree calculation unit 343 may calculate the smile degree as the average value of the smile degree of the face region of the user U and the smile degree of the face region of the companion.

[0046] The generation unit 344 is also referred to as a cumulative smile degree generation unit. The generation unit 344 generates a cumulative smile degree by accumulating the smile degrees of the user U calculated from the authentication face information acquired at each of multiple points A1, A2, ..., Ai, ..., An within the facility. Specifically, the generation unit 344 adds the calculated smile degree to the cumulative smile degree 313B associated with the user ID 313A of the user U in the cumulative smile degree information 313 shown in FIG. 7 to generate a new cumulative smile degree. The generation unit 344 also associates the user ID 313A with the generated cumulative smile degree 313B and stores the associated cumulative smile degree information 313 in the storage unit 310 as the cumulative smile degree information 313. The generated cumulative smile degree is also supplied to the bonus granting unit 346 and the output control unit 347.

[0047] The history update unit 345 is also referred to as a history information update unit. When face authentication is successful, the history update unit 345 updates the travel history information 314 of the user U whose face authentication has been successful. Specifically, the history update unit 345 adds the capture date and time of the authentication face image and the location information of the authentication terminal 200 (point 1, point 2, ... point i, ... point n) received together with the authentication face image from the authentication terminal 200 to the travel history 314B of the travel history information 314 shown in FIG. 8 . The history update unit 345 may also add the smile degree received from the smile degree calculation unit 343, together with the capture date and time of the authentication face image of the user U and the location information.

[0048] The reward granting unit 346 is also referred to as a reward granting means. The reward granting unit 346 grants a reward to the user U according to the accumulated smile level. Specifically, the reward granting unit 346 grants the user U a reward 315B corresponding to the accumulated smile level 315A received from the generation unit 344 based on the reward granting conditions 315 shown in FIG. 9 . More specifically, the reward granting unit 346 adds the reward 315B to the reward included in the registration information 312C of the user U in the user information 312. The reward granting unit 346 may transmit the reward 315B to the user terminal (not shown) of the user U. The reward granting unit 346 may also grant the user U a reward according to the user's travel history. For example, the reward granting unit 346 may refer to the travel history 314B corresponding to the user ID 314A of the user U, acquire the user U's travel distance, and grant the user U a reward according to the travel distance. The travel distance may be the sum of the distances between each of the points (point 1, point 2, . . . point i, . . . point n) that the user U stopped at and included in the travel history 314B.

[0049] The output control unit 347 is also referred to as output control means. When face authentication is successful, the output control unit 347 causes the authentication terminal 200 to output a comparison result between the cumulative smile level 313B of user U and the cumulative smile levels 313B of other users. Specifically, the output control unit 347 references the cumulative smile level information 313 shown in FIG. 7 and generates a comparison result between the cumulative smile level 313B of user U and the cumulative smile levels 313B of other users. The output control unit 347 then causes the communication unit 330 to send an output instruction including the generated comparison result to the authentication terminal 200. The output control unit 347 may also cause the authentication terminal 200 to output a comparison result between the user U's travel history 314B and the other users' travel history 314B. Specifically, the output control unit 347 references the travel history information 314 shown in FIG. 8 and generates a comparison result between the user U's travel distance and the other users' travel distance. Then, the output control unit 347 causes the communication unit 330 to transmit an output instruction including the generated comparison result to the authentication terminal 200 .

[0050] If the facial authentication result indicates a match in facial information, that is, if the facial authentication is successful, the notification unit 348 notifies the authentication terminal 200 of the facial authentication result and the user ID 312A. The facial authentication result may include the user ID 312A. The notification unit 348 may also transmit an error notification to the authentication terminal 200 indicating that the facial authentication has failed. The notification unit 348 may include the user ID 312A in the error notification, but this is not limited to this.

[0051] FIG. 10 is a flowchart illustrating an example of a user information registration process in the authentication method according to the second embodiment. The following flowchart illustrates an example in which a registration facial image and registration information of user U are acquired by authentication terminal 200-1, which is located at the first point A1 among authentication terminals 200-1, 200-2, ..., 200-i, ..., 200-n installed at multiple points A1, A2, ..., Ai, ..., An in an entertainment facility. Here, the first point A1 is, for example, the location of authentication terminal 200-1, which is installed at or near the gate of the entertainment facility. However, user U's registration facial image and registration information may also be acquired by user U's user terminal (not shown) or a registration terminal installed inside or outside the entertainment facility and transmitted to information processing device 300. First, image acquisition unit 261 of authentication terminal 200-1 causes camera 210 to capture user U's face and acquire the registration facial image (step S101). Next, the registration information acquisition unit 262 of the authentication terminal 200-1 acquires the registration information of the user U (step S102). Next, the communication unit 240 transmits the registration face image and the registration information to the information processing device 300 and requests user registration (step S103). Next, the registration unit 341 of the information processing device 300 performs user registration (step S104), and ends this process. Specifically, the registration unit 341 generates registration face information 312B from the registration face image. The registration unit 341 also generates a user ID 312A. Then, the registration unit 341 associates the user ID 312A, the registration face information 312B, and the registration information 312C, and stores them in the storage unit 310 as user information 312.

[0052] 11 and 12 are flowcharts illustrating an authentication method according to the second embodiment. The authentication method illustrated in FIGS. 11 and 12 is performed after the user information registration process illustrated in FIG. 10 has been performed. First, the image acquisition unit 261 of the authentication terminal 200-i causes the camera 210 to capture a face image of the user U to acquire an authentication face image (step S201). Next, the communication unit 240 transmits the authentication face image, the capture date and time, and location information to the information processing device 300, and issues an authentication request (step S202). Next, the authentication unit 342 of the information processing device 300 performs face authentication (step S203). Specifically, the authentication unit 342 generates authentication face information from the authentication face image, compares the authentication face information with the registration face information 312B in the user information 312, and determines that face authentication has been successful if the degree of match between the face information is equal to or greater than a predetermined value. Next, the notification unit 348 notifies the authentication terminal 200-i of the authentication result indicating whether or not the facial authentication was successful and the user ID 312A (step S204). Next, if the facial authentication is successful, the smile degree calculation unit 343 calculates the smile degree of the user U from the authentication face information (step S205). Note that between steps S204 and S205, the output control unit 264 of the authentication terminal 200-i may notify the user U of the facial authentication result by displaying or outputting the facial authentication result as audio on the output unit 250. Next, if the facial authentication is successful, the generation unit 344 accumulates the smile degrees of the user U to generate a cumulative smile degree (step S206). Specifically, the generation unit 344 adds the smile degree calculated in step S205 to the cumulative smile degree 313B associated with the user ID 313A of the user U in the cumulative smile degree information 313. Next, if the facial authentication is successful, the history update unit 345 updates the browsing history information 314 of the user U whose facial authentication was successful (step S207). Next, the reward granting unit 346 grants the user U a reward based on the accumulated smile level 313B and browsing history 314B of the user U (step S208). Next, the output control unit 347 of the information processing device 300 controls the output of the output unit 250 of the authentication terminal 200-i (step S209). Specifically, the output control unit 347 generates a comparison result (ranking) between the accumulated smile level 313B and browsing history 314B of the user U and the accumulated smile levels 313B and browsing history 314B of other users.Next, the communication unit 330 transmits an output instruction including the comparison result to the authentication terminal 200 (step S210). Next, the output control unit 264 of the authentication terminal 200-i causes the output unit 250 to output the comparison result (step S211), and this process ends.

[0053] 13 shows an example of the output unit 250 of the authentication terminal 200 that displays the comparison result. As shown in FIG. 13, the display unit 251 of the output unit 250 displays a message 251A including the comparison result and the benefit acquired by the user U. As shown in FIG. 13, the message 251A includes, as the comparison result, a cumulative smile degree ranking of "Cumulative smile degree: 15th place" and a travel history ranking of "Travel distance: 13th place." The message 251A also includes "Get 250 points!!" as a benefit acquired by the user U. The audio output unit 252 of the output unit 250 may output the message by voice.

[0054] According to the authentication system 100 of the second embodiment described above, the smile degree of the user U at each of the multiple points A1, A2, ..., Ai, ..., An in the entertainment facility is calculated from the authentication face information received from the authentication terminals 200-1, 200-2, ..., 200-i, ..., 200-n installed at each of the multiple points A1, A2, ..., Ai, ..., An, and the calculated smile degrees are accumulated to generate a cumulative smile degree 313B. Then, a comparison result (ranking) between the cumulative smile degree 313B of the user U and the cumulative smile degrees 313B of other users is output to the authentication terminal 200. Therefore, the use of facial recognition technology can further enhance the appeal of the entertainment facility compared to when the smile degree is determined only at the final point in the entertainment facility.

[0055] Furthermore, the authentication system 100 according to the second embodiment further causes the authentication terminal 200 to output a comparison result between the user U's travel history 314B and the other users' travel history 314B. Therefore, the face recognition technology can be used to further improve the appeal of the entertainment facility.

[0056] Furthermore, in the authentication system 100 according to the second embodiment, the visit history information is updated by adding the smile degree of the user U. Specifically, the visit history 314B of the visit history information 314 includes the smile degree calculated from the authentication face image of the user U, in addition to the photographing date and time and location information of the authentication face image. By referring to the visit history information 314, the operator of the entertainment facility can know in which areas of the entertainment facility the smile degree is low, in other words, in which areas customer satisfaction is low.

[0057] Furthermore, in the authentication system 100 according to the second embodiment, a benefit according to the cumulative smile level 313B is given to the user U. This can further increase the appeal of the entertainment facility.

[0058] Furthermore, in the authentication system 100 according to the second embodiment, a benefit according to the tour history 314B is given to the user U. This can further enhance the appeal of the entertainment facility.

[0059] Although the above-described embodiment has been described as a hardware configuration, the present disclosure is not limited to this. Any processing in the present disclosure can also be realized by causing a processor to execute a computer program.

[0060] In the above examples, the program can be stored and supplied to a computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, DVDs (Digital Versatile Discs), and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). The program may also be supplied to a computer by various types of transitory computer-readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire or an optical fiber, or via a wireless communication path.

[0061] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

[0062] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. (Supplementary Note 1) An information processing device comprising: authentication means for controlling face authentication by comparing authentication face information of a user acquired at each of a plurality of points within a facility with pre-registered registration face information; smile degree calculation means for calculating a smile degree of the user from the authentication face information; cumulative smile degree generation means for generating a cumulative smile degree by accumulating the smile degrees of the user calculated from the authentication face information acquired at each of the plurality of points within the facility; and output control means for controlling output of a comparison result between the cumulative smile degree of the user and the cumulative smile degrees of other users. (Supplementary Note 2) The information processing device according to Supplementary Note 1 further comprises history information update means for updating tour history information related to the tour history of the user within the facility, and the output control means further controls output of a comparison result between the tour history of the user and the tour histories of other users. (Supplementary Note 3) The information processing device according to Supplementary Note 2, wherein the history information update means updates the tour history information by adding the smile level of the user. (Supplementary Note 4) The information processing device according to Supplementary Note 1, further comprising: a reward granting means for granting a reward to the user according to the accumulated smile level. (Supplementary Note 5) The information processing device according to Supplementary Note 2, further comprising: a reward granting means for granting a reward to the user according to the tour history.(Supplementary Note 6) An authentication system comprising: authentication terminals installed at a plurality of locations within a facility; and an information processing device capable of communicating with the authentication terminal, wherein the information processing device comprises: user information registration means for registering registration face information of a user in a storage means; the authentication terminal comprises: authentication face information acquisition means for acquiring the authentication face information of the user; and the information processing device further comprises: authentication means for performing face authentication by comparing the authentication face information of the user acquired at each of the plurality of locations within the facility with the registration face information; smile degree calculation means for calculating the smile degree of the user from the authentication face information if the face authentication is successful; cumulative smile degree generation means for generating a cumulative smile degree by accumulating the smile degrees of the user calculated from the authentication face information acquired at each of the plurality of locations within the facility; and output control means for causing the authentication terminal to output a comparison result between the cumulative smile degree of the user and the cumulative smile degrees of other users. (Supplementary Note 7) The authentication system of Supplementary Note 6, wherein the information processing device further comprises history information updating means for updating tour history information relating to the user's tour history within the facility, and wherein the output control means causes the authentication terminal to output a comparison result between the user's tour history and the tour histories of other users. (Supplementary Note 8) The authentication system of Supplementary Note 7, wherein the history information updating means updates the tour history information by adding the user's smile level. (Supplementary Note 9) The authentication system of Supplementary Note 6, wherein the information processing device further comprises reward granting means for granting the user a reward according to the accumulated smile level. (Supplementary Note 10) The authentication system of Supplementary Note 7, wherein the information processing device further comprises reward granting means for granting the user a reward according to the tour history.(Supplementary Note 11) An authentication method in which a computer controls face authentication by comparing authentication face information of a user acquired at each of a plurality of points within a facility with pre-registered registration face information, calculates a smile degree of the user from the authentication face information, generates a cumulative smile degree by accumulating the smile degrees of the user calculated from the authentication face information acquired at each of the plurality of points within the facility, and controls output of a comparison result between the cumulative smile degree of the user and the cumulative smile degrees of other users. (Supplementary Note 12) The authentication method according to Supplementary Note 11, in which the computer updates tour history information relating to the user's tour history within the facility, and further controls output of a comparison result between the user's tour history and the tour histories of other users. (Supplementary Note 13) The authentication method according to Supplementary Note 12, in which the computer updates the tour history information by adding the smile degree of the user. (Supplementary Note 14) The authentication method according to Supplementary Note 11, wherein the computer grants the user a benefit according to the accumulated smile level. (Supplementary Note 15) The authentication method according to Supplementary Note 12, wherein the computer grants the user a benefit according to the travel history. (Supplementary Note 16) A non-transitory computer-readable medium storing a program that causes a computer to execute the following processes: controlling face authentication by comparing authentication face information of the user acquired at each of a plurality of points within a facility with pre-registered registration face information; calculating the smile level of the user from the authentication face information; generating a cumulative smile level by accumulating the smile levels of the user calculated from the authentication face information acquired at each of the plurality of points within the facility; and controlling output of a comparison result between the cumulative smile level of the user and the cumulative smile levels of other users. (Supplementary Note 17) A non-transitory computer-readable medium according to Supplementary Note 16, storing a program that causes the computer to execute: a process of updating travel history information regarding the user's travel history within the facility; and a process of further controlling the output of a comparison result between the user's travel history and the travel histories of other users.(Supplementary Note 18) The non-transitory computer-readable medium according to Supplementary Note 17, storing a program that causes the computer to execute a process of updating the tour history information by adding the smile level of the user. (Supplementary Note 19) The non-transitory computer-readable medium according to Supplementary Note 16, storing a program that causes the computer to execute a process of granting the user a reward according to the accumulated smile level. (Supplementary Note 20) The non-transitory computer-readable medium according to Supplementary Note 17, storing a program that causes the computer to execute a process of granting the user a reward according to the tour history.

[0063] 10,300 Information processing device 100 Authentication system 200 Authentication terminal 11 Memory unit (storage means) 310 Memory unit (storage means) 12,341 Registration unit (user information registration means) 13,342 Authentication unit (authentication means) 14,343 Smile level calculation unit (smile level calculation means) 15,344 Generation unit (cumulative smile level generation means) 16,347 Output control unit (output control means) 345 History update unit (history information update means) 346 Benefit granting unit (benefit granting means) 261 Image acquisition unit (authentication face information acquisition means)

Claims

1. an authentication means for controlling face authentication by comparing face information for authentication of a user acquired at each of a plurality of points in the facility with face information for registration registered in advance; A smile degree calculation means for calculating a smile degree of the user from the authentication face information; a cumulative smile degree generating means for generating a cumulative smile degree by accumulating the smile degree of the user calculated from the authentication face information acquired at each of the plurality of points within the facility; an output control means for controlling an output of a comparison result between the cumulative smile degree of the user and the cumulative smile degree of another user; An information processing device comprising:

2. a history information update unit for updating tour history information relating to the tour history of the user within the facility, The output control means further controls output of a comparison result between the travel history of the user and the travel history of another user. The information processing device according to claim 1 .

3. the history information update means updates the travel history information by adding the smile degree of the user; The information processing device according to claim 2 .

4. The present invention further includes a bonus awarding unit that awards a bonus to the user according to the accumulated smile degree. The information processing device according to claim 1 .

5. A reward giving means is further provided for giving a reward to the user according to the travel history. The information processing device according to claim 2 .

6. Authentication terminals are installed at multiple locations within the facility; an information processing device capable of communicating with the authentication terminal; Equipped with The information processing device includes: A user information registration means for registering face information for registration of a user in a storage means. Equipped with The authentication terminal includes: An authentication face information acquisition means for acquiring authentication face information of the user; Equipped with The information processing device includes: an authentication means for performing face authentication by comparing the authentication face information of the user acquired at each of the plurality of points in the facility with the registration face information; a smile degree calculation means for calculating a smile degree of the user from the authentication face information when the face authentication is successful; a cumulative smile degree generating means for generating a cumulative smile degree by accumulating the smile degree of the user calculated from the authentication face information acquired at each of the plurality of points within the facility; an output control means for causing the authentication terminal to output a comparison result between the accumulated smile degree of the user and the accumulated smile degree of another user; The authentication system further comprises:

7. The computer Controlling face authentication by matching the user's authentication face information acquired at each of a plurality of points within the facility with pre-registered registration face information; Calculating a smile level of the user from the authentication face information; generating a cumulative smile degree by accumulating the smile degree of the user calculated from the authentication face information acquired at each of the plurality of points within the facility; Controlling an output of a comparison result between the accumulated smile degree of the user and the accumulated smile degree of another user. Authentication method.

8. On the computer, A process of controlling face authentication by comparing face information for authentication of a user acquired at each of a plurality of points in a facility with face information for registration registered in advance; A process of calculating a smile level of the user from the authentication face information; A process of generating a cumulative smile degree by accumulating the smile degree of the user calculated from the authentication face information acquired at each of the plurality of points in the facility; A process of controlling an output of a comparison result between the cumulative smile degree of the user and the cumulative smile degree of another user; A program that executes the following.

Images