Recommendation device, recommendation system, recommendation method, and recommendation program

Abstract

This recommending device (1) comprises: a registering unit (11) that registers, in association with a prescribed user, user-related information related to the user, the information being acquired when a first authentication performed when the user uses a first service-providing device is successful; an identifying unit (12) that identifies the user-related information associated with the user when a second authentication performed when the user uses a second service-providing device is successful; a determining unit (13) that determines, on the basis of the user-related information and a provision function of the second service-providing device, recommendation information when using the second service-providing device; and a reporting unit (14) that reports the recommendation information to the user.

Description

Technical Field

[0001] The present invention relates to a recommendation device, system and method, and a computer-readable medium. In particular, it relates to a recommendation device, system and method, and a computer-readable medium for making recommendations to a user when using a service providing device that provides services upon successful authentication.

Background Art

[0002] Patent Document 1 discloses a technique related to a measurement system that analyzes a user's face image and performs measurements related to the user. The measurement system according to Patent Document 1 measures at least one of the user's pulse, blood pressure, stress level, and nutrient deficiency, which is a nutrient lacking, based on the user's face image.

[0003] In recent years, face recognition terminals have become widespread, and face recognition terminals are used in various places such as gate devices for managing entry and exit.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Here, it is required to provide useful information when using another authentication terminal by using the information acquired during authentication at one authentication terminal.

[0006] An object of the present disclosure is to provide a recommendation device, system, method, and program for recommending appropriate information according to the state of a user in view of the above-described problems.

Means for Solving the Problems

[0007] The recommendation device according to the first aspect of the present disclosure is registration means for registering, in association with the user, user-related information related to the user obtained when a first authentication performed when a predetermined user uses a first service providing device is successful; specification means for specifying the user-related information associated with the user when a second authentication performed when the user uses a second service providing device is successful; determination means for determining recommendation information when using the second service providing device based on the user-related information and the provided functions of the second service providing device; notification means for notifying the user of the recommendation information; and includes.

[0008] The recommendation system according to the second aspect of the present disclosure is a first service providing device that enables use of a service in response to successful first authentication; a second service providing device that enables use of a service in response to successful second authentication; and a recommendation device, and the recommendation device is registration means for registering, in association with the user, user-related information related to the user obtained when the first authentication performed when a predetermined user uses the first service providing device is successful; specification means for specifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing device is successful; determination means for determining recommendation information when using the second service providing device based on the user-related information and the provided functions of the second service providing device; notification means for notifying the user of the recommendation information; and includes.

[0009] The recommendation method according to the third aspect of the present disclosure is a computer When a first authentication is successful when a predetermined user uses a first service providing apparatus, the user-related information related to the user obtained at that time is registered in association with the user, When a second authentication is successful when the user uses a second service providing apparatus, the user-related information associated with the user is specified, Based on the user-related information and the providing function of the second service providing apparatus, recommendation information when using the second service providing apparatus is determined, The recommendation information is notified to the user.

[0010] The recommendation program according to the fourth aspect of the present disclosure, a registration process of registering, in association with the user, the user-related information related to the user obtained when a first authentication is successful when a predetermined user uses a first service providing apparatus; a specifying process of specifying the user-related information associated with the user when a second authentication is successful when the user uses a second service providing apparatus; a determining process of determining recommendation information when using the second service providing apparatus based on the user-related information and the providing function of the second service providing apparatus; a notification process of notifying the user of the recommendation information; is caused to be executed by a computer.

Advantages of the Invention

[0011] According to the present disclosure, it is possible to provide a recommendation apparatus, system, method, and program for recommending appropriate information according to the state of a user.

Brief Description of the Drawings

[0012]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Mode for Carrying Out the Invention

[0013] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and redundant descriptions are omitted as necessary for clarity of explanation.

[0014] <Embodiment 1> FIG. 1 is a block diagram showing the configuration of the recommendation device 1 according to Embodiment 1. The recommendation device 1 is an information processing device that notifies recommendation information to a user who has successfully authenticated when using a service providing device (not shown), based on user-related information accumulated at the time of past successful authentication and the service providing functions of the service providing device that has successfully authenticated this time. First, it is assumed that the service providing device requires authentication of the user when the user uses it. For example, the service providing device includes, but is not limited to, an entrance / exit gate device, a vending machine, a multifunction device such as a printer, etc. Also, each service providing device provides a service by the service providing function the device has when authentication is successful. In other words, the first service providing device makes the service related to the service providing function available in response to the success of the first authentication. Also, the second service providing device makes the service related to the service providing function available in response to the success of the second authentication. Here, the service providing function is, for example, unlocking of an entrance / exit gate, settlement in the sale of goods, printing, etc., but is not limited to these. Also, in the following, it is described assuming that an authentication terminal is connected to each service providing device. However, each service providing device may have an authentication terminal built in.

[0015] The authentication terminal acquires personal authentication information from a user who attempts to use the service providing function of the connected service providing device, and transmits the personal authentication information to the recommendation device 1 or the authentication device. Therefore, a user who uses the service providing device needs to register his / her own personal authentication information (for registration) with the authentication device in advance. Then, the authentication terminal receives the authentication result, and when authentication is successful, notifies the service providing device to that effect and causes the service corresponding to the function to be provided. Here, "personal authentication information" is information used for authentication of personal identification, and is information for uniquely identifying (identifying) the person. The personal authentication information is, for example, biometric information, information related to an identity card, display information obtained by encoding a personal number, etc. However, the personal authentication information is not limited to these.

[0016] Here, it is assumed that the recommendation device 1 is connected to each authentication terminal via a communication network (not shown, hereinafter also simply referred to as the network), or by a predetermined wireless communication. Note that the network may be wired or wireless, and the type of communication protocol is not limited.

[0017] In addition, the recommendation device 1 may control the first authentication performed when a predetermined user uses the first service providing device and the second authentication performed when the user uses the second service providing device. Then, the recommendation device 1 acquires the user's personal authentication information (for authentication) from the above-mentioned authentication terminal, compares the personal authentication information for authentication with the personal authentication information for registration registered in the authentication device, and controls the authentication. Alternatively, the authentication terminal may transmit the acquired personal authentication information to the authentication device and transmit the received authentication result to the recommendation device 1. That is, the recommendation device 1 may receive the authentication results of the first authentication and the second authentication and perform processing according to the received authentication results.

[0018] The recommendation device 1 includes a registration unit 11, a specifying unit 12, a determination unit 13, and a notification unit 14. The registration unit 11 registers, in association with the user, the user-related information related to the user, which is acquired when the first authentication is successful when a predetermined user uses the first service providing device. Here, the user-related information is information acquired when the user authenticates or uses the first service providing device. Examples of the user-related information include an authentication result, the user's physical condition information, operation information (operation history) of the first service providing device, and the like. The authentication result includes, for example, time information (authentication time, etc.), authentication location, type of the first service providing device, installation location of the first service providing device, and the like. The physical condition information is information indicating the user's health state. The physical condition information includes, for example, a measured value of the body surface temperature measured by the user and flag information indicating whether the physical condition is good or bad. The registration unit 11 associates the user-related information with the user (identification information) and registers it in a built-in or external storage device.

[0019] When the second authentication performed when the user uses the second service providing device is successful, the specifying unit 12 specifies user-related information associated with the user. That is, the specifying unit 12 acquires, from the above storage device, user-related information associated with the identification information of the user specified at the time of successful second authentication.

[0020] Based on the specified user-related information and the provided functions of the second service providing device, the determination unit 13 determines recommendation information when using the second service providing device. Here, the recommendation information is information for recommending (providing) to the user who has succeeded in the second authentication. For example, the recommendation information may be information indicating a product that is more appropriate considering the user's physical condition, etc., among the products that can be purchased by the second service providing device. Or, the recommendation information may be privilege information applicable when using the second service providing device. However, the recommendation information is not limited to these. The determination unit 13 may determine the recommendation information using a recommendation model that inputs user-related information and provided functions, etc., and outputs recommendation information based on a predetermined logic. Note that known technologies such as an AI (Artificial Intelligence) model can be applied to the recommendation model. Also, the recommendation model can use one that is machine-learned with teacher data having user-related information, etc., as input data and the adoption result of the recommendation information as correct answer data. Or, the determination unit 13 may derive first information from the user-related information and provided functions, etc., and determine the recommendation information based on the determination result of the first information by a predetermined logic or the like.

[0021] The notification unit 14 notifies the user of the recommendation information. The notification unit 14 notifies (transmits) the recommendation information with the second service providing device, an authentication terminal connected to or built in the second service providing device, or a user terminal possessed by the user as the notification destination.

[0022] Further, when the second authentication is successful, the specifying unit 12 may specify user-related information at the time of successful authentication of two or more service providing apparatuses used before using the second service providing apparatus. In particular, when the second authentication is successful, the specifying unit 12 may specify user-related information at the time of successful authentication of a service providing apparatus used in the past, rather than immediately before the second service providing apparatus. For example, assume that the user has used a plurality of service providing apparatuses that require authentication in the order of (1) an entrance gate, (2) a vending machine, and (3) a multifunction device. And assume that the recommendation apparatus 1 has already registered the user-related information D1 and D2 of (1) and (2) in association with the user. At this time, when the user succeeds in authentication when using the (3) multifunction device, the recommendation apparatus 1 may specify the user-related information D1 at the time of successful authentication of the (1) entrance gate, and determine recommendation information based on D1 (without using the immediately preceding D2). That is, from the time of using the (3) multifunction device, it is not always necessary to regard the immediately preceding (2) vending machine as the "first service providing apparatus". Or, when the user succeeds in authentication when using the (3) multifunction device, the recommendation apparatus 1 may specify the user-related information D1 and D2 at the time of successful authentication of the (1) entrance gate and the (2) vending machine, and determine recommendation information based on D1 and D2.

[0023] FIG. 2 is a flowchart showing the flow of the recommendation method according to Embodiment 1. First, the registration unit 11 registers, in association with the user, user-related information related to the user, which is acquired at the time of successful first authentication performed when a predetermined user uses a first service providing apparatus (S11).

[0024] Next, when the second authentication performed when the user uses a second service providing apparatus is successful, the specifying unit 12 specifies the user-related information associated with the user (S12). Then, the determination unit 13 determines recommendation information when using the second service providing apparatus based on the user-related information and the provided function of the second service providing apparatus (S13). Thereafter, the notification unit 14 notifies the user of the recommendation information (S14).

[0025] As described above, the recommendation device 1 according to this embodiment determines and notifies recommendation information in consideration of the provided functions when the authentication of the second service providing device is successful based on the information acquired during authentication when using the first service providing device. That is, it is possible to provide useful information when using another authentication terminal by using the information acquired during authentication on one authentication terminal. Therefore, the recommendation device 1 can recommend appropriate information according to the user's state.

[0026] Note that the recommendation device 1 includes a processor, a memory, and a storage device as a configuration not shown in the figure. Further, a computer program in which the processing of the recommendation method according to this embodiment is implemented is stored in the storage device. Then, the processor causes the memory to read the computer program from the storage device and executes the computer program. Thereby, the processor realizes the functions of the registration unit 11, the specifying unit 12, the determining unit 13, and the notification unit 14.

[0027] Alternatively, each component of the recommendation device 1 may be realized by dedicated hardware. Also, some or all of the components of each device may be realized by general-purpose or dedicated circuitry, processors, etc., or combinations thereof. These may be configured by a single chip or by a plurality of chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-described circuitry, etc. and a program. Also, as the processor, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a quantum processor (quantum computer control chip), etc. can be used.

[0028] In addition, when some or all of the components of the recommendation device 1 are realized by a plurality of information processing devices, circuits, etc., the plurality of information processing devices, circuits, etc. may be centrally arranged or distributed. For example, the information processing devices, circuits, etc. may be realized in a form in which each is connected via a communication network, such as a client-server system or a cloud computing system. Further, the function of the recommendation device 1 may be provided in the form of SaaS (Software as a Service).

[0029] <Embodiment 2> This Embodiment 2 is a specific example of the above-described Embodiment 1. FIG. 3 is a block diagram showing the overall configuration of the recommendation system 1000 according to this Embodiment 2. The recommendation system 1000 is an information system for notifying a user of recommendation information when authentication is successful for using another service providing device, based on the authentication history, etc. when using a plurality of service providing devices installed in the building 20. Note that the recommendation system 1000 is not limited to the service providing devices installed in the building 20, and may notify recommendation information when using a plurality of service providing devices installed in various facilities and areas.

[0030] The recommendation system 1000 includes a user terminal 100, authentication terminals 200-1 to 200-3, a gate device 300-1, a vending machine 300-2, a multifunction device 300-3, an authentication device 400, and a recommendation device 500. Each of the user terminal 100, the authentication terminals 200-1 to 200-3, the gate device 300-1, the vending machine 300-2, the multifunction device 300-3, the authentication device 400, and the recommendation device 500 is connected via the network N. Here, the network N is a wired or wireless communication line, such as the Internet.

[0031] In the following description, "personal authentication information" is information used for authentication of identity verification (such as personal authentication and personal identification processing), and is information for uniquely identifying (identifying) an individual. Also, in this embodiment, personal authentication is face authentication, which is an example of biometric authentication, and personal authentication information (personal identification information) is described as face feature information, which is an example of biometric information. However, other technologies that utilize a person's photographed image are applicable to biometric authentication and biometric information. For example, for biometric information, data (feature quantities) calculated from unique physical characteristics of an individual such as fingerprints, voiceprints, veins, retinas, iris of the pupil, and patterns on the palm may be used. Also, instead of biometric authentication, other personal authentication methods may be applied, and biometric information may also be other personal authentication information. For example, examples of personal authentication information include, but are not limited to, user IDs, combinations of IDs and passwords, information described in identity certificates such as My Number and driver's licenses (identification numbers, passwords, etc.), electronic certificates, code information, etc. Note that the code information may be a two-dimensional code, for example, a QR code (registered trademark).

[0032] The user terminal 100 is an information terminal that is owned, carried, operated, or worn by the user U1, and transmits and receives data to and from the recommendation device 500 via the network N by wireless communication. Note that each of the users U2 and U3 may also possess a terminal having the same functions as the user terminal 100. The user terminal 100 is a mobile phone terminal, a smartphone, a tablet terminal, a wearable terminal, or the like. Also, the user terminal 100 may perform short-range wireless communication with a wearable device worn by the user U1 or an insole sensor embedded in the shoes of the user U1, and acquire detection results or measurement results by the wearable device or the insole sensor. In this case, the user terminal 100 regards the acquired detection results or measurement results as at least a part of the user's physical condition information.

[0033] FIG. 4 is a block diagram showing the configuration of the user terminal 100 according to Embodiment 2. The user terminal 100 includes a camera 110, a storage unit 120, a memory 130, a communication unit 140, an input / output unit 150, and a control unit 160. The camera 110 is an imaging device that performs imaging according to the control of the control unit 160. The storage unit 120 is an example of a storage device including a non-volatile memory such as a flash memory or an SSD (Solid State Drive). The storage unit 120 stores a program 121, position information 122, personal authentication information 123, and physical condition information 124. The program 121 is a computer program in which processes including user registration processing, acquisition processing of the user's physical condition information, transmission processing of the physical condition information, display processing of recommendation information, and the like, which will be described later, are implemented. The position information 122 is GPS (Global Positioning System) information or the like, and is information indicating the current position of the user terminal 100. The personal authentication information 123 is identification information for identifying the user who carries the user terminal 100. The personal authentication information 123 may be biometric information, for example, a face image or face feature information, or other personal authentication information described above. The physical condition information 124 includes the detection result or measurement result described above, or input information (text, flag, etc.) of the health condition by the user U1. Note that the storage unit 120 does not necessarily need to store the position information 122, the personal authentication information 123, and the physical condition information 124.

[0034] The memory 130 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during the operation of the control unit 160. The communication unit 140 is a communication interface with the network N. Further, the communication unit 140 may also communicate with GPS satellites. The input / output unit 150 includes a display device (display unit) such as a screen and an input device (input unit). The input / output unit 150 is, for example, a touch panel. The control unit 160 is a processor that controls the hardware included in the user terminal 100. The control unit 160 causes the memory 130 to read the program 121 from the storage unit 120 and execute it. Thereby, the control unit 160 realizes the functions of a registration unit 161, an acquisition unit 162, and a display control unit 163.

[0035] The registration unit 161 performs the registration process of user information. Specifically, the registration unit 161 receives the face image and personal information of the user U1 input by the user U1. The registration unit 161 transmits a registration request for user information including the received face image and personal information to the recommendation device 500 via the network N. Note that the registration unit 161 may include other personal authentication information for registration instead of the face image in the registration request for user information. The registration unit 161 may receive the user ID issued at the time of registering user information from the recommendation device 500 via the network N and register it in the storage unit 120 as the personal authentication information 123.

[0036] In addition, the registration unit 161 performs the acquisition process and transmission process of the user's physical condition information. Specifically, the registration unit 161 transmits a registration request including the physical condition information, current location, and face image (personal authentication information) acquired by the acquisition unit 162 at an arbitrary timing to the recommendation device 500 via the network N, as will be described later. Note that the registration unit 161 may include other personal authentication information for authentication instead of the face image in the registration request for physical condition information. That is, when transmitting the physical condition information, the registration unit 161 does not necessarily need to transmit the face image every time.

[0037] Alternatively, when the registration unit 161 establishes a connection for short-range wireless communication with the authentication terminal 200, the registration unit 161 may transmit the physical condition information to the authentication terminal 200. In that case, the physical condition information is transmitted from the authentication terminal 200. Alternatively, the registration unit 161 may transmit the physical condition information to the recommendation device 500 via the network N.

[0038] In addition, the registration unit 161 may receive information (acceptance / rejection result) indicating acceptance or rejection input by the user U1 for the recommendation information displayed on the display control unit 163 described later, and transmit the acceptance / rejection result to the recommendation device 500 via the network N.

[0039] The acquisition unit 162 performs acquisition processing of the user's physical condition information. The physical condition information includes the user's health condition and the like. Specifically, the acquisition unit 162 acquires measurement values (vital data) such as the user's body temperature, pulse rate, heart rate, etc. as the health condition. For example, the acquisition unit 162 acquires the measurement values from a health condition measuring device as the physical condition information. When the user terminal 100 is a wearable terminal, the health condition measuring device may be built into the user terminal 100. Alternatively, a sensor such as a wearable terminal worn by the user acquires the measurement value of the user's health condition, and the acquisition unit 162 may acquire the measurement value as the physical condition information from the wearable terminal or the like by short-range wireless communication. Further, the health condition may be the user's gait information detected by a detection device (insole sensor) embedded in an insole (shoe insole) worn by the user. The gait information includes information indicating the stride, walking speed, ground contact angle, outer rotation distance (toe direction, foot lift height), take-off angle, etc. For example, the acquisition unit 162 may acquire the detected value of the gait information from the insole sensor by short-range wireless communication as the health condition, that is, the physical condition information. In addition, the acquisition unit 162 may acquire the input value from the user for the health condition report screen as the health condition. The input value may be, for example, health information such as body temperature, or an answer to the questionnaire displayed on the report screen (a selected value or text information such as the condition of the physical condition, degree of fatigue, etc.). Note that the acquisition unit 162 may perform the acquisition processing of the status information regularly. Regularly means, for example, every hour or once a day, etc., but the interval is not limited to these.

[0040] In addition, the acquisition unit 162 acquires the GPS information indicating the current position of the user terminal 100 via the communication unit 140 as the position information, and stores it in the storage unit 120 as the position information 122. Further, the acquisition unit 162 may acquire the captured image of the user captured by the camera 110 and store it in the storage unit 120 as the personal authentication information 123.

[0041] When the display control unit 163 receives the recommendation information from the recommendation device 500 via the network N, the display control unit 163 displays the recommendation information on the input / output unit 150.

[0042] Returning to FIG. 3, the description will be continued. The authentication device 400 is an information processing device that manages the facial feature information of users. Further, in response to a face authentication request received from the outside, the authentication device 400 collates the face image or facial feature information included in the request with the facial feature information of each user, and returns the collation result (authentication result) to the requester.

[0043] FIG. 5 is a block diagram showing the configuration of the authentication device 400 according to Embodiment 2. The authentication device 400 includes a face information DB (DataBase) 410, a face detection unit 420, a feature point extraction unit 430, a registration unit 440, and an authentication unit 450. The face information DB 410 stores the user ID 411 and the facial feature information 412 of the user ID in association with each other. The facial feature information 412 is a set of feature points extracted from a face image. Note that the authentication device 400 may delete the facial feature information 412 in the face feature DB 410 according to the request from the user or the like corresponding to the facial feature information 412. Alternatively, the authentication device 400 may delete the facial feature information 412 after a certain period has elapsed since registration.

[0044] The face detection unit 420 detects a face area included in a registration image for registering face information, and outputs it to the feature point extraction unit 430. The feature point extraction unit 430 extracts feature points from the face area detected by the face detection unit 420, and outputs facial feature information to the registration unit 440. Further, the feature point extraction unit 430 extracts feature points included in the face image received from the recommendation device 500 or the like, and outputs facial feature information to the authentication unit 450.

[0045] When registering face feature information, the registration unit 440 newly issues a user ID 411. The registration unit 440 associates the issued user ID 411 with the face feature information 412 extracted from the registration image and registers them in the face information DB 410. The authentication unit 450 performs face authentication using the face feature information 412. Specifically, the authentication unit 450 collates the face feature information extracted from the face image with the face feature information 412 in the face information DB 410. When the collation is successful, the authentication unit 450 identifies the user ID 411 associated with the collated face feature information 412. The authentication unit 450 returns to the requester the presence or absence of a match of the face feature information as the face authentication result. The presence or absence of a match of the face feature information corresponds to the success or failure of the authentication. Here, the case where the face feature information matches (match exists) means that the degree of match is equal to or higher than the threshold value. Also, the face authentication result shall include the identified user ID when the face authentication is successful.

[0046] FIG. 6 is a flowchart showing the flow of face information registration processing by the authentication device according to the second embodiment. Here, an information registration terminal (not shown) photographs the body including the user's face and transmits a face information registration request including the photographed image (registration image) to the authentication device 400 via the network N. The information registration terminal is, for example, an information processing device such as a personal computer, a smartphone, or a tablet terminal. For example, the information registration terminal may be the user terminal 100 or the like. Here, it is assumed that the information registration terminal is the recommendation device 500 that has received a registration request from the user terminal 100 or the like.

[0047] First, the authentication device 400 receives a face information registration request (S201). For example, the authentication device 400 receives a face information registration request from the recommendation device 500 via the network N. Next, the face detection unit 420 detects a face region from the face image included in the face information registration request (S202). Then, the feature point extraction unit 430 extracts feature points (face feature information) from the face region detected in step S202 (S203). Then, the registration unit 440 issues a user ID 411 (S204). Then, the registration unit 440 associates the extracted face feature information 412 with the issued user ID 411 and registers them in the face information DB 410 (S205). After that, the registration unit 440 returns the issued user ID 411 to the requester (information registration terminal, for example, the recommendation device 500) (S206).

[0048] Returning to FIG. 3, the description will continue. The gate device 300-1, the vending machine 300-2, and the multifunction device 300-3 are examples of service providing devices installed in the building 20. Hereinafter, when there is no need to particularly distinguish between the gate device 300-1, the vending machine 300-2, and the multifunction device 300-3, they may simply be referred to as the "service providing device 300". The service providing device 300 can also be applied to devices used in combination with authentication terminals, such as lockers, cash registers, digital signage, etc. The recommendation system 1000 is assumed to include at least a plurality of service providing devices 300 having different providing functions.

[0049] The gate device 300-1 is a control device for the entrance / exit gate installed at the entrance / exit of the building 20. The gate device 300-1 unlocks the gate when authentication by the connected or built-in authentication terminal 200-1 is successful. For example, when the user U1 successfully authenticates by the authentication terminal 200-1, the gate is unlocked by the gate device 300-1, so the user U1 can enter the building 20. The authentication result by the authentication terminal 200-1, especially the authentication success time, may be used for recording the attendance and departure of company employees. Note that the entrance / exit gate may be a flap gate or gate-less (so-called).

[0050] The vending machine 300-2 is a device (a vending machine for products) that sells products when authentication by a connected or built-in authentication terminal 200-2 is successful. The vending machine 300-2 may be, for example, a vending machine for a plurality of food and beverage products. For example, when the user U2 successfully authenticates using the authentication terminal 200-2, the vending machine 300-2 displays a group of products that can be sold to the user U2, performs settlement for the product selected by the user U2, and outputs the product.

[0051] The multifunction device 300-3 is a service providing device that can provide the functions of a plurality of devices such as a copier, a printer, a scanner, and a fax machine. The multifunction device 300-3 accepts the operation of the user U3 when authentication by a connected or built-in authentication terminal 200-3 is successful, and provides services (processes) by each function. For example, when the user U3 successfully authenticates using the authentication terminal 200-3, the multifunction device 300-3 accepts a copy operation from the user U3 and performs a copy process (outputs a copy result). Also, the multifunction device 300-3 prints electronic data in response to an instruction from a PC or the like. At this time, the authentication may be performed by either or both of the authentication terminal 200-3 and the PC. For example, assume that the user uses a PC or the like to specify the multifunction device 300-3 as the output destination for printing and issues a print instruction. Then, when the user selects printing of an electronic manuscript on the multifunction device 300-3, the authentication terminal 200-3 captures the user's face and verifies the identity by face authentication between the captured face and the face registered in advance. If the identity verification is successful, the multifunction device 300-3 prints and outputs the above electronic manuscript.

[0052] FIG. 7 is a block diagram showing the configuration of the authentication terminal 200 according to Embodiment 2. The authentication terminal 200 includes a camera 210, a storage unit 220, a memory 230, a communication unit 240, an input / output unit 250, and a control unit 260. The camera 210 is a photographing device that performs photographing according to the control of the control unit 260. The storage unit 220 is an example of a storage device including a non-volatile memory such as a flash memory or an SSD (Solid State Drive). The storage unit 220 stores a program 221. The program 221 is a computer program in which a process including an authentication request process for starting a service provision process described later is implemented. For example, the program 221 includes a client application corresponding to the service provision device 300.

[0053] The memory 230 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during the operation of the control unit 260. The communication unit 240 is a communication interface with the network N. The input / output unit 250 includes a display device (display unit) such as a screen and an input device (input unit). The input / output unit 250 is, for example, a touch panel. The control unit 260 is a processor that controls the hardware of the authentication terminal 200. The control unit 260 causes the memory 230 to read the program 221 from the storage unit 220 and execute it. Thereby, the control unit 260 realizes the functions of the display control unit 261, the authentication request unit 262, and the process control unit 263.

[0054] The display control unit 261 causes the input / output unit 250 to display the screen generated by the execution of the program 221. The display control unit 261 may display a message prompting the user to take a face photo for face authentication. Further, when the face authentication is successful, the display control unit 261 may display a message prompting the input of user-related information. For example, the display control unit 261 may display a message prompting the input of physical condition information. Also, the display control unit 261 may display the recommendation information notified by the recommendation device 500. When the service providing device 300 is the vending machine 300-2 and the face authentication is successful, the display control unit 261 displays the group of available products. When the service providing device 300 is the multifunction machine 300-3 and the face authentication is successful, the display control unit 261 displays the menu of the multifunction machine.

[0055] The authentication request unit 262 extracts the face area of the person detected from the image taken by the user with the camera 210 as a face image, and transmits an authentication request including the face image, time information, and terminal position information or the type of the service providing device 300 to the recommendation device 500. Note that the authentication request may not include the time information. Note that the authentication request unit 262 may transmit a face authentication request including the face image to the authentication device 500 and receive the face authentication result from the authentication device 500. When the face authentication result indicates success, the authentication request unit 262 may extract the user ID included in the face authentication result and transmit information including the user ID, time information, and the type of the service providing device 300, etc. to the recommendation device 500.

[0056] Note that the authentication request unit 262 may obtain biometric information or other personal authentication information from the user in addition to or instead of the face image, and include the obtained personal authentication information in the authentication request. For example, the authentication terminal 200 may establish short-range wireless communication with the user terminal 100 of the user nearby and obtain the personal authentication information from the user terminal 100. Or, the authentication terminal 200 may obtain the personal authentication information by reading the code information with the code corresponding to the personal authentication information printed thereon. Or, the authentication terminal 200 may obtain the personal authentication information from an employee ID card or the like in which an IC (Integrated Circuit) chip is embedded.

[0057] The processing control unit 263 controls the processing specific to the service providing device 300 connected to the authentication terminal 200. For example, when authentication is successful, the processing control unit 263 outputs an unlocking instruction to the gate device 300-1. Also, when authentication is successful, the processing control unit 263 outputs a permission signal for product selection or purchase to the vending machine 300-2. Further, when authentication is successful, the processing control unit 263 outputs a permission signal for using the functions of the multifunction device to the multifunction device 300-3.

[0058] Also, the processing control unit 263 acquires user-related information before or when authentication is successful, and transmits a registration request including the user-related information and the personal authentication information to the recommendation device 500. For example, the processing control unit 263 acquires the physical condition information input by the user as the user-related information. Alternatively, the processing control unit 263 may establish short-range wireless communication with the user terminal 100 of a user nearby and acquire the physical condition information from the user terminal 100. Alternatively, the processing control unit 263 may acquire the measurement values from the user by a measuring device installed near or built into the service providing device 300 as the user-related information. The measuring device may be, for example, a thermal camera that measures the body surface temperature of the user. Also, when the service providing device 300 is the vending machine 300-2, the processing control unit 263 may acquire the product information and settlement information purchased by the user as the user-related information in response to successful authentication. Note that even when the service providing device 300 is a settlement terminal (cash register terminal) that performs settlement by face authentication, the processing control unit 263 may acquire the product information and settlement information purchased by the user as the user-related information in response to successful authentication. Further, when the service providing device 300 is the multifunction device 300-3, the processing control unit 263 may acquire the operation information such as the operation content and used functions of the multifunction device input in response to successful authentication as the user-related information.

[0059] In addition, when the processing control unit 263 receives the recommendation information notified by the recommendation device 500, it outputs the recommendation information to the display control unit 261. Further, when the processing control unit 263 receives the recommendation information notified by the recommendation device 500, it may output the recommendation information to the service providing device 300 connected to the authentication terminal 200. For example, when the recommendation information indicates a product recommending purchase, the processing control unit 263 outputs information recommending the purchase of the product to the vending machine 300-2.

[0060] Returning to FIG. 3, the description will be continued. The recommendation device 500 is an example of the above-described recommendation device 1. The recommendation device 500 is an information processing device that performs user registration processing, user-related information registration processing, recommendation processing, etc. (the recommendation method according to the second embodiment). The recommendation device 500 may be redundant on a plurality of servers, and each functional block may be realized by a plurality of computers.

[0061] FIG. 8 is a block diagram showing the configuration of the recommendation device 500 according to the second embodiment. The recommendation device 500 includes a storage unit 510, a memory 520, a communication unit 530, and a control unit 540. The storage unit 510 is an example of a storage device such as a hard disk, a flash memory, or an SSD. The storage unit 510 stores a program 511, user information 512, and service providing device information 513. The program 511 is a computer program in which the processing of the recommendation method according to the second embodiment is implemented.

[0062] The user information 512 is information for managing users of the recommendation system 1000. The user information 512 is information in which a user ID 5121, personal information 5122, terminal information 5123, and user-related information 5124 are associated. The user ID 5121 is identification information of the user. The user ID 5121 is information that is the same as or uniquely corresponds to the user ID 411 that is managed in association with the face feature information 412 in the face information DB 410 of the authentication device 400. Therefore, it can be said that the user information 512 is information associated with the user's registration authentication information via the user ID 5121.

[0063] The personal information 5122 may include the user's name, gender, date of birth, address, nationality, contact information, payment information, etc. Further, the personal information 5122 may include the user's medical information (medical history), health information (allergy information), hobbies, preferences, etc. Further, the personal information 5122 may include information about the user's family members.

[0064] The terminal information 5123 is information that serves as the destination of a notification for the user terminal 100 held by the user. The terminal information 5123 is, for example, a mobile phone number, an email address, a user ID of an application, a social network service account, etc.

[0065] The user-related information 5124 includes at least an authentication result 51241, a physical condition information 51242, and an operation information 51243. The authentication result 51241 includes time information and at least one of terminal location information or the type of the service providing device 300 or the installation location of the service providing device 300. The time information is the time when the authentication terminal 200 acquired the personal authentication information, the transmission / reception time of the authentication request, the time when authentication was successful (authentication time, authentication success time), etc. The terminal location information is the identification information of the authentication terminal 200 that transmitted the authentication request. Note that the terminal location information is assumed to be associated with the device ID or device type of the service providing device described later. The type of the service providing device 300 is information indicating the device type of the service providing device described later. The installation location of the service providing device 300 is location information for specifying the installation location of the service providing device 300.

[0066] As described above, the physical condition information 51242 includes the detection result or measurement result of the user at the time of authentication, and input information on the health condition by the user.

[0067] The operation information 51243 is the content of the operation performed by the user at the time of authentication on the service providing device 300, the functions used, etc. Further, the operation information 51243 may include the data content (text, etc.) printed using the multifunction device 300-3. Further, the user-related information 5124 may include a purchase history by a payment terminal using face authentication.

[0068] The service providing device information 513 is information that defines the providing functions of the service providing device. The service providing device information 513 is information that associates the device ID 5131, the device type 5132, and the providing function 5133. The device ID 5131 is the identification information of the service providing device. The device type 5132 is information indicating the type of the service providing device. The device type 5132 is information indicating, for example, a gate device, a vending machine, a multifunction device, etc. The providing function 5133 is information indicating the functions (services) that the service providing device can provide when authentication is successful. For example, when the device type 5132 is a gate device, the providing function 5133 is unlocking of the gate, etc. When the device type 5132 is a vending machine, the providing function 5133 is a list of salable products. For example, when the vending machine 300-2 is a vending machine for food and beverages, the providing function 5133 includes the names, prices, etc. of beverages and foods. When the device type 5132 is a multifunction device, the providing function 5133 is copy, print, scan, FAX, etc., and may include details and settings of each function.

[0069] The memory 520 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during the operation of the control unit 540. The communication unit 530 is a communication interface with the network N.

[0070] The control unit 540 is a processor that controls each component of the recommendation device 500, that is, a control device. The control unit 540 causes the memory 520 to read the program 511 from the storage unit 510 and executes the program 511. Thereby, the control unit 540 realizes the functions of the registration unit 541, the authentication control unit 542, the determination unit 543, the specifying unit 544, the acquisition unit 545, the decision unit 546, and the notification unit 547.

[0071] The registration unit 541 is an example of the above-described registration unit 11. The registration unit 541 performs the registration process of user information. Specifically, the registration unit 541 receives a registration request for user information from the user terminal 100, generates user information 512, and registers it in the storage unit 510. Here, it is assumed that the registration request includes the user's face image and personal information. In that case, the registration unit 541 sends a face information registration request including the face image included in the registration request to the authentication device 400, and acquires the user ID issued in response to the registration of the face information from the authentication device 400. Alternatively, when the authentication device 400 is not used for the personal authentication process, the registration unit 541 may newly issue a user ID. The registration unit 541 generates user information 512 by associating the issued user ID 5121 with the personal information 5122 included in the registration request and the terminal information 5123 of the user terminal 100 which is the source of the registration request. As described above, since the user ID is associated with the face feature information, it can be said that the registration unit 541 pre-registers the user's personal authentication information for registration and the personal information in association with each other as user information. Note that the registration request for user information may include personal authentication information other than the face image. In that case, the registration unit 541 generates and registers user information 512 using the personal authentication information included in the registration request.

[0072] Also, the registration unit 541 registers the user-related information 5124 acquired before or after authentication in the user information 512 in association with the user ID 5121 that has successfully passed authentication. Specifically, the registration unit 541 registers at least any one of the authentication result 51241, the physical condition information 51242, and the operation information 51243 in the user information 512 in association with the user ID 5121 that has successfully passed authentication. Note that the registration unit 541 may register the history of the determined recommendation information and the acceptance / rejection result of the recommendation information, etc. in the user information 512.

[0073] The authentication control unit 542 controls face authentication for the face image included in the received authentication request. Specifically, the authentication control unit 542 transmits a face authentication request including the face image to the authentication device 400 and receives a face authentication result from the authentication device 400. Then, the authentication control unit 542 determines whether the authentication is successful or not from the face authentication result received from the authentication device 400, and if the authentication is successful, identifies the user ID included in the face authentication result. Note that the authentication control unit 542 may detect the user's face area from the face image and include the image of the face area in the face authentication request. Alternatively, the authentication control unit 542 may extract face feature information from the face area and include the face feature information in the face authentication request.

[0074] However, as described above, the personal authentication is not limited to face authentication, and the authentication control unit 542 may control the authentication using the personal authentication information for registration and authentication. That is, when the authentication request includes personal authentication information other than the face image, the authentication control unit 542 appropriately controls the collation with the authentication device and the registered personal authentication information registered internally according to the type of the personal authentication information to perform the authentication. And if the authentication is successful, the authentication control unit 542 identifies the corresponding user ID.

[0075] The determination unit 543 determines the physical condition of the user based on the user-related information. Specifically, the determination unit 543 determines whether the physical condition of the user is better or worse than a predetermined condition from the physical condition information included in the user-related information. Alternatively, the determination unit 543 may determine whether the physical condition of the user is better or worse than a predetermined condition from the commuting information based on the authentication times included in the authentication results at a plurality of time points of the user-related information. Further, the determination unit 543 may determine whether the physical condition of the user is better or worse than a predetermined condition from the degree of the user's operation mistakes based on the operation information included in the user-related information.

[0076] The specifying unit 544 is an example of the above-described specifying unit 12. When the authentication is successful, the specifying unit 544 specifies the provided function 5133 from the service providing device information 513 based on the type of the service providing device 300 included in the authentication request.

[0077] The acquisition unit 545 acquires user-related information from the authentication terminal 200 before or after authentication. Note that the user-related information to be acquired may include the face image of the user taken at the time of the first authentication.

[0078] The determination unit 546 is an example of the determination unit 13 described above. Further, the determination unit 546 may include the function of the determination unit 543 described above. That is, the determination unit 546 determines the physical condition of the user based on the user-related information, and determines the recommendation information based on the physical condition and the provided function of the second service providing device. Here, the second service providing device is a service providing device that is used at least after the user-related information has been accumulated due to the success of the first authentication when using the first service providing device in advance. Then, the determination unit 546 determines the recommendation information when the second authentication is successful during the use of the second service providing device.

[0079] Specifically, the determination unit 546 may generate the commuting information of the user from the authentication times in a plurality of first authentications for the user who has succeeded in the second authentication, and determine the physical condition of the user from the commuting information. Further, the determination unit 546 may analyze the face image taken at the time of the first or second authentication to derive the fatigue degree of the user, and determine the fatigue degree as the physical condition.

[0080] Further, when the physical condition indicates that it is worse than a predetermined condition, the determination unit 546 may determine, as the recommendation information, food and beverages that can contribute to the recovery of the user's physical condition among a plurality of food and beverages. Alternatively, the determination unit 546 may analyze the operation information included in the user-related information to derive the concentration of the user, and determine the concentration as the physical condition.

[0081] Further, the determination unit 546 may determine, as the recommendation information, privilege information that can be used for purchasing goods based on the user-related information. Here, the privilege information may be a discount coupon, points, or the like.

[0082] The notification unit 547 is an example of the above-described notification unit 14. When the first or second authentication is successful, the notification unit 547 notifies the user terminal 100, the authentication terminal 200, or the service providing device 300 that the authentication has been successful. Further, when the second authentication is successful and the user's physical condition is worse than a predetermined state, the notification unit 547 notifies the user terminal 100, the authentication terminal 200, or the service providing device 300 of the success of the second authentication and the recommendation information determined by the determination unit 546.

[0083] FIG. 9 is a flowchart showing the flow of the user-related information registration process according to the second embodiment. As a premise, it is assumed that the user U1 has completed the registration of user information in the recommendation device 500. And it is assumed that the user U1 is in front of the authentication terminal 200-1 and the gate device 300-1 of the building 20. At this time, the authentication terminal 200-1 captures the face of the user U1 by the camera 210, and transmits an authentication request including the face image, the time information, and the device type of the gate device 300-1 to the recommendation device 500 via the network N.

[0084] In response to this, the authentication control unit 542 of the recommendation device 500 receives the authentication request from the authentication terminal 200-1 via the network N (S311). The authentication request includes the face image, the time information, and the device type of the gate device 300-1. Next, the authentication control unit 542 transmits a face authentication request including the face image included in the authentication request to the authentication device 400 via the network N (S312). In response to this, the authentication device 400 performs a face authentication process.

[0085] FIG. 10 is a flowchart showing the flow of face authentication processing according to Embodiment 2. First, the authentication device 400 receives a face authentication request from the recommendation device 500 via the network N (S211). Note that the authentication device 400 may receive a face authentication request from the user terminal 100 or the like. Next, the authentication device 400 extracts face feature information from the face image included in the face authentication request in the same manner as in steps S202 and S203 described above. Then, the authentication unit 450 of the authentication device 400 collates the face feature information extracted from the face image included in the face authentication request with the face feature information 412 in the face information DB 410 (S212) and calculates a degree of coincidence. Then, the authentication unit 450 determines whether the degree of coincidence is equal to or greater than a threshold value (S213). When the face feature information matches, that is, when the degree of coincidence of the face feature information is equal to or greater than the threshold value, the authentication unit 450 specifies the user ID 411 associated with the face feature information 412 (S214). Then, the authentication unit 450 returns a face authentication result including the fact that the face authentication has succeeded and the specified user ID 411 to the recommendation device 500 via the network N (S215). When the degree of coincidence is less than the threshold value in step S213, the authentication unit 450 returns a face authentication result including the fact that the face authentication has failed to the recommendation device 500 via the network N (S216).

[0086] Returning to FIG. 9, the authentication control unit 542 of the recommendation device 500 receives a face authentication result from the authentication device 400 via the network N (S313). Then, the authentication control unit 542 determines whether the face authentication has succeeded or not from the face authentication result received from the authentication device 400 (S314). When it is determined that the face authentication has succeeded, the authentication control unit 542 specifies the user ID included in the face authentication result (S315). Then, the notification unit 547 notifies the authentication terminal 200-1 via the network N that the authentication has succeeded (S316). Note that the notification unit 547 may include a request for acquiring user-related information.

[0087] Accordingly, the authentication terminal 200-1 outputs an unlocking instruction to the gate device 300-1. Thus, the user U1 can enter the building 20. Also, the authentication terminal 200-1 acquires user-related information from the user U1 by the various methods described above, and transmits the user-related information to the recommendation device 500 via the network N. Alternatively, the authentication terminal 200-1 may notify the user terminal 100 of the notified authentication success by short-range wireless communication or the like. In that case, the user terminal 100 may transmit user-related information to the recommendation device 500 via the authentication terminal 200-1 or without passing through the authentication terminal 200-1. At this time, the user terminal 100 may notify the authentication terminal 200-1 of the personal authentication information 123, physical condition information 124, and other user-related information stored in the storage unit 120 by short-range wireless communication or the like.

[0088] After that, the acquisition unit 545 of the recommendation device 500 acquires user-related information (S317). For example, the acquisition unit 545 receives user-related information from the authentication terminal 200-1 or the user terminal 100 via the network N. Alternatively, the acquisition unit 545 may acquire the time information included in the authentication request received in step S311 and the reception time of the face authentication result as the authentication time, that is, as user-related information. Then, the registration unit 541 registers the specified user ID and the acquired user-related information in association with each other in the user information 512 (S318).

[0089] On the other hand, if it is determined in step S314 that the face authentication has failed, the recommendation device 500 notifies the authentication terminal 200-1 of the authentication failure (S319).

[0090] Note that steps S312 to S314 are not limited to face authentication, and other personal authentications may be used. That is, the authentication control unit 542 controls the collation between the personal authentication information for authentication included in the authentication request and the pre-registered personal authentication information to perform authentication. The authentication control unit 542 specifies the user ID associated with the personal authentication information for registration for which the authentication has succeeded.

[0091] FIG. 11 is a flowchart showing the flow of the recommendation process according to Embodiment 2. As a premise, it is assumed that the user U2 has completed the registration of user information in the recommendation device 500, has successfully authenticated by the authentication terminal 200-1, the gate device 300-1 has been unlocked, and the user U2 has entered Building 20. And it is assumed that the user-related information of the user U2 has been registered in the recommendation device 500 in response to the successful authentication.

[0092] And it is assumed that the user U2 is in front of the authentication terminal 200-2 and the vending machine 300-2 in Building 20. At this time, the authentication terminal 200-2 captures the face of the user U2 by the camera 210, and transmits an authentication request including the face image, the time information, and the device type of the vending machine 300-2 to the recommendation device 500 via the network N.

[0093] In response to this, the recommendation device 500 performs the processes of steps S311 to S315 in FIG. 9 described above (S321). That is, the authentication of the user U2 is successful, and the recommendation device 500 is assumed to have identified the user ID of the user U2. Then, the specifying unit 544 of the recommendation device 500 specifies the user-related information 5124 (for example, the authentication time) associated with the specified user ID 5121 (S322). Here, the specifying unit 544 is assumed to specify, as user-related information, a plurality of authentication times (at the gate device 300-1) at a plurality of time points associated with the user U2. Specifically, the specifying unit 544 specifies the authentication time (arrival time) when the user U2 arrives at work and the authentication time (departure time) when leaving work on a plurality of days. In addition, when the user ID and the attendance and departure information are managed in association with each other in a work attendance management system (not shown), the specifying unit 544 may specify the user-related information by acquiring the attendance and departure information associated with the user ID of the user U2. Here, the attendance and departure information may include a set of arrival time and departure time for each user, working hours per month, and the like.

[0094] Then, the determination unit 546 generates the attendance and departure information of user U2 from the authentication times at a plurality of time points (S323). For example, the determination unit 546 calculates the difference between the attendance time and the departure time of user U2 every day, aggregates the differences, and generates the monthly working hours as the attendance and departure information. Alternatively, the determination unit 546 may calculate the average working hours per day in a predetermined period and use it as the attendance and departure information.

[0095] The specifying unit 544 specifies the service providing function 5133 from the service providing device information 513 based on the device type 5132 of the vending machine 300-2 included in the authentication request (S324). For example, the specifying unit 544 specifies the group of vendable products as the service providing function of the vending machine 300-2. Here, the product group shall include, in addition to the product name and price of each product, the attributes (type, characteristics, etc.) of the products. For example, when the product is a food or drink product, the attributes of the product may be nutritional drink, low calorie, etc.

[0096] Thereafter, the determination unit 543 determines whether the physical condition based on the attendance and departure information is worse than a predetermined condition (S325). For example, the determination unit 543 determines whether the working hours of the most recent month indicated by the attendance and departure information exceed a predetermined time, or whether the average working hours per day in the most recent week exceed a predetermined time. When the monthly working hours exceed the predetermined time or the average working hours exceed the predetermined time, the determination unit 543 determines that the physical condition is worse than the predetermined condition.

[0097] When it is determined that the physical condition is worse than the predetermined condition, the determination unit 546 determines the recommendation information based on the service providing function of the specified service providing device (S326). Specifically, when the vending machine 300-2 is a vending machine for food and drink products and the physical condition of user U2 is worse than the predetermined condition, the determination unit 546 determines, as the recommendation information, the food and drink products that can contribute to the recovery of the user's physical condition among the product groups vendable by the vending machine 300-2. For example, when user U2 often attends work early in the morning or departs late at night, or when the working hours exceed the predetermined time, the determination unit 546 may determine nutritional drinks, supplements, etc. that can contribute to the recovery of the physical condition as the recommendation information.

[0098] Thereafter, the notification unit 547 notifies the authentication terminal 200-2 of the successful authentication and the recommendation information (S327). That is, the notification unit 547 transmits to the authentication terminal 200-2 the fact of successful authentication of the user U2 and the fact of recommending the purchase of a nutritional drink via the network N. In response to this, the authentication terminal 200-2 outputs to the vending machine 300-2 the fact of recommending the purchase of a nutritional drink.

[0099] On the other hand, when it is determined in step S325 that the physical condition is not worse than the predetermined condition, the notification unit 547 notifies the authentication terminal 200-2 of the fact of successful authentication (S328).

[0100] FIG. 12 is a diagram showing an example of display of recommendation information according to the second embodiment. Here, the vending machine 300-2 and the authentication terminal 200-2 are connected, and it is shown that the authentication is successful by the face image of the user U2 captured by the camera 210 of the authentication terminal 200-2 and the recommendation information is notified from the recommendation device 500. Specifically, it is assumed that the recommendation device 500 has determined a nutritional drink that can contribute to the recovery of the physical condition of the user U2 as the recommendation information by determining that the physical condition of the user U2 is worse than the predetermined condition, for example, that the user is tired. The authentication terminal 200-2 outputs the notified recommendation information to the vending machine 300-2, and the vending machine 300-2 is assumed to perform a display based on the recommendation information. The vending machine 300-2 includes a sales product list display column 310 and a recommendation comment 320. The sales product list display column 310 is a column for displaying at least a part of the product group that the vending machine 300-2 can sell. In particular, the sales product list display column 310 shows that the purchase of the nutritional drink (the second from the left) specified in the recommendation information is highlighted to recommend it to the user U2. Also, the recommendation comment 320 is a display column for comments based on the recommendation information. Here, the recommendation comment 320 shows an example of a comment "You seem tired. A nutritional drink is recommended." However, the number of products displayed in the sales product list display column 310, the product content, the price, the order, etc. are not limited to this. Also, the comment content of the recommendation comment 320 is just an example.

[0101] FIG. 13 is a diagram showing an example of display of recommended information according to Embodiment 2. Here, an example is shown in which privilege information available for purchasing products at the vending machine 300-2 is displayed as recommended information according to the attendance status and work status of the user U2. Specifically, it is assumed that the recommendation device 500 has determined a discount coupon as the recommended information because the number of attendance days of the user U2 in a month exceeds a predetermined value. The vending machine 300-2 includes a sales product list display column 310a and a recommendation comment 320a. The sales product list display column 310a is the same as that in FIG. 12 described above, but shows an example in which the products to be recommended are not specified. Note that the sales product list display column 310a may display only the product group to be discounted (the target of the discount coupon) or may highlight the products to be discounted. The recommendation comment 320a shows an example of a comment such as "The number of attendance days this month has exceeded 20 times. A 50-yen discount coupon is available." Note that the privilege information may be such that the discount amount is directly deducted from the settlement amount instead of using a discount coupon. In that case, the recommended information may be a message or the like that encourages the purchase of products for which the discount amount can be directly deducted from the settlement amount.

[0102] Note that various determination methods other than the determination method described above may be applied to the recommended information. For example, the recommendation device 500 may acquire and register the physical condition information at the time of attendance as user-related information when the first authentication for passing through the gate device 300-1 is successful, and may determine beverages or supplements suitable for the physical condition information at the time of attendance as the recommended information when using the vending machine 300-2.

[0103] Alternatively, the recommendation device 500 may analyze the expression and degree of smile of the user from the face image captured at the time of the first authentication, and determine the degree of fatigue as the physical condition of the user. Then, when the degree of fatigue indicates that it is worse than a predetermined state, the recommendation device 500 may determine a nutritional drink or the like that can contribute to the recovery of the physical condition as the recommended information.

[0104] Alternatively, the recommendation device 500 may analyze the degree of the user U3's concentration based on the operation content of the user U3 on the multifunction machine 300-3, and determine the physical condition of the user based on the degree of concentration. For example, when the user U3 continuously cancels the print operation on the multifunction machine 300-3 (more than a predetermined number of times within a predetermined time), the recommendation device 500 determines that the concentration of the user U3 has dropped (lower than a predetermined value). Then, when the recommendation device 500 determines that the degree of concentration is lower than the predetermined value, for example, it may determine to recommend the purchase of coffee when using the vending machine 300-2 as the recommendation information. Alternatively, the recommendation device 500 may analyze the hobbies from the text content printed by the user U3 using the multifunction machine 300-3, and determine the recommendation information based on the analysis result.

[0105] Alternatively, the service providing device may be a PC that performs login authentication by face recognition. In that case, the user-related information may be the operation information of the PC by the user after successful face recognition. And the operation information may include the history of the login and logout times, the history of typing operations, and the search history such as the keywords and browsed pages of WEB searches. For example, the recommendation device 500 may analyze the working hours and the degree of typing mistakes from the operation information of the user U3's PC, and determine the health condition (degree of fatigue and concentration) of the user based on these. Also, the recommendation device 500 may analyze the hobbies from the search history of the user U3, and determine the recommendation information based on the analysis result.

[0106] In addition to health information such as the authentication time and the body surface temperature at the time of successful authentication as user-related information, based on the purchase history of products actually purchased at a store, etc., when using the vending machine, recommended products may be displayed on a service providing device or the like. That is, the recommendation device 500 registers the purchase history by the payment terminal using face authentication of a specific user as user-related information, and when the user successfully authenticates at the vending machine, determines recommendation information based on the purchase history by the payment terminal, and may display it on the vending machine. For example, when a user has purchased coffee at a store a predetermined number of times or more using a payment terminal with face authentication, when the user uses the vending machine, the recommendation device 500 may determine a product other than coffee considering the user's health and display it on a service providing device or the like. Or, when a user has purchased a specific product at a store using a payment terminal with face authentication, the recommendation device 500 analyzes the user's hobbies and preferences taking into account the purchase history of the specific product, determines a product similar to the specific product, and may display it as a recommended product on the vending machine.

[0107] As described above, the recommendation device 500 according to the second embodiment registers the user-related information acquired when the first authentication performed for the user U1 to pass through the gate device 300-1 is successful. Then, for example, when the second authentication performed for the user U1 to purchase a beverage at the vending machine 300-2 is successful, information recommended to the user U1 is notified based on the user-related information of the user U1 and the list of beverages (product attributes) that can be purchased at the vending machine 300-2. Here, the combination of the first service providing device and the second service providing device may be any of the gate device 300-1, the vending machine 300-2, and the multifunction device 300-3, or other devices. That is, it suffices that the providing functions of the first service providing device and the second service providing device are different. And the recommendation information suffices that it is based on the providing function of the second service providing device. Also, the user-related information may be based not only on the authentication result and physical condition information, but also on the providing function, operation content, or purchase history of the second service providing device as described above.

[0108] Based on these, from the information about the user at the time of the first authentication, the state of the user such as the physical condition can be automatically grasped, and information suitable for the state of the user at the time of the second authentication can be recommended.

[0109] <Other Embodiments> In addition, in the above-described Embodiment 2, the recommendation device 500 etc. and the authentication device 400 have been described as separate information processing devices, but they may be the same. For example, the recommendation device 500 etc. may further register face feature information in association with the user ID 5121 of the user information 512. In that case, the control unit 540 may include the face detection unit 420, feature point extraction unit 430, registration unit 440, and authentication unit 450 of FIG. 5.

[0110] In the above example, the program includes a group of instructions (or software code) for causing a computer to perform one or more functions described in the embodiment when loaded into the computer. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD), or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disc, or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage devices. The program may be transmitted on a temporary computer-readable medium or communication medium. By way of example and not limitation, the temporary computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0111] Note that the present disclosure is not limited to the above embodiments, and can be appropriately changed without departing from the gist. Also, the present disclosure may be implemented by appropriately combining each embodiment.

[0112] Some or all of the above embodiments may be described as follows in the following supplementary notes, but are not limited thereto. (Supplementary Note A1) Registration means for registering, in association with the user, user-related information related to the user obtained at the time of successful first authentication performed when a predetermined user uses a first service providing device; Specifying means for specifying the user-related information associated with the user when second authentication performed when the user uses a second service providing device is successful; Determining means for determining recommendation information when using the second service providing device based on the user-related information and the provided functions of the second service providing device; Notification means for notifying the user of the recommendation information; A recommendation device comprising the above. (Supplementary Note A2) The determining means: Determines the physical condition of the user based on the user-related information, And determines the recommendation information based on the physical condition and the provided functions of the second service providing device The recommendation device according to Supplementary Note A1. (Supplementary Note A3) The first service providing device is a control device for an entrance / exit gate, The user-related information includes the authentication time of the first authentication, The determining means: Generates commuting information of the user from the authentication times in a plurality of the first authentications of the user, And determines the physical condition of the user from the commuting information The recommendation device according to Supplementary Note A2. (Supplementary Note A4) The user-related information includes a face image of the user taken at the time of the first authentication, The determining means analyzes the face image to derive the fatigue degree of the user, and determines the fatigue degree as the physical condition. The recommendation device according to Supplementary Note A2 or A3. (Supplementary Note A5) The second service providing device is a vending machine for a plurality of food and beverages, When the determination means indicates that the physical condition is worse than a predetermined condition, the determination means determines, as the recommendation information, food and beverages among the plurality of food and beverages that can contribute to the recovery of the user's physical condition. The recommendation device according to any one of appended claims A2 to A4. (Appended claim A6) The user-related information includes operation information of the user with respect to the first service providing device. The determination means analyzes the operation information to derive the user's concentration, and determines the concentration as the physical condition. The recommendation device according to any one of appended claims A2 to A5. (Appended claim A7) The second service providing device is a vending machine for goods. Based on the user-related information, the determination means determines, as the recommendation information, privilege information that can be used for purchasing the goods. The recommendation device according to any one of appended claims A1 to A4. (Appended claim B1) A first service providing device that enables use of a service in response to successful first authentication, A second service providing device that enables use of a service in response to successful second authentication, A recommendation device, and includes: The recommendation device Registration means for registering, in association with the user, user-related information related to the user obtained at the time of successful first authentication performed when the predetermined user uses the first service providing device. Specification means for specifying the user-related information associated with the user at the time of successful second authentication performed when the user uses the second service providing device. Determination means for determining recommendation information when using the second service providing device based on the user-related information and the provided function of the second service providing device. Notification means for notifying the user of the recommendation information. A recommendation system comprising the same. (Appendix B2) The determination means determines the physical condition of the user based on the user-related information, and determines the recommendation information based on the physical condition and the provided functions of the second service providing device The recommendation system according to Appendix B1. (Appendix C1) A computer associates and registers the user-related information obtained at the time of successful first authentication performed when a predetermined user uses the first service providing device with the user, identifies the user-related information associated with the user at the time of successful second authentication performed when the user uses the second service providing device, determines recommendation information for using the second service providing device based on the user-related information and the provided functions of the second service providing device, and notifies the user of the recommendation information, Recommendation method. (Appendix D1) A registration process of associating and registering the user-related information related to the user obtained at the time of successful first authentication performed when a predetermined user uses the first service providing device with the user, a specifying process of specifying the user-related information associated with the user at the time of successful second authentication performed when the user uses the second service providing device, a determination process of determining recommendation information for using the second service providing device based on the user-related information and the provided functions of the second service providing device, a notification process of notifying the user of the recommendation information, A non-transitory computer-readable medium storing a recommendation program for causing a computer to execute the above.

[0113] The present invention has been described with reference to the embodiments (and examples), but the present invention is not limited to the above embodiments (and examples). Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

Explanation of Reference Numerals

[0114] 1 Recommendation device 11 Registration unit 12 Identification unit 13 Decision unit 14 Notification unit 1000 Recommendation system N Network U1 User U2 User U3 User 100 User terminal 110 Camera 120 Storage unit 121 Program 122 Location information 123 Biometric authentication information 124 Health information 130 Memory 140 Communication unit 150 Input / output unit 160 Control unit 161 Registration unit 162 Acquisition unit 163 Display control unit 20 Building 200 Authentication terminal 200-1 Authentication terminal 200-2 Authentication terminal 200-3 Authentication terminal 210 Camera 220 Storage unit 221 Program 230 Memory 240 Communication unit 250 Input / output unit 260 Control unit 261 Display control unit 262 Authentication request unit 263 Processing control unit 300 Service providing device 300-1 Gate Device 300-2 Vending Machine 300-3 Multifunction Machine 400 Authentication Device 410 Facial Information DB 411 User ID 412 Facial Feature Information 420 Face Detection Unit 430 Feature Point Extraction Unit 440 Registration Unit 450 Authentication Unit 500 Recommendation Device 510 Memory Unit 511 Program 512 User Information 5121 User ID 5122 Personal Information 5123 Terminal Information 5124 User-related Information 51241 Authentication Result 51242 Physical Condition Information 51243 Operation Information 513 Service Provision Device Information 5131 Device ID 5132 Device Type 5133 Provided Function 520 Memory 530 Communication Unit 540 Control Unit 541 Registration Unit 542 Authentication Control Unit 543 Judgment Unit 544 Identification Unit 545 Acquisition Unit 546 Decision Unit 547 Notification Unit 310 Sales Product List Display Column 310a Sales Product List Display Column 320 Recommendation Comment 320a Recommendation Comment

Claims

1. Registration means for registering the user-related information related to the user, which is obtained when the first authentication performed when a specific user uses the first service providing device is successful, in association with the user; Specification means for specifying the user-related information associated with the user when the second authentication performed when the user uses the second service providing device is successful; Determination means for determining the physical condition of the user based on the user-related information, and determining, based on the determined physical condition and the provided functions of the second service providing device, among the products that can be purchased by the second service providing device, products that can contribute to the recovery of the determined physical condition, or recommendation information that is a privilege applicable when using the second service providing device, by a predetermined logic; Notification means for notifying the user of the recommendation information; A recommendation device comprising the above.

2. The first service providing device is a control device for an entrance / exit gate, The user-related information includes the authentication time of the first authentication, The determination means Generates the user's commuting information from the authentication times in the plurality of the first authentications of the user, Determines the physical condition of the user from the commuting information The recommendation device according to Claim 1.

3. The user-related information includes the face image of the user taken at the time of the first authentication, The determination means analyzes the face image to derive the fatigue degree of the user, and determines the fatigue degree as the physical condition. The recommendation device according to Claim 1 or 2.

4. The second service providing device is a plurality of vending machines for food and beverages, When the determination means indicates that the physical condition is worse than a predetermined condition, the determination means determines, as the recommendation information, food and beverages among the plurality of food and beverages that can contribute to the recovery of the user's physical condition. The recommendation device according to any one of Claims 1 to 3.

5. The user-related information includes the operation information of the user with respect to the first service providing device, The determination means analyzes the operation information to derive the concentration of the user, and determines the concentration as the physical condition. The recommendation device according to any one of Claims 1 to 4.

6. The second service providing device is a vending machine for products, The determination means determines, as the recommendation information, privilege information available for purchasing the product based on the user-related information. The recommendation device according to any one of claims 1 to 3.

7. A first service providing device that enables a service to be used in response to the success of a first authentication, A second service providing device that enables a service to be used in response to the success of a second authentication, A recommendation device, comprising: The recommendation device is Registration means for registering, in association with the user, user-related information related to the user obtained at the time of success of the first authentication performed when a predetermined user uses the first service providing device; Identification means for identifying the user-related information associated with the user at the time of success of the second authentication performed when the user uses the second service providing device; Determining means for determining the physical condition of the user based on the user-related information, and determining, based on the determined physical condition and the provided functions of the second service providing device, among the products that can be purchased by the second service providing device, products that can contribute to the recovery of the determined physical condition, or recommendation information that is a privilege applicable when using the second service providing device, by a predetermined logic; Notification means for notifying the user of the recommendation information; A recommendation system comprising:

8. A computer registers, in association with the user, user-related information related to the user obtained at the time of success of the first authentication performed when a predetermined user uses a first service providing device, identifies the user-related information associated with the user at the time of success of the second authentication performed when the user uses a second service providing device, determines the physical condition of the user based on the user-related information, and determines, based on the determined physical condition and the provided functions of the second service providing device, among the products that can be purchased by the second service providing device, products that can contribute to the recovery of the determined physical condition, or recommendation information that is a privilege applicable when using the second service providing device, by a predetermined logic, and notifies the user of the recommendation information. A recommendation method.

9. A registration process for registering, in association with the user, user-related information related to the user obtained at the time of success of the first authentication performed when a predetermined user uses a first service providing device, When the second authentication performed when the user uses the second service providing device is successful, a specifying process for specifying the user-related information associated with the user, a determining process for determining the physical condition of the user based on the user-related information, and determining, based on the determined physical condition and the provided functions of the second service providing device, among the products that can be purchased by the second service providing device, products that can contribute to the recovery of the determined physical condition, or recommendation information that is a privilege applicable when using the second service providing device, by a predetermined logic, a notification process for notifying the user of the recommendation information, A recommendation program that causes a computer to execute.

Images