Server device, system, server device control method and program

Abstract

Provided is a server device that can provide a better customer reception service to a customer who has visited a shop or the like. The server device includes a generation means and a notification control means. The generation means generates a behavior history of each of a plurality of users in an area that includes a plurality of facilities. The notification control means, on the basis of a behavior history of a visitor who is among the plurality of users and who visited one of the facilities in the area, generates preference information of the visitor and notifies a person who works at the one of the facilities of the generated preference information.

Description

[Technical Field]

[0001] The present invention relates to a server device, a system, a method for controlling a server device, and a storage medium. [Background technology]

[0002] In recent years, technological developments related to biometric authentication have been progressing.

[0003] For example, Patent Document 1 discloses a face matching system that prevents the same face image from being repeatedly notified in a system that notifies customers when the face image of the customer detected in a store or the like is registered. The face matching system of Patent Document 1 detects and cuts out a face image of the customer photographed in the store, detects features between the cut-out face image and face images registered in a face image database, and calculates a mutual similarity value for the detected features. If the calculated similarity value exceeds a predetermined threshold, the face matching system extracts the face image with the highest similarity value. The face matching system checks the registration information of the extracted face image, and if a VIP (Very Important Person) flag is set in the registration information, it proceeds to VIP notification processing. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-016969 Summary of the Invention [Problem to be solved by the invention]

[0005] As described in Patent Document 1, there are important customers for businesses (retail stores) and the like. In Patent Document 1, when a VIP visits a store, a store clerk is notified of this fact. However, even if a store clerk is simply notified of the fact that a VIP has visited the store, it is difficult for a new store clerk to provide sufficient customer service to the VIP. This is because the new store clerk does not have knowledge of the preferences and interests of the VIP, etc.

[0006] The main object of the present invention is to provide a server device, a system, a method for controlling a server device, and a storage medium that contribute to enabling better customer service to be provided to customers visiting a store or the like. [Means for solving the problem]

[0007] According to a first aspect of the present invention, a server device is provided that includes a generation means for generating a behavioral history of each of a plurality of users within an area including a plurality of facilities, and a notification control means for generating preference information of a visitor who visits one of the plurality of users at a facility within the area based on the behavioral history of the visitor, and notifying a person working at the facility of the generated preference information.

[0008] According to a second aspect of the present invention, there is provided a system including a terminal and a server device, wherein the server device is equipped with a generation means for generating a behavioral history of each of a plurality of users within an area including a plurality of facilities, and a notification control means for generating preference information of a visitor among the plurality of users who visits a facility within the area based on the behavioral history of the visitor, and for transmitting the generated preference information to a terminal carried by a person working at the facility.

[0009] According to a third aspect of the present invention, there is provided a method for controlling a server device, in which a behavioral history of each of a plurality of users within an area including a plurality of facilities is generated in the server device, preference information of a visitor among the plurality of users who has visited one of the facilities within the area is generated based on the behavioral history of the visitor, and the generated preference information is notified to a person working at the one of the facilities.

[0010] According to a fourth aspect of the present invention, there is provided a computer-readable storage medium that stores a program for causing a computer mounted on a server device to execute the following processes: generating a behavioral history of each of a plurality of users within an area including a plurality of facilities; generating preference information of a visitor who visits one of the plurality of users at a facility within the area based on the behavioral history of the visitor; and notifying a person working at the facility of the generated preference information. [Effects of the Invention]

[0011] According to each aspect of the present invention, a server device, a system, a method for controlling a server device, and a storage medium are provided that contribute to providing better customer service to customers visiting a store, etc. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram for explaining an outline of an embodiment. [Figure 2] FIG. 2 is a flowchart for explaining an outline of the operation of one embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating the operation of the information processing system according to the first embodiment. [Figure 5] FIG. 5 is a diagram for explaining the operation of the information processing system according to the first embodiment. [Figure 6] FIG. 6 is a diagram for explaining the operation of the information processing system according to the first embodiment. [Figure 7] FIG. 7 is a diagram for explaining the operation of the information processing system according to the first embodiment. [Figure 8]FIG. 8 is a diagram for explaining the operation of the information processing system according to the first embodiment. [Figure 9] FIG. 9 is a diagram for explaining the operation of the information processing system according to the first embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a processing configuration of a server device according to the first embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a display on the terminal according to the first embodiment. [Figure 12] FIG. 12 is a diagram illustrating an example of a display on the terminal according to the first embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of a display on the terminal according to the first embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of a user information database according to the first embodiment. [Figure 15] FIG. 15 is a diagram illustrating an example of a display on the terminal according to the first embodiment. [Figure 16] FIG. 16 is a flowchart showing an example of the operation of the server device according to the first embodiment. [Figure 17] FIG. 17 is a diagram illustrating an example of a processing configuration of an authentication terminal according to the first embodiment. [Figure 18] FIG. 18 is a diagram illustrating an example of a processing configuration of a terminal according to the first embodiment. [Figure 19] FIG. 19 is a diagram illustrating an example of a display on the terminal according to the first embodiment. [Figure 20] FIG. 20 is a sequence diagram illustrating an example of the operation of the information processing system according to the first embodiment. [Figure 21] FIG. 21 is a diagram showing an example of a display on a terminal according to a modification of the first embodiment. [Figure 22] FIG. 22 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure. [Figure 23] FIG. 23 is a diagram showing an example of a display on a terminal according to a modification of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] First, an overview of one embodiment will be described. Note that the reference numerals in the drawings are added to each element for convenience as an example to facilitate understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

[0014] A server device 100 according to one embodiment includes a generating means 101 and a notification control means 102 (see FIG. 1). The generating means 101 generates a behavior history of each of a plurality of users in an area including a plurality of facilities (step S1 in FIG. 2). The notification control means 102 generates preference information of a visitor based on the behavior history of a visitor who visited one of the plurality of users at one facility in the area, and notifies a person working at the one facility of the generated preference information (step S2).

[0015] The server device 100 generates a behavior history of the user not only in the facility (e.g., a retail store) visited by the user but also in other facilities in the same area (e.g., a complex building). The server device 100 uses the generated behavior history to notify the store staff or the like of the visitor's preferences and interests as preference information. Because preference information is generated from the behavior history including behavior in other facilities, the staff can know the visitor's accurate preferences, etc. The staff can provide better customer service to the visitor (store customer) by serving the visitor based on the notified preference information.

[0016] Specific embodiments will be described in more detail below with reference to the drawings.

[0017] [First embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0018] [System Configuration] Fig. 3 is a diagram showing an example of a schematic configuration of an information processing system (authentication system) according to the first embodiment. As shown in Fig. 3, the information processing system includes a complex building equipped with various facilities. The complex building includes residences, offices, retail stores, entertainment facilities (e.g., movie theaters, concert halls), medical facilities (e.g., hospitals, pharmacies), public facilities (e.g., libraries), etc. Typically, the complex building is a high-rise building with many floors.

[0019] The information processing system according to the first embodiment aims to improve the convenience of users related to an area (building) including multiple facilities. For example, the information processing system improves the convenience of users (users of the complex building), such as residents who live in the complex building, workers who work in the complex building, and customers of stores in the complex building. Note that, although the description in this document uses a "complex building" as an example of an area having multiple facilities, it is not intended to limit areas having multiple facilities to a "complex building." For example, areas such as summer resorts and tourist destinations where many commercial facilities operate in one area may also be set as targets of the present disclosure.

[0020] The information processing system includes a server device 10. The server device 10 is a device that realizes the main functions of the information processing system. The server device 10 is connected to various devices and apparatuses in a complex building via a network.

[0021] Fig. 4 is a diagram showing an example of the structure of a specific floor in a complex building. As shown in Fig. 4, a plurality of camera devices 20-1 to 20-5 are installed that can capture images of various locations in the complex building, such as entrances and exits, corridors, inside stores, etc. Furthermore, authentication terminals 30-1 to 30-8 are installed in each facility, such as residences, offices, and retail stores.

[0022] In the following description, unless there is a particular reason to distinguish between the camera devices 20-1 to 20-5, they will simply be referred to as "camera device 20." Similarly, for other elements, the reference numeral to the left of the hyphen will represent that element.

[0023] Due to its nature, a variety of people enter and exit a building complex, such as residents who live in the building complex, employees who have offices in the building complex, staff working in stores or entertainment facilities in the building complex, and customers visiting stores in the building complex.

[0024] In the drawings including Figure 4, residents are represented by light grey figures, office workers (workers of businesses that do not provide direct services to customers visiting the complex building) are represented by black figures, store clerks are represented by dark grey figures, and customers visiting stores are represented by white figures.

[0025] The authentication terminal 30 is a terminal that performs operations related to biometric authentication of users (users of the complex building). The authentication terminal 30 requests the server device 10 to perform biometric authentication using the user's biometric information. The authentication terminal 30 performs operations according to the authentication result (authentication success, authentication failure) of the server device 10.

[0026] For example, authentication terminals 30-1 to 30-3 installed in homes open the doors of the homes when they have successfully authenticated the person to be authenticated standing in front of the homes. Authentication terminal 30-4 installed in an office opens the gate installed at the entrance of the office when it has successfully authenticated the person to be authenticated standing in front of the gate.

[0027] The authentication terminals 30-5 to 30-7 installed in a store or the like are used for settling payments for purchased goods, etc. Alternatively, the authentication terminals 30-5 to 30-7 may be used for authentication to detect users who enter a store, etc. The authentication terminal 30-8 installed in an entertainment facility such as a movie theater opens the gate and allows entry to the facility when the person to be authenticated has a ticket to use the facility.

[0028] In the drawings including FIG. 4, the authentication terminal 30 is depicted as a signage-type device, but in reality, devices with shapes and functions appropriate for the purpose of each facility are installed. For example, the authentication terminal 30 installed in a home can be a door equipped with a camera. Also, the authentication terminal 30 installed in an office can be a gate device equipped with a camera.

[0029] Examples of the user's biometric information include data (features) calculated from physical characteristics unique to an individual, such as a face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, the user's biometric information may be image data such as a face image or fingerprint image. The user's biometric information may be any information that includes the user's physical characteristics. In the first embodiment, the biometric information is a person's face image or features generated from a face image.

[0030] The server device 10 shown in Fig. 3 and the camera device 20 and authentication terminal 30 shown in Fig. 4 are connected via a network. Fig. 3 and Fig. 4 are merely examples and are not intended to limit the configuration of the information processing system disclosed in the present application. For example, the information processing system may include two or more server devices 10.

[0031] The internal structure of the complex building shown in Figure 4 is an example and is not intended to limit the internal structure of the complex building. In Figure 4, for ease of understanding, residential and commercial facilities are shown on the same floor. However, in reality, residential and commercial facilities are often located on different floors.

[0032] [General operation] Next, the general operation of the information processing system according to the first embodiment will be described.

[0033] In the following explanation, users who use the complex building on a daily and continuous basis (for example, residents, workers) will be referred to as "continuous users." In contrast, users who do not use the complex building on a daily basis (for example, customers of stores, customers of entertainment facilities, etc.) will be referred to as "general users." General users can also register as members to use the complex building. General users who have registered as members will be referred to as "member users," and users who have not registered as members will be referred to as "non-member users."

[0034] <Registering as a continuing user> Continuing users (e.g., residents, workers) who use the complex building on a daily basis must register as continuing users in the system.

[0035] The continuing user operates the terminal 40 that he or she possesses to register continuing user information in the server device 10. Specifically, the continuing user inputs his or her own biometric information (e.g., facial image), login information (login ID, password), user type (e.g., resident, employee), and personal information (e.g., name, age, address, place of employment, account information, etc.) into the server device 10 (see FIG. 5).

[0036] When the continued user information is acquired, the server device 10 generates a user ID (IDentifier) ​​for identifying the user. The server device 10 associates the generated user ID with the acquired personal information and the like and stores them in the user information database.

[0037] <Membership registration> As described above, general users who do not regularly use the complex (e.g., customers of stores, entertainment facilities, etc.) can register as members. For example, a user can become a common member of stores, entertainment facilities, etc. operating in the complex. The server device 10 provides various services to the common member.

[0038] A general user operates a terminal 40 that the general user owns to register member information in the server device 10. Specifically, the general user inputs his / her own biometric information (e.g., a facial image), login information (login ID, password), and personal information (e.g., name, age, sex, address, etc.) into the server device 10 (see FIG. 6).

[0039] When the member information is acquired, the server device 10 generates a user ID for identifying the user. The server device 10 associates the generated user ID with the acquired personal information and the like and stores them in the user information database. At that time, the server device 10 sets the user type of the user to "member user."

[0040] Furthermore, regular users (e.g., residents, workers) who use the complex on a daily basis do not need to register as members. Regular users can receive the same services as registered users.

[0041] Regular users and member users can receive services that allow them to comfortably use the facilities of the complex building. For example, member users can purchase tickets to cinemas, art museums, etc. online. Alternatively, member users can make hospital appointments online. Alternatively, member users can pay for products purchased at stores, etc., using facial payment.

[0042] <Provision of online services> The server device 10 provides online services related to stores, entertainment facilities, etc. operating in a complex building.

[0043] For example, a member user operates terminal 40 to access a portal site provided by server device 10 in order to purchase movie theater tickets. The member user purchases movie tickets on the portal site. Server device 10 stores information about the tickets purchased by the member user (ticket information) in a user information database.

[0044] A member user who makes an online hospital reservation accesses the portal site provided by the server device 10 and makes a reservation for a medical examination or the like on the site, in the same way as when purchasing a ticket.

[0045] <Generating behavioral history> The server device 10 uses various methods and means to collect behavioral information about users (repeated users and general users) of the complex building, and generates a behavior history.

[0046] The server device 10 can obtain behavioral information of users (for example, residents, employees, store clerks, and customers) using image data obtained from the camera devices 20 installed in various locations in the complex. If the consent of the users is required for the camera devices 20 to photograph the users of the complex, the manager of the complex is required to take measures such as posting a notice to that effect (that users will be photographed) at the entrance of the complex.

[0047] For example, the server device 10 acquires image data from a camera device 20-1 that captures an entrance / exit of a building complex. The server device 10 extracts biometric information (face image) from the image data and performs a matching process using the extracted biometric information and biometric information registered in the user information database. If the matching process is successful, the server device 10 registers the fact that the user identified by the matching process has entered the building complex as behavioral information in the user information database.

[0048] If the matching process fails, the server device 10 determines that a general user (non-member user) who has not registered as a user or member has entered the building complex. In this case, the server device 10 generates a user ID for the non-member user. The server device 10 registers the generated user ID and biometric information (biometric information obtained from image data; for example, a facial image or feature values) in a user information database.

[0049] Furthermore, the server device 10 can generate behavioral information using image data obtained from a camera device 20 installed at a location other than the entrance / exit of the complex building. For example, the server device 10 generates behavioral information about a user who stays in the same place for a predetermined period of time or more. For example, if a user stays in front of a show window for a predetermined period of time, the server device 10 registers this fact in the user information database. For example, the server device 10 registers in the user information database the fact that the user was engaged in so-called window shopping.

[0050] The server device 10 may generate behavioral information when processing an authentication request received from the authentication terminal 30. The authentication terminal 30 installed in each facility of the complex transmits an authentication request including biometric information of the person to be authenticated to the server device 10 (see FIG. 8).

[0051] The server device 10 performs authentication (one-to-N authentication; N is a positive integer, the same applies below) using the biometric information included in the authentication request and the biometric information registered in the user information database. The server device 10 notifies the authentication terminal 30 of the authentication result (authentication success, authentication failure).

[0052] For example, when authentication terminal 30-1 installed in a house receives a successful authentication, it opens the door. In this case, server device 10 generates, as behavior information, the fact that the resident has returned home to the house where authentication terminal 30-1 is installed.

[0053] When the authentication terminal 30-4 installed in the office receives the successful authentication, it opens the gate. In this case, the server device 10 generates, as behavior information, the fact that the employee has come to work in the office where the authentication terminal 30-4 is installed.

[0054] When the authentication terminal 30-5 installed in a store or the like receives the authentication success, it determines that the payment for the product or service purchased by the user has been completed. In this case, the server device 10 generates the purchase of the product or service as behavior information.

[0055] When the authentication terminal 30-8 installed in the movie theater or the like receives the successful authentication, it permits the user to enter the movie theater or the like. In this case, the server device 10 generates, as behavior information, the fact that the user watched a movie.

[0056] <Visitor Notification> The server device 10 utilizes the user's behavior history to improve user convenience. For example, the server device 10 provides information to store clerks so that they can provide appropriate customer service to customers who visit a store. Appropriate customer service by store clerks increases the satisfaction of shopping users.

[0057] As shown in Fig. 9, a camera device 20 installed inside a store captures images of customers who visit the store. The camera device 20 transmits image data of the customers to a server device 10. The server device 10 identifies the visiting user by performing a matching process using biometric information obtained from the image data and biometric information registered in a user information database.

[0058] The server device 10 analyzes the behavioral history of the identified user (customer) and generates preference information of the user. Specifically, the server device 10 generates the hobbies and interests of the customer as preference information based on the behavioral history.

[0059] The server device 10 transmits a visitor notification including the generated preference information to the terminal 40 carried by a salesperson at the store where the customer visited. For example, the server device 10 notifies the salesperson of the customer's preference information, such as "I like movies" or "I like a particular fashion brand."

[0060] The salesperson will use the information provided to them when serving the customer. For example, if a customer likes movies, the salesperson will recommend products related to the movies. Or, if a customer likes a particular fashion brand, the salesperson will recommend products from similar fashion brands.

[0061] This type of customer service allows customers to purchase products and services that suit their preferences, and also increases the probability that stores will be able to sell products and services to customers.

[0062] Next, details of each device included in the information processing system according to the first embodiment will be described.

[0063] [Server device] 10 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the first embodiment. Referring to FIG. 10, the server device 10 includes a communication control unit 201, an information registration unit 202, an online service control unit 203, a behavior history generation unit 204, a visitor notification control unit 205, and a storage unit 206.

[0064] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the authentication terminal 30. The communication control unit 201 also transmits data to the authentication terminal 30. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0065] The information registration unit 202 is a means for registering continued user information and member information. In response to access from the terminal 40, the information registration unit 202 displays a GUI (Graphical User Interface) such as that shown in FIG.

[0066] 11, when "Register continuing user" is selected, the information registration unit 202 displays a GUI for acquiring continuing user information (information on residents who use the complex building on a daily basis) on the terminal 40. For example, the information registration unit 202 acquires continuing user information using a GUI such as that shown in FIG.

[0067] 11, when "member registration" is selected, the information registration unit 202 displays a GUI for acquiring member information (information on general users who temporarily use the complex building) on ​​the terminal 40. For example, the information registration unit 202 acquires member information using a GUI such as that shown in FIG.

[0068] When the continued user information or member information is acquired, the information registration unit 202 generates a feature amount (a feature vector consisting of a plurality of feature amounts) from the acquired biometric information (face image).

[0069] Since existing technology can be used for the process of generating feature amounts, detailed description thereof will be omitted. For example, the information registration unit 202 extracts the eyes, nose, mouth, etc. from the face image as feature points. After that, the information registration unit 202 calculates the position of each feature point and the distance between each feature point as feature amounts, and generates a feature vector (vector information that characterizes the face image) consisting of multiple feature amounts.

[0070] The information registration unit 202 also generates a user ID for identifying a system registrant (a continuing user or a member user). The user ID may be any information that can uniquely identify a user registered in the system. For example, the information registration unit 202 may assign a unique value each time a user is registered as a user ID.

[0071] The information registration unit 202 associates the generated user ID, feature amount (biometric information), user type (resident, employee, store clerk, member user), login information, and personal information (e.g., name, etc.) and stores them in a user information database (see FIG. 14). Note that the user information database shown in FIG. 14 is an example and is not intended to limit the items to be stored. For example, a "face image" may be registered in the user information database as biometric information.

[0072] Furthermore, when the information registration unit 202 acquires member information, it sets the user type of the user who inputs the member information to "member user."

[0073] The online service control unit 203 is a means for controlling the online services provided to users who have registered with the system (continuing users, member users).

[0074] For example, when "Login" is selected in Fig. 11, the online service control unit 203 acquires login information (login ID, password) from the user's terminal 40. The online service control unit 203 authenticates the user using the acquired login information and the login information registered in the user information database.

[0075] If the authentication using the login information is successful, the online service control unit 203 performs control to provide online services to the user. For example, the online service control unit 203 displays a GUI as shown in Fig. 15. The online service control unit 203 performs control related to the menu selected by the user from the various menus shown in Fig. 15. For example, the online service control unit 203 performs control related to the purchase of movie theater tickets, making hospital appointments, etc.

[0076] The online service control unit 203 stores information about tickets and the like purchased by the user in a user information database. Note that detailed explanations of the various services (online services) provided by the online service control unit 203 will be omitted, as explanations about ticket purchases and the like are outside the scope of the present disclosure.

[0077] The behavior history generation unit 204 is a means for generating the behavior history of each of a plurality of users in an area including a plurality of facilities (for example, in a complex building). More specifically, the behavior history generation unit 204 generates the behavior history of users (repeated users, general users) of the complex building. The behavior history generation unit 204 collects behavior information of each user using various methods and means.

[0078] For example, the behavior history generation unit 204 generates behavior information using image data obtained from the camera device 20. Alternatively, the behavior history generation unit 204 generates behavior information using data obtained from the authentication terminal 30.

[0079] More specifically, the behavior history generation unit 204 receives image data and a camera ID from the camera device 20. The camera ID is an ID for identifying the camera device 20 installed at each location in the building complex. The camera ID may be a MAC (Media Access Control) address or an IP (Internet Protocol) address of the camera device 20.

[0080] The behavior history generation unit 204 attempts to extract a face image from the acquired image data.

[0081] Since existing technologies can be used for the facial image detection process and facial image extraction process by the behavior history generation unit 204, detailed description thereof will be omitted. For example, the behavior history generation unit 204 may extract a facial image (face region) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the behavior history generation unit 204 may extract a facial image using a method such as template matching.

[0082] If the facial image is successfully extracted, the behavior history generation unit 204 generates a feature from the facial image. The behavior history generation unit 204 sets the generated feature as a matching target and performs a matching process with at least one feature stored in the user information database (1:N matching).

[0083] Specifically, the behavior history generation unit 204 calculates the similarity between the feature amount (feature vector) of the comparison target and each of the multiple feature amounts on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0084] If there is a feature whose similarity is equal to or greater than a predetermined value, the behavior history generation unit 204 determines that the matching process is successful. If the matching process is successful, the behavior history generation unit 204 identifies the entry (the user appearing in the image data) with the feature whose similarity is the highest. In this case, the behavior history generation unit 204 identifies the installation location of the camera device 20 that transmitted the image data from the camera ID of the camera device 20. The behavior history generation unit 204 generates behavior information according to the installation location of the camera device 20 as behavior information of the identified user.

[0085] For example, if a user is captured in image data captured by a camera device 20-1 installed at the entrance of a complex building, the behavior history generation unit 204 generates behavior information indicating that the identified user has "entered the complex building."

[0086] The behavior history generation unit 204 stores the generated behavior information in the behavior history field of the specified user. As shown in Fig. 14, the behavior history generation unit 204 stores the behavior information and the date and time when the behavior information was obtained in the user information database.

[0087] If there is no feature whose similarity is equal to or greater than a predetermined value, the behavior history generation unit 204 determines that the matching process has failed. If the matching process has failed, the behavior history generation unit 204 determines that the user appearing in the image data is a non-member user. The behavior history generation unit 204 generates a user ID to identify the non-member user, and stores the generated user ID and biometric information (feature) in the user information database. At that time, the behavior history generation unit 204 sets the user type of the user to "non-member user."

[0088] The behavior history generation unit 204 generates behavior information for non-member users in the same way as for other users (continuing users, member users) according to the installation location of the camera device 20. The behavior history generation unit 204 stores the generated behavior history in the behavior history field of the corresponding user (non-member user).

[0089] The behavior history generation unit 204 may generate behavior information for users who appear for a predetermined period of time or longer in image data captured by the same camera device 20. For example, for a user who stays in front of a movie theater for a predetermined period of time (e.g., 3 minutes) or longer, the behavior history generation unit 204 may generate behavior information such as "stayed at movie theater." Similarly, for a user who stays in front of an art museum for a predetermined period of time or longer, the behavior history generation unit 204 may generate behavior information such as "stayed at art museum."

[0090] In this way, the behavior history generation unit 204 identifies the person appearing in the image data by performing a matching process using the biometric information of the person appearing in the image data acquired from the camera device 20 installed in the complex building and the biometric information stored in the user information database. The behavior history generation unit 204 generates behavior information of the identified person based on the installation location of the camera device 20, and registers the generated behavior information in the user information database.

[0091] The behavior history generation unit 204 processes an authentication request received from the authentication terminal 30. The behavior history generation unit 204 may generate behavior information when processing the authentication request.

[0092] The authentication request includes the biometric information (facial image) of the person to be authenticated and a terminal ID. The terminal ID is an ID for identifying the authentication terminal 30 installed in each location in the complex building. The MAC address or IP address of the authentication terminal 30 can be used as the terminal ID.

[0093] The behavior history generation unit 204 generates features from the face image included in the authentication request. The behavior history generation unit 204 executes a matching process using the generated features and features registered in the user information database to identify the corresponding user.

[0094] If the matching process is successful (if a feature with a similarity equal to or greater than a predetermined value is registered), the behavior history generation unit 204 executes a process (authentication process) according to the installation location of the authentication terminal 30 obtained from the terminal ID.

[0095] For example, consider a case where the behavior history generation unit 204 receives an authentication request from an authentication terminal 30 installed in a home. In this case, if the address of the home where the authentication terminal 30 is installed matches the address of the person to be authenticated identified by the matching process, the behavior history generation unit 204 determines that the authentication has been successful. In this case, the behavior history generation unit 204 transmits a notification of authentication success to the authentication terminal 30.

[0096] Furthermore, the behavior history generating unit 204 generates "return home" as behavior information related to the identified user. The behavior history generating unit 204 stores the generated behavior history in the user information database.

[0097] When processing an authentication request received from the authentication terminal 30 installed in the office, the behavior history generation unit 204 determines that the authentication of the person to be authenticated is successful if the user identified by the matching process is an employee of the office where the authentication terminal 30 is installed. In this case, the behavior history generation unit 204 generates "attendance" as behavior information related to the identified user.

[0098] The authentication request received from the authentication terminal 30 installed in the store includes the biometric information and terminal ID of the person to be authenticated, as well as payment information (e.g., the name of the purchased product, the purchase amount) related to the product (service) purchased by the person to be authenticated. The behavior history generation unit 204 executes the payment process for the purchased product using the account information of the user identified by the matching process and the payment information included in the authentication request.

[0099] Specifically, the behavior history generation unit 204 requests a payment server of the financial institution or credit card company listed in the account information to settle the purchase price of the product included in the payment information. Upon receiving a response indicating "payment successful" from the payment server, the behavior history generation unit 204 transmits a notification of authentication success to the authentication terminal 30. In this case, the behavior history generation unit 204 generates the purchase of the product (service) included in the payment information as behavior information.

[0100] When an authentication request is received from the authentication terminal 30 installed in a facility such as a movie theater that requires a ticket for admission, the behavior history generation unit 204 transmits a successful authentication to the authentication terminal 30 if the user identified by the matching process has purchased a valid ticket. In this case, the behavior history generation unit 204 generates entry into the facility (for example, entry into a movie theater) as behavior information.

[0101] In this way, when the authentication of the person to be authenticated is successful, the behavior history generating unit 204 generates behavior information according to the type of authentication terminal 30 that sent the authentication request (or the installation location of the authentication terminal 30).

[0102] If the matching process fails or if the process corresponding to the terminal ID fails, the behavior history generation unit 204 sends an "authentication failed" to the authentication terminal 30. For example, if a resident of a building complex attempts to enter an office despite not being an office employee, an "authentication failed" message is sent to the authentication terminal 30.

[0103] In this way, the behavior history generation unit 204 acquires an authentication request including biometric information of the person to be authenticated acquired by the authentication terminal 30 installed in the building complex, and identifies the person to be authenticated by a matching process using the biometric information included in the authentication request and the biometric information stored in the user information database. The behavior history generation unit 204 generates behavior information of the person to be authenticated according to the type of authentication terminal 30 that sent the authentication request, and registers the generated behavior information in the user information database.

[0104] As described above, the behavioral history generation unit 204 may generate behavioral information using image data obtained from the camera device 20, or may generate behavioral information using image data captured by a camera provided in the authentication terminal 30.

[0105] The visitor notification control unit 205 generates preference information of a visitor who visits one facility in a complex building among multiple users based on the behavior history of the visitor. The visitor notification control unit 205 is a means for notifying a person working at the one facility (e.g., a store clerk) of the generated preference information.

[0106] That is, the visitor notification control unit 205 controls visitor notifications sent to store staff. The visitor notification control unit 205 processes image data captured by some of the camera devices 20 installed in the building complex.

[0107] Specifically, the visitor notification control unit 205 processes image data captured by the camera device 20, which is installed so as to be able to capture the entrance of the store. The visitor notification control unit 205 receives image data from the camera device 20, which is installed so as to be able to capture the entrance of the store. The visitor notification control unit 205 attempts to extract a face image from the image data.

[0108] When a facial image is extracted from the image data, the visitor notification control unit 205 generates features from the facial image. The visitor notification control unit 205 executes a matching process using the generated features and features registered in the user information database to identify the user who has visited the store.

[0109] The visitor notification control unit 205 analyzes the behavioral history of the identified user (customer) and generates preference information about the user. Specifically, the visitor notification control unit 205 generates the hobbies and interests of the customer as preference information based on the behavioral history.

[0110] The visitor notification control unit 205 can generate preference information using a learning model. For example, the learning model is generated by machine learning using training data in which labels (hobbies and interests inferred from behavioral information) are assigned to behavioral information. The visitor notification control unit 205 acquires preference information by inputting all or part of the behavioral information (behavioral history) of customers who visit the store into the generated learning model.

[0111] The learning model can be generated using any algorithm such as a support vector machine, boosting, neural network, etc. Since the algorithm such as the support vector machine can be a known technique, a description thereof will be omitted.

[0112] The visitor notification control unit 205 transmits a visitor notification including the generated preference information to the terminal 40 carried by a store clerk of the store where the customer has visited.

[0113] The visitor notification control unit 205 may notify the store clerk of the name, user type, etc. of the customer who has visited the store. The visitor notification control unit 205 may send a visitor notification including the name, user type, etc. of the customer who has visited the store to the terminal 40.

[0114] The server device 10 has a table that stores the camera ID of the camera device 20 installed so that it can capture the entrance of the store and the address (destination of the visitor notification) of the terminal 40 carried by the store staff. The visitor notification control unit 205 refers to the table and obtains the destination of the visitor notification from the camera ID.

[0115] The storage unit 206 is a means for storing information necessary for the operation of the server device 10. In the storage unit 206, a user information database is constructed.

[0116] The operation of the server device 10 can be summarized as shown in the flowchart of Fig. 16. Fig. 16 is a flowchart showing an example of the operation of the server device 10 according to the first embodiment.

[0117] The server device 10 generates behavioral information of the user by analyzing image data acquired from the camera device 20 or processing an authentication request received from the authentication terminal 30 (step S101). The server device 10 stores the generated behavioral information in a user information database, thereby generating a behavioral history of the user.

[0118] The server device 10 acquires image data from the camera device 20 installed in the store, and analyzes the image data to detect the customer's visit (step S102).

[0119] When detecting the visit of a customer to the store, the server device 10 generates preference information of the customer (user) who has visited the store (step S103). The server device 10 generates preference information based on the preferences and interests of the customer who has visited the store, using the behavior history of the customer.

[0120] The server device 10 transmits a visitor notification including the generated preference information to the terminal 40 carried by the store clerk (step S104). The store clerk who receives the visitor notification serves the customer while referring to the preference information.

[0121] [Camera equipment] Detailed description of the camera device 20 will be omitted. The camera device 20 photographs a predetermined area periodically or at a predetermined timing. The camera device 20 transmits image data obtained by photographing the predetermined area and a camera ID preset in the camera device 20 to the server device 10.

[0122] [Authentication terminal] 17 is a diagram showing an example of the processing configuration (processing modules) of the authentication terminal 30 according to the first embodiment. Referring to FIG. 17, the authentication terminal 30 includes a communication control unit 301, a biometric information acquisition unit 302, an authentication request unit 303, a function realization unit 304, and a storage unit 305.

[0123] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the server device 10. The communication control unit 301 also transmits data to the server device 10. The communication control unit 301 passes data received from other devices to other processing modules. The communication control unit 301 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0124] The biometric information acquisition unit 302 controls a camera mounted on the device and acquires biometric information (face image) of the person to be authenticated. The biometric information acquisition unit 302 captures an image of the area in front of the device periodically or at a predetermined timing. The biometric information acquisition unit 302 determines whether the acquired image contains a human face image, and if a face image is included, extracts the face image from the acquired image data.

[0125] The biometric information acquisition unit 302 passes the extracted face image to the authentication request unit 303 .

[0126] The authentication request unit 303 is a means for requesting authentication of the person to be authenticated from the server device 10. The authentication request unit 303 transmits an authentication request including at least the biometric information and terminal ID of the person to be authenticated (the user in front of the authentication terminal 30) to the server device 10.

[0127] The authentication request unit 303 receives the authentication result (authentication success, authentication failure) from the server device 10. The authentication request unit 303 passes the acquired authentication result to the function implementation unit 304.

[0128] The function realization unit 304 is a means for realizing the functions assigned to the authentication terminal 30. For example, the function realization unit 304 of the authentication terminal 30 installed in a home unlocks the door when it acquires a successful authentication result. The function realization unit 304 of the authentication terminal 30 installed in a home does not perform any particular operation when it acquires a failed authentication result.

[0129] Note that a detailed description of the function realization unit 304 will be omitted because the realization of the functions of the authentication terminal 30 by the function realization unit 304 is different from the gist of the disclosure of this application.

[0130] The storage unit 305 stores information necessary for the operation of the authentication terminal 30 .

[0131] [Device] The terminal 40 is a mobile terminal device such as a smartphone, a mobile phone, a game console, a tablet, etc. However, the terminal 40 is not limited to these examples. The terminal 40 can be any equipment or device that can accept user operations and communicate with the server device 10.

[0132] Explanation of the processing configuration etc. of the terminal 40 carried by users such as residents, employees, and customers will be omitted because the processing configuration etc. of the terminal 40 will be clear to those skilled in the art. Here, the processing configuration and operation of the terminal 40 carried by the store clerk will be explained.

[0133] Fig. 18 is a diagram showing an example of a processing configuration (processing modules) of the terminal 40 according to the first embodiment. Referring to Fig. 18, the terminal 40 includes a communication control unit 401, a visitor notification processing unit 402, and a storage unit 403. Note that Fig. 18 does not show processing modules for continuous user registration and the like.

[0134] The communication control unit 401 is a means for controlling communication with other devices. For example, the communication control unit 401 receives data (packets) from the server device 10. The communication control unit 401 also transmits data to the server device 10. The communication control unit 401 passes data received from other devices to other processing modules. The communication control unit 401 transmits data acquired from other processing modules to other devices. In this way, other processing modules transmit and receive data to and from other devices via the communication control unit 401. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

[0135] The visitor notification processing unit 402 is a means for processing the visitor notification received from the server device 10. The visitor notification processing unit 402 displays a display as shown in Fig. 19 based on the received visitor notification. As shown in Fig. 19, the visitor notification processing unit 402 presents the face photo of the visiting customer, preference information of the visiting customer, etc. to the store clerk. The store clerk will provide service according to the presented preference information, etc.

[0136] The storage unit 403 is a means for storing information necessary for the operation of the terminal 40 .

[0137] [System Operation] Next, the operation of the information processing system according to the first embodiment will be described. Note that a description of operations related to continued user registration, etc. will be omitted. Fig. 20 is a sequence diagram showing an example of the operation of the information processing system according to the first embodiment.

[0138] The server device 10 identifies a customer who has visited the store using image data obtained from the camera device 20 installed in the store (step S01).

[0139] The server device 10 generates preference information of the identified user based on the behavior history of the user (step S02).

[0140] The server device 10 transmits a visitor notification including the generated preference information to the terminal 40 carried by the store clerk (step S03).

[0141] The terminal 40 displays the preference information contained in the received customer notification, and presents the preferences, interests, etc. of the customer who has visited the store to the store staff (step S04).

[0142] Next, a modification of the first embodiment will be described.

[0143] <Variation 1> The server device 10 may provide the store clerk with an interface that enables the store clerk to select users to whom visitor notifications are to be sent.

[0144] For example, a store clerk operates terminal 40 to access server device 10. When the store clerk performs a predetermined operation on the portal site, visitor notification control unit 205 of server device 10 displays a GUI on terminal 40 that allows the store clerk to select a user to whom a visitor notification is to be sent.

[0145] For example, the visitor notification control unit 205 acquires information about a customer to whom a visitor notification is to be sent using a GUI such as that shown in Fig. 21. The visitor notification control unit 205 identifies a user registered in the user information database based on the acquired customer information (e.g., name). The visitor notification control unit 205 stores the user ID of the identified user (identified entry) in association with the store information of the store clerk who selected the visitor notification to be sent.

[0146] For example, the visitor notification control unit 205 stores in a table the camera ID of the camera device 20 (a camera device 20 installed so that it can photograph the entrance to the store) installed in the store that selected the visitor notification recipient, in association with the user ID of the customer selected by the store clerk.

[0147] When the visitor notification control unit 205 receives image data from the camera device 20, it acquires at least one or more user IDs stored in association with the camera ID of the camera device 20. The visitor notification control unit 205 sets the users registered in the user information database who correspond to the at least one or more user IDs as the registered users, and executes a matching process.

[0148] If the user selected by the store clerk visits the store, the above-mentioned verification process is successful. In this case, the visitor notification control unit 205 generates preference information for the user identified by the verification process and sends a visitor notification to the terminal 40 carried by the store clerk.

[0149] If a user other than the one selected by the store clerk comes to the store, the above-mentioned verification process will fail. In this case, the visitor notification control unit 205 will not perform any special process. In other words, the visitor notification will not be sent to the terminal 40 carried by the store clerk.

[0150] By having a store clerk select the recipient of the visitor notification, the clerk is reliably notified that an important customer (a VIP (Very Important Person) for the store) has visited the store. In addition, the server device 10 notifies each clerk of the same customer's preference information. This configuration prevents inconsistencies in customer service depending on the store clerk.

[0151] In this way, when a pre-designated person among multiple users visits the store, the visitor notification control unit 205 generates preference information for the pre-designated person. The visitor notification control unit 205 notifies the store clerk of the preference information of the pre-designated person.

[0152] <Variation 2> The server device 10 may automatically select a destination for sending the visitor notification. For example, the visitor notification control unit 205 may determine whether or not to send the visitor notification based on the user type of the user who has visited the store.

[0153] For example, if the visiting user is a "resident," the visitor notification control unit 205 may send a visitor notification to the terminal 40 of a store clerk. This is because if the user is a resident of a complex building, sufficient behavioral information has been collected, and it is expected that highly accurate preference information will be generated. On the other hand, if the visiting user is a "non-member user," the visitor notification control unit 205 may not need to send a visitor notification to the terminal 40. This is because in this case, sufficient behavioral information has not been collected.

[0154] Alternatively, visitor notification control unit 205 may determine whether or not to send a visitor notification based on attribute information (e.g., age, gender, etc.) of a customer who has visited the store (a customer who has entered the store). For example, if a man visits a store that mainly sells products for women, visitor notification control unit 205 may not need to send a visitor notification regarding the man.

[0155] Alternatively, the visitor notification control unit 205 may determine whether or not to send a visitor notification based on information about the workplace of the visiting user. Specifically, if the visiting user is an employee of the store, the visitor notification control unit 205 may not need to send a visitor notification. If the entrance for customers and the entrance for store staff are the same, it is not necessary to send a visitor notification to the store staff terminal 40 every time an employee enters or exits.

[0156] In this way, the visitor notification control unit 205 may determine whether to notify the store clerk of the preference information based on the type of visitor who visited the store, attribute information, or workplace information. By making such a determination, it is possible to prevent a visitor notification that is meaningless to the store clerk from being sent to the store clerk.

[0157] The visitor notification control unit 205 may determine whether or not to send a visitor notification based on preference information generated according to the user's behavioral history. For example, the visitor notification control unit 205 may not send a visitor notification if preference information closely related to the business type, etc., of the store visited by the user has not been obtained. For example, if only food preference information has been obtained for a user who visited a store that sells brand-name goods, the visitor notification control unit 205 will not send a visitor notification for that user. In this way, the visitor notification control unit 205 may not send a visitor notification for a user for whom preference information matching the business type, etc., of the store has not been obtained.

[0158] Alternatively, the visitor notification control unit 205 may transmit a visitor notification to the store clerk terminal 40 when a user who has visited at least one specific store visits the store. For example, the visitor notification control unit 205 may be configured to transmit a visitor notification when a user who has visited another store (e.g., another store in the same business as the store or an affiliated store of the same chain as the store) visits the store. The server device 10 may also provide an interface that enables each store to specify another store (the specific store) from which it wants to receive a visitor notification. Alternatively, the visitor notification control unit 205 may transmit a visitor notification to the store clerk terminal 40 when a user who has stayed at another store (the specific store) for a predetermined time or more visits the store. For example, a visitor notification may be transmitted only when a user who has stayed at another store for 30 minutes or more visits the store. Alternatively, the visitor notification control unit 205 may transmit a visitor notification to the store clerk terminal 40 when a user who has purchased a product at another store visits the store. Alternatively, the visitor notification control unit 205 may send a visitor notification to the store clerk's terminal 40 when a user who has only visited another store but has not purchased any products visits the store.

[0159] In this way, the visitor notification control unit 205 notifies store staff of a user's visit when the user visits a competitor's store or an affiliated store of the store, or when the user stays at the competitor's store for a predetermined period of time or more. Alternatively, the visitor notification control unit 205 notifies store staff of the user's visit based on the user's purchase history and purchase details at competitor's stores or affiliated stores of the store. In other words, if visitor notifications were sent to the store clerk's terminal 40 for every visitor who visits the store, the clerk would often allocate time to users who do not contribute to sales, which would be inefficient. Therefore, the visitor notification control unit 205 notifies store clerks of the visit of only users who are likely to contribute to sales, using the user's behavioral history (store visit history, product purchase history, store stay time, etc.). As a result, store clerks can provide efficient customer service.

[0160] <Variation 3> The server device 10 may change the method of generating the behavior history depending on the type of user (continuing user, member user, non-member user) who uses the building complex.

[0161] For example, if the behavioral history generation unit 204 of the server device 10 fails in a matching process using biometric information obtained from image data, the behavioral history generation unit 204 will not generate behavioral information for the user (non-member user) who failed the matching process. General users, especially non-member users, rarely visit the complex, making it difficult for the server device 10 to obtain the behavioral information necessary to generate highly accurate preference information. Therefore, the server device 10 gives up on collecting behavioral information for non-member users.

[0162] In contrast, continuing users and member users who have registered with the system frequently visit the building complex. Taking this fact into consideration, the server device 10 (behavior history generation unit 204) may generate behavior information and behavior history only for continuing users and member users who are likely to be able to generate highly accurate preference information.

[0163] Alternatively, the server device 10 may determine whether to store behavioral information depending on the type of user. For example, the server device 10 constantly tracks the behavior of each user from the time they enter the building complex and generates detailed behavioral information. Thereafter, the server device 10 stores the generated detailed behavioral information and generates a behavior history for residents of the building complex. On the other hand, for workers and member users, the server device 10 stores behavioral information at predetermined spots from the detailed behavioral information (many pieces of behavioral information) as a behavior history. In other words, the server device 10 stores rough behavioral information for workers as a behavior history.

[0164] When generating preference information, detailed behavioral information is also collected for residents, so the server device 10 can provide highly accurate preference information to store clerks. In contrast, since only rough behavioral information is collected for workers, the accuracy of the preference information provided is lower than that of residents.

[0165] Here, residents are likely to live in the building complex for a long time, and therefore can be said to be the most important customers for a store. Therefore, the server device 10 closely monitors the behavior of the residents so as to enable stores to provide highly accurate preference information about the residents. In contrast, although workers may leave the building complex due to job changes or other reasons, they generally visit the building complex repeatedly, and therefore are undoubtedly the second most important customers after residents for stores operating in the building complex. Therefore, the server device 10 treats workers in the same way as residents. On the other hand, users who have not registered as members are determined to be unlikely to visit the building complex again, and the server device 10 does not collect behavioral information about those users. In this way, by selecting the behavioral information to be accumulated depending on the type of user, the limited resources of the server device 10 are effectively utilized.

[0166] As described above, the information processing system according to the first embodiment generates a behavioral history of users of a complex building. The behavioral history includes not only the purchase history of products and the like at stores, but also information such as whether the user stayed in the same facility for a predetermined period of time even if they did not purchase a product. The preference information generated based on such behavioral history accurately reflects the user's tastes and interests. The server device 10 notifies the store staff of the preference information of users who visited the store, enabling the staff to provide high-level customer service.

[0167] Furthermore, as in the first modification example of the first embodiment, a store clerk can specify customers who will be the target of visitor notifications. That is, the store clerk can set up to receive visitor notifications when a VIP (VIP) visits the store. As a result, when a VIP visits the store, the VIP's visit is detected by passive authentication, and the VIP's preference information is notified to the clerk. The clerk then provides customer service (such as product suggestions) according to the VIP's preferences and interests. Furthermore, because the same preference information is notified to both veteran and new clerks, there is less variation in the customer service provided by the clerk.

[0168] Furthermore, for users of the building complex who use the building on a daily basis or who have registered as members, services are available to enable them to use the building complex more comfortably. Specifically, these users are provided with a service that allows them to purchase tickets online. Users can purchase tickets online and enter facilities such as movie theaters through active authentication using pre-registered biometric information. Users can also use facial payment using pre-registered facial information. In this way, the information processing system according to the first embodiment generates a user's behavioral history by linking cyber (web) information with real-world information (information generated by biometric authentication when the user actually visits a store, etc.).

[0169] Next, the hardware of each device constituting the information processing system will be described. Fig. 22 is a diagram showing an example of the hardware configuration of the server device 10.

[0170] The server device 10 can be configured by an information processing device (so-called computer), and has the configuration exemplified in Fig. 22. For example, the server device 10 includes a processor 311, a memory 312, an input / output interface 313, and a communication interface 314. The components such as the processor 311 are connected by an internal bus or the like, and are configured to be able to communicate with each other.

[0171] However, the configuration shown in Fig. 22 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not include the input / output interface 313 as necessary. Furthermore, the number of processors 311 and the like included in the server device 10 is not intended to be limited to the example shown in Fig. 22, and for example, the server device 10 may include multiple processors 311.

[0172] The processor 311 is a programmable device such as a central processing unit (CPU), a micro processing unit (MPU), or a digital signal processor (DSP). Alternatively, the processor 311 may be a device such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The processor 311 executes various programs including an operating system (OS).

[0173] The memory 312 is a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a solid state drive (SSD), etc. The memory 312 stores an OS program, application programs, and various data.

[0174] The input / output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user operations such as a keyboard or a mouse.

[0175] The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a network interface card (NIC).

[0176] The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. That is, the present invention can also be embodied as a computer program product. The program can be downloaded via a network or updated using a storage medium storing the program. The processing modules can also be realized by semiconductor chips.

[0177] The authentication terminal 30, terminal 40, etc. can also be configured using information processing devices similar to the server device 10, and their basic hardware configurations are not described here because they are no different from the server device 10. For example, the authentication terminal 30 may be provided with a camera device for photographing the person to be authenticated.

[0178] The server device 10, which is an information processing device, is equipped with a computer, and functions of the server device 10 can be realized by causing the computer to execute a program. The server device 10 also executes a control method for the server device 10 by the program.

[0179] [Variations] The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

[0180] In the above embodiment, the case where the user himself / herself registers as a member has been described. However, a third party other than the user may register as a member on behalf of the user. For example, a store clerk may register the VIP as a member on behalf of the VIP. More specifically, the face image of the VIP may also be registered when selecting the target person for visitor notification as shown in FIG. 21.

[0181] In the above embodiment, a case has been described in which a behavior history is generated based on the actual behavior of a user in a complex building. However, a user's behavior history may also be generated using cyber data (data on a network). For example, the user's terminal 40 may notify the server device 10 of the user's terminal operation log, etc., and the server device 10 may generate a behavior history based on the notified operation log, etc. For example, a search result by the user may be stored as the behavior history. By generating user preference information based on the behavior history generated in this manner, the user's preferences, etc. can be more accurately understood.

[0182] The server device 10 may transmit a visitor notification including not only preference information but also behavioral history to the terminal 40 carried by the store clerk. For example, the server device 10 may extract behavioral history (e.g., purchase history) related to the store visited by the user from the user database, and transmit a visitor notification including the extracted purchase history and preference information to the terminal 40. In this case, the terminal 40 displays a screen as shown in FIG. 23. A store clerk who sees a screen as shown in FIG. 23 can provide the customer with a service that will provide the customer with a higher level of satisfaction.

[0183] The server device 10 may generate recommendation information based on the user's behavioral history. For example, the server device 10 may generate recommendation information that recommends the purchase of products that suit the user's lifestyle, using the user's office attendance history, return home information, etc. The generated recommendation information is transmitted to the user's terminal 40.

[0184] In the above embodiment, the case where the user information database is configured inside the server device 10 has been described, but the database may also be configured on an external database server or the like. That is, some of the functions of the server device 10 may be implemented on another server. More specifically, the above-described "behavior history generation unit (behavior history generation means)," "visitor notification control unit (visitor notification control means)," etc. may be implemented on any of the devices included in the system.

[0185] The server device 10 may verify the identity of a user when registering a continuing user or a member. Specifically, the server device 10 acquires the user's biometric information, personal information, etc., as well as an identification document (e.g., a passport, a driver's license, etc.) containing the biometric information. The server device 10 performs one-to-one matching using the biometric information on the identification document and the biometric information acquired from the user. If the matching is successful, the server device 10 may perform member registration, etc.

[0186] In the above embodiment, the feature quantities generated from a facial image are stored in the user information database, but the feature quantities do not have to be stored in the database. Instead of feature quantities, a facial image may be registered in the user information database, and the server device 10 may generate feature quantities from the registered facial image each time it processes an authentication request.

[0187] The form of data transmission and reception between the devices (server device 10, authentication terminal 30) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Biometric information and the like is transmitted and received between these devices, and in order to appropriately protect this information, it is desirable to transmit and receive encrypted data.

[0188] In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are described in order, but the execution order of the steps executed in the embodiments is not limited to the order described. In the embodiments, the order of the illustrated steps can be changed to the extent that the content is not affected, such as by executing each process in parallel.

[0189] The above-described embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the above-described configurations are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

[0190] From the above explanation, it is clear that the present invention has industrial applicability, and the present invention can be suitably applied to an information processing system that authenticates users who visit a complex building.

[0191] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. [Appendix 1] A generation means for generating a behavior history of each of a plurality of users within an area including a plurality of facilities; a notification control means for generating preference information of a visitor who has visited a facility in the area among the plurality of users based on the behavior history of the visitor, and notifying a person working at the facility of the generated preference information; A server device comprising: [Appendix 2] a user information database that stores biometric information of each of the plurality of users; The server device described in Appendix 1, wherein the generation means identifies the person appearing in the image data by performing a matching process using the biometric information of the person appearing in the image data acquired from a camera device installed within the area and the biometric information stored in the user information database, generates behavioral information of the identified person based on the installation location of the camera device, and registers the generated behavioral information in the user information database. [Appendix 3] The server device described in Appendix 2, wherein the generation means acquires an authentication request including biometric information of the person to be authenticated acquired by an authentication terminal installed within the area, identifies the person to be authenticated by a matching process using the biometric information included in the authentication request and the biometric information stored in the user information database, generates behavioral information of the person to be authenticated according to the type of authentication terminal that sent the authentication request, and registers the generated behavioral information in the user information database. [Appendix 4] The server device described in Appendix 3, wherein the notification control means generates preference information for a pre-designated person among the plurality of users when the pre-designated person visits the facility, and notifies a person working at the facility of the preference information for the pre-designated person. [Appendix 5] the user information database stores the type of each of the plurality of users; The server device according to claim 4, wherein the notification control means determines whether or not to notify a person working at the facility of the preference information depending on the type of visitor who has visited the facility. [Appendix 6] the user information database stores attribute information of each of the plurality of users; The server device according to claim 5, wherein the notification control means determines whether or not to notify a person working at the facility of the preference information based on attribute information of a visitor who has visited the facility. [Appendix 7] the user information database stores information on the workplace of each of the plurality of users; The server device according to claim 6, wherein the notification control means does not notify a person working at the facility of the preference information if the visitor to the facility is an employee of the facility. [Appendix 8] The server device according to claim 7, wherein the notification control means transmits a visitor notification including the generated preference information to a terminal carried by a person working at the facility. [Appendix 9] The server device according to claim 8, wherein the generation means changes a method for generating a behavior history depending on the type of each of the plurality of users. [Appendix 10] 10. The server device according to any one of claims 1 to 9, wherein the area including the plurality of facilities is a complex building. [Appendix 11] The server device according to any one of Supplementary Notes 2 to 9, wherein the biometric information is a face image or a feature amount generated from the face image. [Appendix 12] A terminal and a server device; Including, The server device A generation means for generating a behavior history of each of a plurality of users within an area including a plurality of facilities; a notification control means for generating preference information of a visitor who has visited a facility in the area among the plurality of users based on the behavior history of the visitor, and transmitting the generated preference information to a terminal carried by a person working at the facility; A system comprising: [Appendix 13] In the server device, Generate a behavioral history of each of a plurality of users within an area including a plurality of facilities; A control method for a server device that generates preference information for a visitor who visits a facility within the area among the plurality of users based on the behavioral history of the visitor, and notifies a person working at the facility of the generated preference information. [Appendix 14] The computer installed in the server device A process of generating a behavior history of each of a plurality of users within an area including a plurality of facilities; generating preference information of a visitor who has visited one facility in the area based on the behavior history of the visitor among the plurality of users, and notifying a person working at the facility of the generated preference information; A computer-readable storage medium that stores a program for executing the above.

[0192] The disclosures of the above-cited prior art documents are incorporated herein by reference. Although the embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the claims, and the technical concepts thereof. [Explanation of symbols]

[0193] 10 Server device 20 Camera equipment 20-1 Camera equipment 20-2 Camera equipment 20-3 Camera equipment 20-4 Camera equipment 20-5 Camera equipment 30 Authentication Terminal 30-1 Authentication terminal 30-2 Authentication terminal 30-3 Authentication terminal 30-4 Authentication terminal 30-5 Authentication terminal 30-6 Authentication terminal 30-7 Authentication terminal 30-8 Authentication Terminal 40 terminals 100 Server device 101 Generation means 102 Notification Control Means 201 Communication control unit 202 Information Registration Department 203 Online Service Control Section 204 Behavioral History Generation Unit 205 Visitor notification control unit 206 Memory section 301 Communication Control Unit 302 Biometric information acquisition unit 303 Authentication Request Section 304 Functionality Realization Department 305 Storage section 311 processor 312 memory 313 Input / Output Interface 314 Communication Interface 401 Communication control unit 402 Visitor notification processing unit 403 Storage section

Claims

1. A generation means for generating a behavior history of each of a plurality of users within an area including a plurality of facilities; a notification control means for generating preference information of a visitor who has visited a facility in the area among the plurality of users based on the behavior history of the visitor, and notifying a person working at the facility of the generated preference information; a user information database that stores biometric information and workplace information of each of the plurality of users; Equipped with the generation means identifies the person appearing in the image data by a matching process using biometric information of the person appearing in the image data acquired from a camera device installed within the area and the biometric information stored in the user information database, generates behavioral information of the identified person based on the installation location of the camera device, and registers the generated behavioral information in the user information database; The notification control means is configured to not notify a person working at the facility of the preference information if the visitor to the facility is an employee of the facility.

2. 2. The server device according to claim 1, wherein the generation means acquires an authentication request including biometric information of the person to be authenticated acquired by an authentication terminal installed within the area, identifies the person to be authenticated by a matching process using the biometric information included in the authentication request and the biometric information stored in the user information database, generates behavioral information of the person to be authenticated according to the type of authentication terminal that sent the authentication request, and registers the generated behavioral information in the user information database.

3. The server device according to claim 2, wherein the notification control means generates preference information for a pre-designated person among the plurality of users when the pre-designated person visits the facility, and notifies a person working at the facility of the preference information for the pre-designated person.

4. the user information database stores the type of each of the plurality of users; 4. The server device according to claim 3, wherein the notification control means determines whether or not to notify a person working at the facility of the preference information depending on the type of visitor who has visited the facility.

5. the user information database stores attribute information of each of the plurality of users; The server device according to claim 4 , wherein the notification control means determines whether or not to notify a person working at the facility of the preference information, depending on attribute information of a visitor who has visited the facility.

6. A terminal and a server device; Including, The server device A generation means for generating a behavior history of each of a plurality of users within an area including a plurality of facilities; a notification control means for generating preference information of a visitor who has visited a facility in the area among the plurality of users based on the behavior history of the visitor, and transmitting the generated preference information to a terminal carried by a person working at the facility; a user information database that stores biometric information and workplace information of each of the plurality of users; Equipped with the generation means identifies the person appearing in the image data by a matching process using biometric information of the person appearing in the image data acquired from a camera device installed within the area and the biometric information stored in the user information database, generates behavioral information of the identified person based on the installation location of the camera device, and registers the generated behavioral information in the user information database; The system is such that, if a visitor to the facility is an employee of the facility, the notification control means does not send the preference information to a terminal carried by a person working at the facility.

7. A server device having a user information database that stores biometric information and workplace information for each of a plurality of users, generating a behavior history of each of the plurality of users within an area including the plurality of facilities; A control method for a server device, the method comprising: generating preference information of a visitor who has visited a facility in the area among the plurality of users, based on the behavior history of the visitor; and notifying a person working at the facility of the generated preference information, the method comprising: Identifying the person appearing in the image data by performing a matching process using biometric information of the person appearing in the image data acquired from a camera device installed within the area and the biometric information stored in the user information database, generating behavioral information of the identified person based on the installation location of the camera device, and registering the generated behavioral information in the user information database; A server device control method for not notifying a person working at the facility of the preference information when the visitor who visits the facility is an employee of the facility.

8. A computer installed in a server device having a user information database that stores biometric information and workplace information for each of a plurality of users, A process of generating a behavior history of each of the plurality of users within an area including the plurality of facilities; generating preference information of a visitor who has visited one facility in the area based on the behavior history of the visitor among the plurality of users, and notifying a person working at the facility of the generated preference information; A program for executing The computer, identifying a person appearing in image data acquired from a camera device installed within the area by a matching process using biometric information of the person appearing in the image data and biometric information stored in the user information database, generating behavioral information of the identified person based on the installation location of the camera device, and registering the generated behavioral information in the user information database; The program includes a process of notifying a person working at the facility of the generated preference information, wherein if a visitor who visits the facility is an employee of the facility, the preference information is not notified to the person working at the facility.

Images