Information processing device, information processing system, information processing method and program

Abstract

An information processing device (10) according to the present invention comprises: a contract identification unit (11) that identifies a contract associated with a user vehicle upon acquiring information about the state of the user vehicle and user position information from a user terminal used by a user; a selection unit (12) that selects, on the basis of the user position information and information about contracted shops which are shops that are party to the contract, at least one shop from among shops that are capable of performing maintenance corresponding to the state as a recommended shop; and an output control unit (16) that outputs information about the recommended shop to the user terminal.

Description

[Technical Field]

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium, and more particularly to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that recommend stores. [Background technology]

[0002] In recent years, technologies for providing personalized service information to customers have been developed. For example, Patent Document 1 describes a service provision system that determines service content for a customer based on customer information identified based on biometric features and product information. Furthermore, Patent Document 2, for example, describes a service provision system that provides services according to an object related to a captured image, in which service information based on a combination of a recognized object (such as a vehicle) and a recognized person is read out and output. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-236417 [Patent Document 2] Japanese Patent Application Publication No. 2018-110023 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, vehicle manufacturers have expanded their group-wide operations beyond just selling the vehicles they manufacture to include vehicle maintenance and inspection, service stations, and other businesses. In order to increase the profits of the entire group, vehicle manufacturers have a need to increase the number of points of contact with users after they purchase a vehicle. However, while users often purchase vehicles from the vehicle manufacturer's dealership, they often outsource subsequent vehicle inspections and repairs in the event of a malfunction to businesses other than the vehicle manufacturer. The above-mentioned issues apply not only to vehicle manufacturers, but also to other stores that have previously done business with the user regarding the user's vehicle.

[0005] In view of the above-mentioned problems, the object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that effectively encourage users to use affiliated groups or partner groups of stores with which they have a transaction history related to a vehicle. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present disclosure includes: a contract identification means for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from a user terminal used by the user; a selection means for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control means for outputting information related to the recommended store to the user terminal; Equipped with.

[0007] An information processing system according to one aspect of the present disclosure includes: an information processing device; The user terminal used by the user Equipped with The information processing device includes: a contract identification means for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from the user terminal; a selection means for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control means for outputting information related to the recommended store to the user terminal; It has.

[0008] An information processing method according to one aspect of the present disclosure includes: When information regarding the status of the user's vehicle and location information of the user are acquired from a user terminal used by the user, a contract related to the user's vehicle is identified; Selecting at least one store that can perform maintenance corresponding to the condition as a recommended store based on information about the contract store that is the store with which the contract has been made and location information of the user; Information relating to the recommended store is output to the user terminal.

[0009] According to one aspect of the present disclosure, there is provided a non-transitory computer-readable medium comprising: a contract identification process for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from a user terminal used by the user; a selection process for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control process for outputting information related to the recommended store to the user terminal; It stores programs to be executed by a computer. [Effects of the Invention]

[0010] The present disclosure makes it possible to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that suitably encourage users to use affiliated groups or affiliated groups of stores with which they have a transaction history related to a vehicle. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to a first embodiment. [Figure 2] 1 is a flowchart showing the flow of an information processing method according to the first embodiment. [Figure 3] FIG. 10 is a block diagram showing the overall configuration of an information processing system according to a second embodiment. [Figure 4] FIG. 10 is a block diagram showing the configuration of a face authentication device according to a second embodiment. [Figure 5] 10 is a flowchart showing the flow of face information registration processing according to the second embodiment. [Figure 6] 10 is a flowchart showing the flow of face authentication processing according to the second embodiment. [Figure 7] FIG. 10 is a block diagram showing the configuration of a user terminal according to the second embodiment. [Figure 8] FIG. 10 is a block diagram showing the configuration of a store terminal according to a second embodiment. [Figure 9] FIG. 10 is a block diagram showing the configuration of a server according to a second embodiment. [Figure 10] FIG. 10 is a diagram for explaining an example of relationship information according to the second embodiment. [Figure 11] FIG. 10 is a diagram illustrating an example of a data structure of a usage history DB according to the second embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of a member registration process according to the second embodiment. [Figure 13] FIG. 10 is a diagram illustrating an example of a display on a user terminal according to the second embodiment. [Figure 14] FIG. 10 is a sequence diagram showing the flow of information provision processing according to the second embodiment. [Figure 15]FIG. 10 is a sequence diagram showing the flow of a usage history registration process according to the second embodiment. [Figure 16] FIG. 10 is a diagram for explaining a purchase cycle according to the second embodiment. [Figure 17] FIG. 10 is a diagram showing an example of a display of a store terminal according to the second embodiment. [Figure 18] FIG. 10 is a block diagram showing the configuration of a server according to a third embodiment. [Figure 19] FIG. 11 is a sequence diagram showing the flow of opportunity loss calculation processing according to the third embodiment. [Figure 20] FIG. 10 is a block diagram showing the configuration of a server according to a fourth embodiment. [Figure 21] FIG. 11 is a sequence diagram showing the flow of information provision processing according to the fourth embodiment. [Figure 22] FIG. 13 is a diagram showing an example of a display of a store terminal according to the fourth embodiment. [Figure 23] FIG. 10 is a block diagram showing the configuration of a server according to a fifth embodiment. [Figure 24] FIG. 13 is a diagram illustrating an example of a data structure of contract information according to the fifth embodiment. [Figure 25] FIG. 13 is a sequence diagram showing the flow of information provision processing according to the fifth embodiment. [Figure 26] FIG. 13 is a diagram showing an example of a display on a user terminal according to the fifth embodiment. [Figure 27] FIG. 13 is a sequence diagram showing the flow of information sharing processing according to the fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0013] In the following, the following terms are defined as follows: "User information" is information related to a user. "User information" includes at least one of user attribute information and information indicating the user's preferences. "User information" may also include the user's usage history in addition to or instead of the above information. The "usage history" is information indicating that the user has used any of a plurality of predetermined stores. The usage history includes a payment history. The "relationship information" indicates the business relationship between the stores. "Having a business relationship" may indicate, for example, whether the stores belong to the same affiliated group, or whether the stores or their affiliated groups are in a business or capital partnership relationship. "Sales promotion information" may include basic information about the store, information about products or services offered at the store, or campaign information or preferential treatment information for the products or services. "Maintenance" is used as a term that includes preparation, inspection, repair, or replacement. "Personal identification information" is information that identifies the user. "Personal identification information" is a facial image or facial feature information of the user, or a user ID that identifies the user. "Information about the vehicle status" may also be referred to as vehicle status information, and may indicate, for example, that a particular part of the vehicle has broken down, that a particular function has stopped working, or that a particular function is not functioning properly. "User location information" may be location information of the user terminal, location information of a wearable terminal connected to the user terminal and worn on the user's body, or location information of the user's vehicle. A "vehicle-related contract" is a contract for vehicle services. A "vehicle-related contract" may include a vehicle purchase contract, a vehicle rental or lease contract, a vehicle maintenance contract, or preferential information associated with various contracts. "Vehicle services" are services related to vehicles. For example, "vehicle services" are services related to vehicle inspection, insurance, maintenance, sales, car sharing, or rental cars. The "contract store" is a store that has entered into a contract with the user. For example, the "contract store" may include a store where the user purchased, rented, or leased a vehicle. "Using (a product or service)" means purchasing a product or service.

[0014] <Embodiment 1> First, a first embodiment of the present disclosure will be described. FIG. 1 is a block diagram showing a configuration of an information processing device 10 according to the first embodiment. The information processing device 10 is a computer device that recommends one or more stores to a user. The information processing device 10 is connected to a network (not shown). The network may be wired or wireless. A user terminal (not shown) used by a user may be connected to the network.

[0015] The information processing device 10 includes a contract specifying unit 11, a selecting unit 12, and an output control unit 16.

[0016] The contract identification unit 11 is also called a contract identification means. When the contract identification unit 11 acquires information about the state of the user's vehicle (vehicle state information) and the user's location information from the user terminal, the contract identification unit 11 identifies a contract related to the user's vehicle. For example, the contract identification unit 11 further acquires personal identification information from the user terminal, identifies the user based on the personal identification information, and identifies the user's contract.

[0017] The selection unit 12 is also called a selection means. The selection unit 12 selects, as a recommended store, at least one store that can perform maintenance corresponding to the condition, based on information about the contract store, which is the store with which the contract has been made, and the user's location information.

[0018] The output control unit 16 is also called output control means. The output control unit 16 outputs information related to the recommended store selected by the selection unit 12 to the user terminal. For example, the output control unit 16 may transmit information related to the recommended store to the user terminal and output (display) it on the user terminal. Information related to the recommended store includes basic information and promotional information about the recommended store.

[0019] FIG. 2 is a flowchart showing the flow of the information processing method according to the first embodiment. First, the information processing device 10 acquires information about the condition of the user's vehicle and the user's location information from the user terminal (S10). Next, the contract identification unit 11 of the information processing device 10 identifies the user and identifies a contract related to the user's vehicle (S11). Next, the selection unit 12 of the information processing device 10 selects at least one store that can perform maintenance corresponding to the condition as a recommended store based on the contract store of the identified contract and the user's location information (S12). Finally, the output control unit 16 of the information processing device 10 outputs information related to the recommended store to the user terminal (S13).

[0020] As described above, according to the first embodiment, when a user's vehicle needs maintenance, the information processing device 10 can encourage the user to have the maintenance done at a store that is related to the contracted store and is close to the user. Therefore, the user can be encouraged to use a store affiliated with or affiliated to a store with which the user has a transaction history while ensuring user convenience. Therefore, the user can be effectively retained as a customer.

[0021] <Embodiment 2> Next, a second embodiment of the present disclosure will be described. Fig. 3 is a block diagram showing the overall configuration of an information processing system 1000 according to the second embodiment. The information processing system 1000 is a computer system that provides a user with promotional information about one or more stores. In the second embodiment, the information processing system 1000 provides a user with promotional information about a store that has a business relationship with a first store that the user has visited, in order to encourage the user to visit the store.

[0022] The information processing system 1000 includes a face authentication device 100, an information processing device (hereinafter referred to as a server) 200, a user terminal 300, and one or more store terminals 400. The devices and terminals are connected to each other via a network N. The network N is a wired or wireless communication line.

[0023] The user terminal 300 is an information terminal used by a user.

[0024] The store terminal 400 is an information terminal installed in each of a plurality of stores that provide in-store services or a terminal used by a manager of each store. The in-store service is a service in which a user visits a store to receive the service, and examples thereof may include cosmetics sales, vehicle sales, or vehicle maintenance services. The store terminal 400 accepts face authentication for a user who visits the store and uses in-store services, and if face authentication is successful, provides promotional information tailored to the user from its own store or other stores. In the second embodiment, the store terminal 400 photographs at least the face of the user who is the subject of face authentication, and transmits the face image (hereinafter, sometimes referred to as a photographed image) to the server 200. Face authentication is performed in the server 200 and the face authentication device 100 via the store terminal 400. The store terminal 400 also transmits a usage history relating to face payment for use of in-store services to the server 200, and causes the server 200 to accumulate the user's usage history.

[0025] The face authentication device 100 is an example of a biometric authentication device, and is a computer device that stores facial feature information of multiple people. The face authentication device 100 also has a face authentication function that, in response to a face authentication request received from an external device, matches the facial image or facial feature information included in the request with the facial feature information of each user. In the second embodiment, the face authentication device 100 registers the facial feature information of a user during membership registration, which will be described later. The face authentication device 100 then acquires a facial image of a user who has visited the first store from the store terminal 400 of the first store via the server 200, and performs face authentication using the facial image. The face authentication device 100 then returns the matching result (face authentication result) to the server 200.

[0026] The server 200 is a computer device that provides the store terminal 400 with promotional information for one or more stores selected by the user. First, the server 200 registers the user as a member in response to a member registration request from the user terminal 300. Then, when the server 200 receives an information provision request or a facial payment request from the store terminal 400, it executes processing in response to the request and according to the user. The request includes a facial image or facial feature information of the user who visited the first store. When the server 200 receives the request, it extracts the user's facial image or facial feature information from the request and requests the face authentication device 100 to perform facial authentication on the face area. For example, when an information provision request is received, the server 200 transmits promotional information for one or more stores according to the user identified by facial authentication to the store terminal 400 and displays it.

[0027] The server 200 also collects the usage history relating to face payment from the store terminal 400 of each store and stores it in a usage history database (DB).

[0028] FIG. 4 is a block diagram showing the configuration of a face authentication device 100 according to a second embodiment. The face authentication device 100 includes a face information database (DB) 110, a face detection unit 120, a feature point extraction unit 130, a registration unit 140, and an authentication unit 150. The face information DB 110 stores a user ID 111 and facial feature information 112 corresponding to the user ID in association with each other. The user ID 111 is information for identifying a user, such as an identification number. The facial feature information 112 is a collection of feature points extracted from a face image and is an example of facial information. The face authentication device 100 may delete the facial feature information 112 from the facial feature DB 110 in response to a request from a registered user of the facial feature information 112. Alternatively, the face authentication device 100 may delete the facial feature information 112 after a certain period of time has elapsed since the registration of the facial feature information 112.

[0029] The face detection unit 120 detects a face area included in a registration image for registering face information and supplies the detected face area to the feature point extraction unit 130. The feature point extraction unit 130 extracts feature points from the face area detected by the face detection unit 120 and supplies facial feature information to the registration unit 140. The feature point extraction unit 130 also extracts feature points included in a face image received from the server 200 and supplies the facial feature information to the authentication unit 150.

[0030] The registration unit 140 issues a new user ID 111 when registering facial feature information. The registration unit 140 associates the issued user ID 111 with facial feature information 112 extracted from the registered image and registers them in the facial information DB 110. The authentication unit 150 performs facial authentication using the facial feature information 112. Specifically, the authentication unit 150 compares the facial feature information extracted from the facial image with the facial feature information 112 in the facial information DB 110. The authentication unit 150 returns a match of the facial feature information to the server 200. The match of the facial feature information corresponds to the success or failure of authentication. The match of the facial feature information (match present) refers to a case where the degree of match is equal to or greater than a predetermined value.

[0031] FIG. 5 is a flowchart showing the flow of face information registration processing according to the second embodiment. First, the face authentication device 100 acquires a registration image of the user U included in a face registration request (S21). For example, the face authentication device 100 receives the face registration request via the network N from the server 200, which has received a member registration request from the user terminal 300. Note that the face authentication device 100 may also receive the face registration request directly from the user terminal 300. Next, the face detection unit 120 detects a face area included in the registration image (S22). Next, the feature point extraction unit 130 extracts feature points from the face area detected in step S22 and provides facial feature information to the registration unit 140 (S23). Finally, the registration unit 140 issues a user ID 111 and associates the user ID 111 with facial feature information 112, and registers the user ID 111 in the face information DB 110 (S24). The face authentication device 100 may receive the face feature information 112 from the face registration request source, and register it in the face information DB 110 in association with the user ID 111.

[0032] FIG. 6 is a flowchart showing the flow of face authentication processing according to the second embodiment. First, the feature point extraction unit 130 acquires facial feature information for authentication (S31). For example, the face authentication device 100 receives a face authentication request from the server 200 via the network N and extracts facial feature information from the face image included in the face authentication request as in steps S21 to S23. Alternatively, the face authentication device 100 may receive the facial feature information from the server 200. Next, the authentication unit 150 compares the acquired facial feature information with the facial feature information 112 in the face information DB 110 (S32). If the facial feature information matches, that is, if the degree of match between the facial feature information is equal to or greater than a predetermined value (Yes in S33), the authentication unit 150 identifies the user ID 111 of the user whose facial feature information matches (S34). Then, the authentication unit 150 returns to the server 200 a notification that face authentication was successful and the identified user ID 111 as a face authentication result (S35). If there is no matching facial feature information (No in S33), the authentication unit 150 returns a message to the server 200 indicating that the facial authentication has failed as a facial authentication result (S36).

[0033] 7 is a block diagram showing the configuration of a user terminal 300 according to embodiment 2. The user terminal 300 includes a camera 310, a storage unit 320, a communication unit 330, a display unit 340, an input unit 350, and a control unit 360. The camera 310 is an imaging device that takes pictures under the control of the control unit 360. The memory unit 320 is a storage device that stores programs for realizing each function of the user terminal 300. The communication unit 330 is a communication interface with the network N. The display unit 340 is a display device. The input unit 350 is an input device that accepts input from the user. The display unit 340 and the input unit 350 may be configured integrally, such as a touch panel. The control unit 360 controls the hardware that the user terminal 300 has.

[0034] 8 is a block diagram showing the configuration of a store terminal 400 according to embodiment 2. The store terminal 400 includes a camera 410, a storage unit 420, a communication unit 430, a display unit 440, an input unit 450, and a control unit 460. The camera 410 is an imaging device that takes pictures under the control of the control unit 460. The memory unit 420 is a storage device that stores programs for realizing each function of the store terminal 400. The communication unit 430 is a communication interface with the network N. The display unit 440 is a display device. The input unit 450 is an input device that accepts input. The display unit 440 and the input unit 450 may be configured integrally, such as a touch panel. The control unit 460 controls the hardware that the store terminal 400 has.

[0035] 9 is a block diagram showing the configuration of the server 200 according to the second embodiment. The server 200 includes a storage unit 210, a memory 220, a communication unit 230, and a control unit 240. The storage unit 210 is a storage device such as a hard disk or a flash memory. The storage unit 210 stores a program 211, a user DB 212, a store information DB 213, related information 214, and a usage history DB 215. The program 211 is a computer program that implements the processing of the information processing method according to the second embodiment.

[0036] The user DB 212 stores user information of users who are members. Specifically, the user DB 212 stores user information 2122 in association with a user ID 2121. The user ID 2121 may be issued by the face authentication device 100 when registering face information. The user information 2122 is information about the user and may include, for example, user attribute information and information indicating the user's preferences. The attribute information may include at least one of age, place of residence, gender, family composition, place of employment, allergy information, and religious information. The attribute information may include a work environment, for example, whether the work is indoors or outdoors. The information indicating the user's preferences may include information about at least one of the user's hobbies, areas of interest of the user, and products or services evaluated by the user.

[0037] The store information DB 213 is a database that stores various information related to stores. Specifically, the store information DB 213 includes a store ID 2131, an affiliated group 2132, and sales promotion information 2133. The store ID 2131 is information for identifying the store. The affiliated group 2132 is information relating to the group to which the store belongs. For example, the affiliated group 2132 is a group ID for identifying the group to which the store belongs. The sales promotion information 2133 includes basic information about the store, information about products or services offered at the store, or campaign information or preferential treatment information for the products or services.

[0038] The relationship information 214 is an example of the relationship information described above. A specific example of the relationship information 214 will now be described with reference to FIG. 10 . FIG. 10 is a diagram illustrating an example of the relationship information 214 according to the second embodiment. The relationship information 214 may be information indicating the business relationship between the groups to which each store belongs, such as information on the relationship degree that quantifies the strength of the business relationship between the groups. For example, if the stores belong to the same affiliated group, the relationship degree may be “1.” If the stores belong to different affiliated groups and there is no business or capital alliance, the relationship degree may be “0.” Furthermore, if the stores belong to different affiliated groups but have some kind of business or capital alliance, the relationship degree may be greater than or equal to “0” and less than “1.” In this diagram, the relationship degree between group α and group β is “0.5,” and the relationship degrees between group α and group γ and between group β and group γ are “0.”

[0039] Alternatively or additionally, the relationship information 214 may be information indicating the business relationship between the stores, for example, information on the degree of relationship that quantifies the strength of the business relationship between the stores.

[0040] Returning to Fig. 9, the explanation will continue. The usage history DB 215 stores the usage history of a user at one or more stores. The usage history DB 215 stores a user ID 2151 and a usage history 2152 in association with each other. A specific example of the usage history DB 215 will now be explained with reference to Fig. 11.

[0041] 11 is a diagram showing an example of the data structure of the usage history DB 215 according to the second embodiment. The usage history DB 215 records the usage history of each user for each user ID. For example, the usage history includes the date and time of usage, the store used, the affiliated group of the store used, the purchased product (or the service used), the quantity, and the usage amount. The user's usage history may be included in the user information.

[0042] 9, the description will continue. The memory 220 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during operation of the control unit 240. The communication unit 230 is a communication interface with the network N.

[0043] The control unit 240 is a processor, that is, a control device, that controls each component of the server 200. The control unit 240 loads the program 211 from the storage unit 210 into the memory 220 and executes the program 211. In this way, the control unit 240 realizes the functions of a user information registration unit 241, an image acquisition unit 242, a user identification unit 243, a usage history extraction unit 244, a first selection unit 245, an output control unit 246, and a usage history registration unit 247.

[0044] The user information registration unit 241 is also called user information registration means. When the user information registration unit 241 receives a registration image from the user terminal 300, it transmits a face registration request to the face authentication device 100. Then, when the face authentication device 100 registers face information and issues a user ID, the user information registration unit 241 registers the user ID in the user DB 212. Furthermore, when the user information registration unit 241 receives a membership registration request from the user terminal 300, it associates the user information of the user using the user terminal 300 with the user ID of the user in the user DB 212.

[0045] The image acquisition unit 242 is also called image acquisition means. When the image acquisition unit 242 receives an information provision request or a facial payment request from the store terminal 400, it acquires a facial image or facial feature information included in the request. The image acquisition unit 242 supplies the facial image or facial feature information to the user identification unit 243.

[0046] The user identification unit 243 is also called a user identification means. The user identification unit 243 controls face authentication for the face region of user U included in the face image to identify the user. That is, the user identification unit 243 causes the face authentication device 100 to perform face authentication on the face image acquired from the store terminal 400. For example, the user identification unit 243 transmits a face authentication request including the acquired face image to the face authentication device 100 via the network N. The user identification unit 243 may extract the face region of user U from the face image and include the extracted image in the face authentication request. The user identification unit 243 may also extract facial feature information from the face region and include the facial feature information in the face authentication request. The user identification unit 243 then receives the face authentication result from the face authentication device 100. As a result, the user identification unit 243 identifies the user ID of the user.

[0047] The usage history extraction unit 244 is also called a usage history extraction means. When the usage history extraction unit 244 receives an information provision request from the store terminal 400, it extracts the usage history associated with the user ID identified by the user identification unit 243 from the usage history DB 215. The usage history extraction unit 244 supplies the extracted usage history to the first selection unit 245.

[0048] The first selection unit 245 is also referred to as a selection means. The first selection unit 245 selects at least one store as a recommended store from a plurality of stores based at least on the affiliated groups 2132 and the relationship information 214 in the store information DB 213. For example, the first selection unit 245 may select, as a recommended store, a store that belongs to a group whose relationship level between the store visited by the user (first store) and the affiliated group is equal to or greater than a predetermined threshold. Alternatively, for example, the first selection unit 245 may select, as a recommended store, a store that belongs to a group that has the top n relationships (n is a predetermined natural number) between the first store and the affiliated group. The recommended stores may be selected so as to include or exclude the first store. Furthermore, the recommended store may be operated in the same type of business as the first store or in a different type of business. Operating different types of businesses may mean that the business fields are different according to a predetermined criterion. For example, the first store may be operating a cosmetics sales business and the recommended store is operating a restaurant business. When a business selects different types of stores as recommended stores, it can widely guide users to other services in its own group or affiliated groups, thereby increasing the shopping effect of the entire group.

[0049] The first selection unit 245 then selects at least one piece of promotional information from the plurality of pieces of promotional information related to the recommended store as recommended promotional information. For example, the first selection unit 245 selects recommended promotional information from the plurality of pieces of promotional information associated with the store ID of the recommended store in the store information DB 213. The selection of recommended promotional information may be based on at least one of the user information associated with the user ID in the user DB 212 and the usage history associated with the user ID in the usage history DB 215.

[0050] The first selection unit 245 may adjust the quantity or quality of the recommended promotional information to be selected based on the identified user's usage history at stores in the affiliated group or affiliated group. For example, the first selection unit 245 may adjust the quantity or quality of the recommended promotional information based on the amount of spending by the identified user within the affiliated group of the first store or the user's frequency of visits to stores belonging to the affiliated group. As an example, the first selection unit 245 may increase the amount of recommended promotional information, select promotional information with a higher discount rate, or preferentially select promotional information including discount information, the higher the amount of spending or frequency of visits. As a result, for example, the more products a user purchases at or visits stores in the affiliated group, the more useful information the user can obtain. This makes it easier for stores to guide users to their own stores' affiliated groups.

[0051] The output control unit 246 is also called an output control means. In the second embodiment, the output control unit 246 transmits the sales promotion information selected by the first selection unit 245 to the store terminal 400 of the first store visited by the user, and causes the store terminal 400 to display the sales promotion information.

[0052] The usage history registration unit 247 is also called a usage history registration means. When the usage history registration unit 247 receives a facial payment request from the store terminal 400, it registers the usage information related to the payment included in the facial payment request as a usage history in the usage history DB 215 in association with the user ID.

[0053] FIG. 12 is a sequence diagram showing the flow of member registration processing according to the second embodiment. First, the user terminal 300 photographs the user U (S500) and transmits a member registration request including a registration image generated by photographing the user U to the server 200 (S501). Then, the user information registration unit 241 of the server 200 incorporates the registration image included in the received member registration request into a face registration request and transmits the request to the face authentication device 100 (S502). Then, the face authentication device 100 registers face information (facial feature information) of the user U based on the registration image included in the received face registration request (S503). Then, the face authentication device 100 notifies the server 200 of the issued user ID (S504). Furthermore, the user terminal 300 accepts input of user information from the user and transmits the user information to the server 200 (S505). The transmitted user information includes user attribute information and information indicating the user's preferences. The user information registration unit 241 of the server 200 associates the notified user ID and user information with each other and registers them in the user DB 212 (S506).

[0054] FIG. 13 is a diagram showing an example of a display of the user terminal 300 according to the second embodiment. FIG. 13 shows a user information input screen displayed on the display unit 340 of the user terminal 300 at the time of member registration. The screen of FIG. 13 includes, as input areas for information indicating the user's preferences, an input area for selecting items of interest to the user and an input area for selecting information for which the user would like to receive recommendations. For example, the user selects "makeup" and "restaurants" as items of interest, and selects "cosmetics sales information" and "restaurant preferential treatment information" as information for which the user would like to receive recommendations. In S505, the user terminal 300 transmits the information received from each input area to the server 200 as information indicating the user's preferences.

[0055] FIG. 14 is a sequence diagram showing the flow of information provision processing according to the second embodiment. First, the store terminal 400 of the first store captures an image of a user visiting the first store (S510). Then, the store terminal 400 transmits an information provision request to the server 200 (S511). This information provision request includes a facial image generated by capturing the image and a store ID for identifying the first store. As a result, the image acquisition unit 242 of the server 200 acquires the facial image of the user. Next, the user identification unit 243 of the server 200 transmits a facial recognition request for the facial region of user U in the facial image to the face authentication device 100 (S512). Then, the face authentication device 100 performs face authentication on the facial region of user U in the facial image included in the received face authentication request (S513). Here, it is assumed that there is a user ID whose face authentication was successful. The face authentication device 100 transmits a face authentication result including a notification that face authentication was successful and the user ID to the server 200 (S514). The user identification unit 243 of the server 200 identifies the user based on the user ID included in the face authentication result.

[0056] Next, the usage history extraction unit 244 of the server 200 extracts usage history associated with the user ID included in the face authentication result from the usage history DB 215 (S515) and supplies it to the first selection unit 245. Next, the first selection unit 245 identifies the affiliated group of the first store by referring to the store information DB 213 using the store ID that identifies the first store (S516). Next, the first selection unit 245 selects a recommended store from multiple stores based on the identified affiliated group and the relationship information 214 (S517). Next, the first selection unit 245 selects recommended promotional information from the promotional information of recommended stores stored in the store information DB 213 based on the user usage history extracted in S515 and user information associated with the user ID in the user DB 212 (S518). Next, the output control unit 246 transmits the recommended promotional information of the recommended store to the store terminal 400 of the first store (S519). The store terminal 400 displays the recommended sales promotion information of the recommended store on the display unit 440 (S520).

[0057] In the above description, in S517, the affiliated group and related information 214 are used as the basis for selecting a recommended store, and the usage history and user information are used as the basis for selecting recommended promotional information. However, this is not limiting. For example, in addition to or instead of this, the usage history and user information may be used as the basis for selecting a recommended store. As an example, if the first store provides vehicle sales and vehicle maintenance services, the first selection unit 245 may select a recommended store based on the user's vehicle maintenance history included in the user's usage history from among the stores identified based on the affiliated group and related information 214 of the first store. Then, the first selection unit 245 may select promotional information for a service preferred by the user from the promotional information of the recommended stores based on the usage history and user information. Furthermore, the affiliated group and relationship information 214 may be used as the basis for selecting recommended promotional information. For example, the first selection unit 245 may select a recommended product or recommended service from the usage history and user information, and select promotional information for the recommended store from the promotional information related to the recommended product or recommended service based on the affiliated group and relationship information 214. As an example, if the first store provides vehicle sales or vehicle maintenance services, the first selection unit 245 may first select the type of maintenance service required based on the user's vehicle maintenance history included in the user's usage history. Then, the first selection unit 245 may select promotional information for a store that has a high relationship with the affiliated group of the first store from the promotional information related to the selected maintenance service as the recommended promotional information for the recommended store.

[0058] FIG. 15 is a sequence diagram showing the flow of the usage history registration process according to the second embodiment. First, the store terminal 400 of the first store photographs the user when the user makes a facial payment for use at the first store (S530). Next, the store terminal 400 transmits a facial payment request to the server 200 (S531). The facial payment request may include a facial image generated by photographing and usage information related to the facial payment. Then, the information processing system 1000 executes processes similar to those of S512 to S514.

[0059] The usage history registration unit 247 of the server 200, which has received the face authentication result, executes a settlement process with the store terminal 400 (S535). At this time, the usage history registration unit 247 of the server 200 designates the user as the billing destination. The usage history registration unit 247 of the server 200 then registers the usage information as a usage history in the usage history DB 215 in association with the user ID included in the face authentication result (S536).

[0060] The information provision request in S511 of Fig. 14 and the facial payment request in S531 of Fig. 15 may include a facial image of the user captured at the same time, or the facial authentication result may be used. Alternatively, in S511 of Fig. 14, the store terminal 400 may issue a facial payment request along with the information provision request. In such a case, some or all of S530 to S531 of Fig. 15 and S512 to S514 of Fig. 15 may be omitted. This provides various advantages, such as eliminating the need to take a picture of the user's face, reducing the processing load on the information processing system 1000, and suppressing an increase in the psychological burden on the user from taking a picture.

[0061] Thus, according to the second embodiment, the server 200 provides a user who visits a first store with promotional information about stores that have business relationships with the first store, personalized based on the user's attributes and preferences. This increases user satisfaction and encourages users to visit stores in the same company group or affiliated group as the store they visited, making it easier to retain customers.

[0062] In the second embodiment, the first selection unit 245 may select recommended sales promotion information related to the recommended store based on the usage cycle of the product or service used by the user, in addition to the user information and usage history. The usage cycle may be called a purchase cycle.

[0063] FIG. 16 is a diagram for explaining a purchase cycle according to the second embodiment. The purchase cycle may be predetermined based on the type of product or the type of service. FIG. 16 shows an example of a purchase cycle when the first store visited by the user sells cosmetics and the server 200 recommends cosmetics to the user. The type of product (cosmetics) may be divided into major categories and minor categories representing the purpose of use or the area of ​​use, and the purchase cycle may be determined based on at least one of the major category and the minor category. As an example, the purchase cycle for a product whose major category is "base makeup" and whose minor category is "foundation" is "four months." On the other hand, the purchase cycle for a product whose major category is "eye makeup" and whose minor category is "eyeliner," "mascara," or "eyebrow pencil" is "three months."

[0064] For example, if the user purchased an eyeliner with a three-month purchase cycle three months ago, the first selection unit 245 determines the type of product to be suggested as “eyeliner.” Alternatively, if the user purchased an eyeliner with a three-month purchase cycle three months ago, the first selection unit 245 may determine the major item “eye makeup” to which the minor item “eyeliner” belongs as the type of product to be suggested.

[0065] The first selection unit 245 then selects promotional information related to eyeliner as recommended promotional information from among the promotional information related to various products at the recommended store. The promotional information related to eyeliner may be, for example, information on new eyeliner products, word-of-mouth information, or discount information. Before selecting the recommended promotional information, the first selection unit 245 may select, as recommended stores, stores related to the cosmetics sales business and in the same affiliated group as the visited store that have promotional information related to eyeliner. In this way, the first selection unit 245 determines the type of product to be recommended based on the purchase cycle and the timing of the previous purchase, and selects recommended promotional information based on the determined product type. This enables the server 200 to provide information tailored to the user's purchase cycle for each product type. The server 200 may transmit the recommended promotional information to the store terminal 400 or the user terminal 300 when the user visits the first store, or may transmit the recommended promotional information to the user terminal 300 regardless of whether the user visits the store.

[0066] Furthermore, when selecting recommended stores and recommended promotion information, the first selection unit 245 may select recommended stores and recommended promotion information based on sale information of each store instead of or in addition to the usage cycle.

[0067] When the store terminal 400 receives such recommended sales promotion information, it may display the screen shown in Fig. 17 on the display unit 440. Fig. 17 is a diagram showing an example of the display of the store terminal 400 according to the fourth embodiment. The display unit 440 displays information about an eye makeup set and lipstick that are on sale at stores in group α as products recommended to the user. This allows products or services on sale to be introduced to users preferentially. 17, an illustration of a person's face is displayed on display unit 440, and information about the product is displayed at a position on the person's face that corresponds to the part of the body where the product is used. The illustration of the person's face may be a registered image of the user or an image of the user's face at the time of face authentication.

[0068] 16 and 17, the promotional information of a store that provides cosmetics sales services is provided, but the business field of the store is not limited to this. For example, when providing promotional information of a store that provides vehicle maintenance services, the first selection unit 245 may determine the type of maintenance (e.g., engine oil change or tire change) based on the timing of vehicle purchase or previous maintenance, and the maintenance cycle. The first selection unit 245 may then select recommended promotional information based on the determined type of maintenance.

[0069] <Embodiment 3> Next, a third embodiment of the present disclosure will be described. The third embodiment is characterized in that the server provides appropriate sales promotion information in consideration of opportunity loss for the user. 18 is a block diagram showing the configuration of the server 200a according to the third embodiment. The server 200a has basically the same configuration and functions as the server 200. However, the server 200a differs from the server 200 in that the server 200a includes a storage unit 210a and a control unit 240a instead of the storage unit 210 and the control unit 240.

[0070] The storage unit 210a stores a program 211a instead of the program 211, and a user DB 212a instead of the user DB 212. The program 211a is a computer program in which the processing of the information processing method according to the third embodiment is implemented.

[0071] The user DB 212a further stores opportunity loss information 2123 in association with the user ID 2121. The opportunity loss information 2123 is information indicating that a user visited a predetermined store but did not use the store. For example, the opportunity loss information may indicate an opportunity loss rate obtained by dividing the number of times the user used the predetermined store by the number of times the user visited the predetermined store. Furthermore, for example, the opportunity loss information may indicate an opportunity loss rate in a case where a user who visited a store is identified but the user's use of the store at the time of the visit is not recorded.

[0072] Here, various methods may be used to identify users who have visited a store. In this embodiment 3, the following "Method 1" is used, but the present invention is not limited to this and may also be "Method 2" or "Method 3." (Method 1) For example, when a user visits a first store, the user terminal 300 is configured to transmit a previously captured facial image or facial feature information of the user to the store terminal 400 via short-range wireless communication. The short-range wireless communication may be Bluetooth (registered trademark) or BLE (Bluetooth Low Energy). The store terminal 400 then transmits a store visit record request including the acquired facial image or facial feature information to the server 200a. The server 200a controls the facial recognition device 100 to perform facial recognition based on the user's facial area, thereby identifying the user who has visited the store. (Method 2) The user terminal 300 may be configured to transmit, when the user visits the first store, a user ID that has been registered in advance in the user terminal 300 to the store terminal 400 via short-range wireless communication. In this case, the store terminal 400 transmits a store visit record request including the user ID to the server 200a, and the server 200a identifies the user who visited the store. (Method 3) The server 200a may identify a user who has visited the store by a facial recognition method using the camera 410 of the store terminal 400, similar to the facial recognition performed when providing information or making a facial payment. In this case, the camera 410 of the store terminal 400 may be installed in a location other than the cash register of the store. By using "Method 1," "Method 2," or "Method 3," the fact that a user visited the store can be recorded even if the user did not visit the store's cash register, making it easy to calculate the opportunity loss.

[0073] The control unit 240a includes an opportunity loss calculation unit 248 and a first selection unit 245a instead of the first selection unit 245.

[0074] The opportunity loss calculation unit 248 is also called opportunity loss calculation means. First, the opportunity loss calculation unit 248 acquires or generates store visit information indicating that the user visited the first store from the store visit record request. The store visit information may include a user ID, information on the date and time when the user visited the store, and the store ID of the store visited. When "Method 1" or "Method 3" is used, the store visit record request may include a facial image or facial feature information, information on the date and time when the user visited the store, and the store ID of the store visited. In this case, the opportunity loss calculation unit 248 identifies the user ID included in the store visit information from the results of face authentication based on the user's facial area, and generates store visit information by combining the user ID with the date and time information and the store ID. On the other hand, when "Method 2" is used, the store visit record request may include the user ID, information on the date and time when the user visited the store, and the store ID of the store visited. The opportunity loss calculation unit 248 then acquires the store visit record request as store visit information as is.

[0075] The opportunity loss calculation unit 248 may store the store visit information as a store visit history in association with the user in the storage unit 210a. The store visit history may be information included in the user information in the user DB 212.

[0076] The opportunity loss calculation unit 248 then generates opportunity loss information from the user's store visit history and usage history. For example, the opportunity loss calculation unit 248 calculates the number of visits to a specific store (number of visits) and the number of times a specific store has been used (number of uses). The number of uses may simply be the number of times in the usage history for the specific store, or may be the number of times in the usage history that usage occurred within a specific time period from the user's store visit. The opportunity loss calculation unit 248 then generates opportunity loss information for the user based on the number of visits and the number of uses. The opportunity loss calculation unit 248 associates the generated opportunity loss information with the user ID and registers it in the user DB 212.

[0077] The first selection unit 245a selects recommended promotional information related to the recommended store based on the user information, the user's usage history, and the related information 214, as well as the user's opportunity loss information. For example, a user who visits a particular store many times but uses it infrequently may be interested in the store's products or services but has not yet purchased them. Therefore, the first selection unit 245a may preferentially select discount information that encourages the purchase of products from a particular store as recommended promotional information. Also, for example, a user who visits multiple stores many times but uses them infrequently may be the type of user who prefers to carefully examine the contents of a product before purchasing it. Therefore, the first selection unit 245a may preferentially select detailed information about a product that the user is interested in as recommended promotional information.

[0078] In this way, the first selection unit 245a analyzes the user's situation and personality based on the opportunity loss information and uses this information to select the promotional information to provide, allowing the server 200a to provide promotional information that is effective in retaining customers.

[0079] Here, the opportunity loss calculation process by the opportunity loss calculation unit 248 will be described. Fig. 19 is a sequence diagram showing the flow of the opportunity loss calculation process according to the third embodiment. First, when a user visits a first store, the user terminal 300 transmits a face image of the user, which is stored in advance in the storage unit 320 of the user terminal 300, to the store terminal 400 via short-range wireless communication (S541).

[0080] In response to receiving the user's facial image from the user terminal 300, the store terminal 400 transmits a store visit record request to the server 200a (S542). The store visit record request may include the visit date and time, the user's facial image, and the store ID.

[0081] When the server 200a receives a store visit record request, the same processes as S512 to S514 are executed. As a result, the opportunity loss calculation unit 248 of the server 200a can acquire store visit information including the user ID, visit date and time, and store ID to identify the user ID.

[0082] The opportunity loss calculation unit 248 of the server 200a that has received the face authentication result records the visit information as the user's visit history in the user DB 212 (S545). The opportunity loss calculation unit 248 generates opportunity loss information based on the usage history in the usage history DB 215 and the visit history in the user DB 212 (S546). Then, the opportunity loss calculation unit 248 updates the opportunity loss information corresponding to the user ID in the user DB 212 (S547).

[0083] <Embodiment 4> Next, a fourth embodiment of the present disclosure will be described. In the fourth embodiment, the first store visited by the user is a store that provides beauty-related services, for example, a store that sells cosmetics. In the fourth embodiment, the server provides the user with information about cosmetic products or preferential treatment information for cosmetic products, etc., personalized for the user, as recommended promotional information.

[0084] 20 is a block diagram showing the configuration of a server 200b according to the fourth embodiment. The server 200b differs from the server 200 in that the server 200b includes a storage unit 210b and a control unit 240b instead of the storage unit 210 and the control unit 240.

[0085] The storage unit 210b stores a program 211b instead of the program 211. The program 211b is a computer program in which the processing of the information processing method according to the fourth embodiment is implemented.

[0086] The control unit 240b includes a facial state generation unit 249 and a first selection unit 245b instead of the first selection unit 245.

[0087] The facial state generation unit 249 is also called a facial state generation means. The facial state generation unit 249 generates facial state information from the user's facial image acquired by the image acquisition unit 242. The facial state information is information about the user's facial state, and includes, for example, information about skin color, skin moisture content, pore condition, or bone structure. The user's facial image used to generate the facial state information is also used for face authentication to identify the user.

[0088] The first selection unit 245b selects recommended sales promotion information related to the recommended store based on the facial state information generated by the facial state generation unit 249 in addition to the user information, usage history and related information 214.

[0089] 21 is a sequence diagram showing the flow of information provision processing according to embodiment 4. The steps shown in FIG. 21 include S600 to S601 instead of S518 shown in FIG.

[0090] In S600, the facial state generation unit 249 of the server 200b generates facial state information based on the facial image included in the information provision request acquired in S511. The facial state generation unit 249 supplies the facial state information to the first selection unit 245b.

[0091] Next, the first selection unit 245b of the server 200b selects recommended promotional information from the promotional information of recommended stores stored in the store information DB 213 (S601). At this time, the selection is based on the user's usage history extracted in S515, the user information associated with the user ID in the user DB 212, and facial state information. Next, the output control unit 246 transmits the recommended promotional information of the recommended store to the store terminal 400 of the first store (S519). The store terminal 400 displays the recommended promotional information of the recommended store on the display unit 440 (S520).

[0092] In the above description, facial state information is used as the basis for selecting recommended promotional information, but instead of or in addition to this, facial state information may also be used as the basis for selecting recommended stores.

[0093] FIG. 22 is a diagram showing an example of a display on the store terminal 400 according to the fourth embodiment. For example, the facial condition generating unit 249 generates facial condition information indicating that the skin is dry and has little moisture, based on the texture and color of the user's skin. The first selecting unit 245b then selects, as recommended promotional information, information about products with high moisturizing effects sold by stores belonging to the affiliated group or affiliated group of the first store. The store terminal 400 then displays the recommended promotional information on the display unit 440. In FIG. 22, the store terminal 400 displays, on the display unit 440, information about a moisturizing cosmetic set belonging to group β, which is affiliated with group α, the affiliated group of the first store.

[0094] In this way, the server 200b uses the face image for face authentication to grasp the current state of the user's face and uses the current state of the user's face to select information to provide. Therefore, the server 200b can provide appropriate information tailored to the user's situation, thereby improving user satisfaction. This makes it easier to retain users.

[0095] <Embodiment 5> Next, a fifth embodiment of the present disclosure will be described. In the fifth embodiment, the first store visited by the user is a store that provides vehicle services, for example, a store that sells vehicles. The server is an example of the information processing device 10 described above, and provides information about vehicle services or preferential information about vehicle services to the user after personalizing the information for the user. In the fifth embodiment, when the server receives a maintenance request from the user terminal, regardless of whether the user visits the first store, it transmits information about stores that can perform maintenance to the user terminal. This allows the user to easily find out about nearby stores that can perform maintenance, for example, if a breakdown occurs while the user is traveling in their vehicle. Furthermore, for example, if the user moves after purchasing a vehicle, the user can easily find out about stores near their home that can perform maintenance.

[0096] 23 is a block diagram showing the configuration of a server 200c according to embodiment 5. The server 200c has basically the same configuration and functions as the server 200. However, the server 200c differs from the server 200 in that it includes a storage unit 210c and a control unit 240c instead of the storage unit 210 and the control unit 240.

[0097] The storage unit 210c stores a program 211c, a user DB 212c, and a store information DB 213c instead of the program 211, the user DB 212, and the store information DB 213. The program 211c is a computer program that implements the processing of the information processing method according to the fifth embodiment. The user DB 212c further stores contract information 2124 in association with a user ID 2121.

[0098] The contract information 2124 is information about a contract concluded by a user and related to the user's vehicle. FIG. 24 is a diagram showing an example of the data structure of the contract information 2124 according to the fifth embodiment. The contract information 2124 records the user's contract information for each user ID. For example, the contract information includes the contract date, the contract store, the affiliated group, and the contract details. As an example, the user's record dated April 1, 2021 records that the vehicle was purchased from Store A of Group α, and that the user received a special benefit of free repairs for electrical system failures for two years at stores of Group α.

[0099] Returning to Fig. 23, the explanation will be continued. The store information DB 213c further stores available maintenance 2134 in association with the store ID 2131. The available maintenance 2134 indicates the types of maintenance that the store can currently handle, based on the store's parts inventory information, work time availability, etc.

[0100] The control unit 240c includes a vehicle state acquisition unit 250, a contract specification unit 251, and a second selection unit 252 in addition to the configuration of the control unit 240.

[0101] The vehicle state acquisition unit 250 is also referred to as a vehicle state acquisition means. The vehicle state acquisition unit 250 receives a vehicle maintenance request from the user terminal 300. The maintenance request includes the user's identification information, the user's vehicle state information, and the user's location information. As described above, the vehicle state information may indicate, for example, that a specific part of the vehicle has broken down, that a specific function has stopped working, or that a specific function is not working properly. The vehicle state acquisition unit 250 supplies the vehicle state information and the user's location information to the second selection unit 252.

[0102] In the fifth embodiment, the personal identification information is a facial image or facial feature information of the user, but may be a user ID instead. When the personal identification information is a facial image or facial feature information, the vehicle state acquisition unit 250 supplies the personal identification information to the user identification unit 243. In this way, the user identification unit 243 controls face authentication to identify the user.

[0103] The contract identification unit 251 is an example of the above-mentioned contract identification unit 11. When the user identification unit 243 identifies the user who has requested maintenance, the contract identification unit 251 identifies the contract information. Then, the contract identification unit 251 identifies the contracted store included in the contract information.

[0104] The second selection unit 252 is an example of the above-mentioned selection unit 12. The second selection unit 252 selects at least one store as a recommended store from among candidate stores that are stores capable of performing maintenance corresponding to the vehicle condition.

[0105] For example, the second selection unit 252 first identifies the type of maintenance based on the vehicle condition information. Next, the second selection unit 252 determines whether or not each of the multiple stores can perform maintenance corresponding to the vehicle condition, based on the available maintenance 2134 registered in the store information DB 213c. In other words, the second selection unit 252 identifies candidate stores that can perform maintenance corresponding to the vehicle condition, based on information on parts inventory according to the type of maintenance, availability of work time, etc.

[0106] The second selection unit 252 then selects a recommended store from the candidate stores based on information about the contract store included in the contract information and the user's location information. The information about the contract store may include at least the name of the contract store and the location information of the contract store. For example, the second selection unit 252 selects a recommended store from the candidate stores based on relationship information between each of the multiple stores and the contract store and the user's location information. For example, the second selection unit 252 preferentially selects stores in the affiliated group of the contract store or its affiliated group as recommended stores from among the candidate stores near the user's current location. This ensures convenience for the user, while encouraging the use of the affiliated group or affiliated group of the contract store with which the user has a transaction history when maintenance is needed. This makes it easier to retain users.

[0107] Furthermore, the second selection unit 252 may select a recommended store from the candidate stores based on the contract details and the user's location information in addition to or instead of the information about the contracted store. For example, the second selection unit 252 preferentially selects, as a recommended store, a store that can provide the services and benefits stipulated in the contract from among candidate stores in the vicinity of the user's current location. This allows the user to easily identify stores that are advantageous for them, thereby improving user satisfaction.

[0108] The output control unit 246 then outputs information related to the selected recommended store to the user terminal 300 that has made the maintenance request. Information related to the recommended store includes basic information and sales promotion information about the recommended store.

[0109] FIG. 25 is a sequence diagram showing the flow of information provision processing according to the fifth embodiment. First, the user terminal 300 transmits a maintenance request to the server 200c (S701). The maintenance request includes the user's location information, vehicle condition information, and a facial image of the user as personal identification information. As a result, the vehicle condition acquisition unit 250 of the server 200c acquires various information included in the maintenance request. Next, the information processing system 1000 executes the same processes as S512 to S514. As a result, the user identification unit 243 of the server 200c identifies the user ID of the user.

[0110] Next, the contract identification unit 251 of the server 200c references the user DB 212c and identifies the contract information 2124 associated with the user ID (S702). Next, the second selection unit 252 of the server 200c identifies the type of maintenance based on the vehicle condition information (S703). Next, the second selection unit 252 identifies candidate stores that can perform maintenance based on the type of maintenance and the available maintenance 2134 registered in the store information DB 213c (S704). Next, the second selection unit 252 selects a recommended store from the candidate stores based on at least the contract information 2124 and the location information (S705). Then, the output control unit 246 of the server 200c transmits information related to the recommended store to the user terminal 300 (S706). The user terminal 300 displays the information related to the recommended store on the display unit 340 (S707).

[0111] 26 is a diagram showing an example of a display of the user terminal 300 according to the fifth embodiment. For example, the display unit 340 of the user terminal 300 displays the user's current location and the location of a store recommended for maintenance on a map. The user terminal 300 may further display route information from the user's current location to the store recommended for maintenance.

[0112] Here, when the user visits the first store, the server 200c may share the user's contract information with the store terminal 400 of the first store. In this case, the contract identification unit 251 identifies a contract related to the vehicle of the user identified by the user identification unit 243, and the output control unit 246 outputs contract information related to the contract to the store terminal 400 of the first store. The output control unit 246 may also output user information of the user identified by the user identification unit 243 to the store terminal 400 of the first store.

[0113] FIG. 27 is a sequence diagram showing the flow of information sharing processing according to the fifth embodiment. In FIG. 27, as an example, when a user visits a first store, the server 200c records the visit and transmits contract information and user information to the store terminal 400. Specifically, first, the same processes as those of S541 to S542, S512 to S514, and S545 described above are executed. Then, the contract identification unit 251 of the server 200c refers to the user DB 212c and acquires user information and contract information associated with the user ID from the user DB 212c (S711). Then, the output control unit 246 of the server 200c transmits the user information and contract information to the store terminal 400 (S712).

[0114] Therefore, even when a user visits a store other than one with which the user has previously done business, the user information or contract information can be easily transferred to the first store. The output control unit 246 of the server 200c may not transmit the user information or contract information to the store terminal 400 of the first store if the business relationship between the user's contract store and the visited first store is distant. That is, the output control unit 246 of the server 200c may determine whether to transmit the user information or contract information to the store terminal 400 of the first store based on relationship information indicating the business relationship between the user's contract store and the visited first store. In this case, the output control unit 246 may restrict or prohibit the transmission of the user information or contract information to the store terminal 400 of the first store if the relationship level is below a predetermined threshold. This facilitates information sharing between stores while taking into account the business risks of information sharing.

[0115] <Another embodiment 1> In the second embodiment described above, the server 200 executes the face payment process after designating the user as the billing destination for the fee for using the store (e.g., S535 in FIG. 15 ). However, instead of this, the server 200 may determine whether to bill the user for the fee for using the store, or the billing destination or the billing amount, based on the relationship between the user's company and the first store. For example, suppose that the user's company has a corporate contract with the first store regarding a subscription service for its employees as part of its employee benefits. In this case, the server 200 does not bill the user for the fee for using the store. Instead, the server 200 bills the user's company for the usage fee for the subscription service. Also, suppose that the user's company has a corporate contract with the first store under which the company will cover a portion of the fees used by its employees. In this case, the server 200 bills the company for the fee for using the store and the user for the remainder.

[0116] In order to realize the above-described processing based on the relationship between the user's company and the first store, the ID of the user's company may be stored in association with the user ID in the user DB 212 of the storage unit 210 of the server 200. The storage unit 210 of the server 200 may further store information regarding the corporate contract between each company and each store.

[0117] Note that even when a family member of the user visits the first store, the server 200 may determine whether to charge a fee for using the store, or the billing destination or the billing amount, based on the relationship between the user's company and the first store. In this case, the user ID of the user and the user IDs of the user's family members may be linked in the user DB 212 of the storage unit 210 of the server 200.

[0118] In this way, by making it possible to execute facial payment processing that takes into account the content of the corporate contract, the information processing system 1000 can be applied to a new business model called BtoBtoE.

[0119] Although the above-described embodiments have been described as hardware configurations, the present disclosure is not limited to such configurations. Any processing in the present disclosure can also be realized by causing a processor to execute a computer program.

[0120] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0121] The present disclosure is not limited to the above-described embodiments, and can be modified as appropriate without departing from the spirit of the present disclosure. For example, it is possible to combine embodiments 3 and 4, or embodiments 3 and 5.

[0122] For example, in the above-described embodiment, facial authentication is used as a means for identifying a user, but instead of facial authentication, fingerprint, iris, palm, vein authentication, gait, or other biometric authentication may be used. In this case, the store terminal 400 may transmit an image of the user captured by the store terminal 400 or biometric information read by the store terminal 400 to the face authentication device 100 (biometric authentication device) via the server 200, and the face authentication device 100 may identify the user ID by the designated biometric authentication. The identified user ID is returned to the server 200.

[0123] Furthermore, in the above-described embodiment, the face authentication device 100 has a face authentication function, but instead of or in addition to the face authentication device 100, the server 200 may have a face authentication function.

[0124] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. (Appendix A1) image acquisition means for acquiring a photographed image of a user who visits the first store; a user identification means for identifying the user based on the captured image; a selection means for selecting at least one piece of promotional information related to at least one of the plurality of stores as recommended promotional information related to a recommended store, based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; an output control means for outputting the recommended sales promotion information; An information processing device comprising: (Appendix A2) The user information includes at least one of attribute information of the user, information indicating the user's preferences, and a usage history indicating that the user has used any one of the plurality of stores. 10. The information processing device according to claim 1, (Appendix A3) The selection means selecting the at least one store as the recommended store from the plurality of stores based on the relationship information; Selecting the at least one piece of promotional information as the recommended promotional information from a plurality of pieces of promotional information related to the recommended store based on the user information. An information processing device according to appendix A1 or A2. (Appendix A4) a facial state generating means for generating facial state information relating to the facial state of the user from the photographed image; The selection means selects the recommended sales promotion information related to the recommended store based on the user information, the related information, and the facial state information. An information processing device according to any one of appendices A1 to A3. (Appendix A5) The recommended store operates a different type of business than the first store. An information processing device according to any one of appendices A1 to A3. (Appendix A6) The selection means selects the recommended sales promotion information related to the recommended store based on a cycle corresponding to the type of product purchased by the user or a cycle corresponding to the type of service used by the user. An information processing device according to any one of appendices A1 to A5. (Appendix A7) The method further comprises: acquiring store visit information indicating that the user has visited the first store; and generating opportunity loss information of the user based on the number of times the user has visited the first store and the number of times the user has used the first store; The selection means selects the recommended sales promotion information related to the recommended store based on the user information, the relationship information, and the opportunity loss information of the user. An information processing device according to any one of appendices A1 to A6. (Appendix A8) The selection means adjusts the quantity or quality of the promotional information to be selected based on the amount of money spent by the user in the group to which the first store belongs or the frequency of the user's visits to one or more stores belonging to the group. An information processing device according to any one of appendices A1 to A7. (Appendix A9) an information processing device; a terminal that provides information to a user who visits the first store; Equipped with The information processing device includes: image acquisition means for acquiring a photographed image of the user visiting the first store; a user identification means for identifying the user based on the captured image; a selection means for selecting at least one piece of promotional information related to at least one of the plurality of stores as recommended promotional information related to a recommended store, based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; an output control means for outputting the recommended sales promotion information to the terminal; have Information processing system. (Appendix A10) The terminal further includes a biometric authentication device that acquires the captured image from the terminal and performs biometric authentication using the captured image. 1. An information processing system as described in Appendix A9. (Appendix A11) Acquire a photographed image of a user who visited the first store; Identifying the user based on the captured image; selecting at least one piece of promotional information related to at least one of the plurality of stores as recommended promotional information related to a recommended store based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; Output the recommended sales promotion information Information processing methods. (Appendix A12) an image acquisition process for acquiring a captured image of a user who visited the first store; a user identification process for identifying the user based on the captured image; a selection process for selecting at least one piece of promotional information related to at least one of the plurality of stores as recommended promotional information related to a recommended store, based on user information related to the user and relationship information indicating a business relationship between each of the plurality of stores and the first store; an output control process for outputting the recommended sales promotion information; A non-transitory computer-readable medium storing a program for causing a computer to execute the above. (Appendix B1) a contract identification means for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from a user terminal used by the user; a selection means for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control means for outputting information related to the recommended store to the user terminal; An information processing device comprising: (Appendix B2) The contracted store includes the store where the user purchased, rented, or leased the vehicle. 10. The information processing device according to claim 8, wherein the information processing device is a device for processing information according to claim 1. (Appendix B3) The selection means selects the recommended store from stores that can perform maintenance corresponding to the condition based on relationship information indicating a business relationship between each of a plurality of stores and the contract store and location information of the user. An information processing device according to Appendix B1 or B2. (Appendix B4) The selection means selects the recommended store from stores that can perform maintenance corresponding to the condition based on information about the contract store, location information about the user, and the contract details about the vehicle. An information processing device according to any one of appendices B1 to B3. (Appendix B5) The selection means Identifying the type of maintenance based on the condition information; For each of the plurality of shops, it is determined whether or not the repair corresponding to the condition is possible based on inventory information of parts corresponding to the type of repair. An information processing device according to any one of appendices B1 to B4. (Appendix B6) image acquisition means for acquiring a photographed image of a user who visits the first store; a user identification means for identifying a user based on the captured image; Equipped with The contract identification means identifies a contract related to the vehicle of the identified user, The output control means outputs contract information relating to the contract to a terminal in the first store. An information processing device according to any one of appendices B1 to B5. (Appendix B7) an information processing device; The user terminal used by the user Equipped with The information processing device includes: a contract identification means for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from the user terminal; a selection means for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control means for outputting information related to the recommended store to the user terminal; have Information processing system. (Appendix B8) When information regarding the status of the user's vehicle and location information of the user are acquired from a user terminal used by the user, a contract related to the user's vehicle is identified; Selecting at least one store that can perform maintenance corresponding to the condition as a recommended store based on information about the contract store that is the store with which the contract has been made and location information of the user; Outputting information related to the recommended store to the user terminal. Information processing methods. (Appendix B9) a contract identification process for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from a user terminal used by the user; a selection process for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control process for outputting information related to the recommended store to the user terminal; A non-transitory computer-readable medium that stores a program for execution by a computer. [Explanation of symbols]

[0125] 10, 200, 200a, 200b, 200c Information processing device (server) 12 Selection section 100 Facial Recognition Device 110 Face Information DB 111 User ID 112 Facial Feature Information 120 Face detection unit 130 Feature point extraction unit 140 Registration Department 150 Authentication Department 210,210a Storage section 211, 211a, 211b, 211c Programs 212, 212a, 212c User DB 2121 User ID 2122 User Information 2123 Opportunity Loss Information 2124 Contract Information 213,213c Store Information DB 2131 Store ID 2132 Affiliated Group 2133 Promotional Information 2134 Available maintenance 214 Related Information 215 Usage History DB 2151 User ID 2152 Usage History 220 memory 230 Communications Department 240, 240a, 240b, 240c control unit 241 User Information Registration Department 242 Image acquisition unit 243 User Identification Unit 244 Usage History Extraction Unit 245, 245a, 245b First Selection Section 16,246 Output control section 247 Usage History Registration Department 248 Opportunity Loss Calculation Unit 249 Facial State Generation Unit 250 Vehicle status acquisition unit 11,251 Contract Specific Department 252 Second Selection Section 300 User Terminals 310 Camera 320 Storage section 330 Communications Department 340 Display section 350 Input section 360 Control Unit 400 store terminals 410 Camera 420 Storage section 430 Communications Department 440 Display section 450 Input section 460 Control Unit 1000 Information Processing Systems

Claims

1. a contract identification means for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from a user terminal used by the user; a selection means for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control means for outputting information related to the recommended store to the user terminal; Equipped with The selection means selects the recommended store from stores that can perform maintenance corresponding to the condition based on relationship information indicating a business relationship between each of a plurality of stores and the contract store and location information of the user. Information processing device.

2. The contracted store includes the store where the user purchased, rented, or leased the vehicle. The information processing device according to claim 1 .

3. The selection means selects the recommended store from stores that can perform maintenance corresponding to the condition based on information about the contract store, location information about the user, and the contract details about the vehicle.

3. The information processing device according to claim 1 or 2.

4. The selection means Identifying the type of maintenance based on the condition information; For each of the plurality of shops, it is determined whether or not the repair corresponding to the condition is possible based on inventory information of parts corresponding to the type of repair. The information processing device according to claim 1 .

5. image acquisition means for acquiring a photographed image of a user who visits the first store; a user identification means for identifying a user based on the captured image; Equipped with The contract identification means identifies a contract related to the vehicle of the identified user, The output control means outputs contract information relating to the contract to a terminal of the first store. The information processing device according to claim 1 .

6. an information processing device; The user terminal used by the user Equipped with The information processing device includes: a contract identification means for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from the user terminal; a selection means for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control means for outputting information related to the recommended store to the user terminal; and The selection means selects the recommended store from stores that can perform maintenance corresponding to the condition based on relationship information indicating a business relationship between each of a plurality of stores and the contract store and location information of the user. Information processing system.

7. A computer comprising: When information regarding the status of the user's vehicle and location information of the user are acquired from a user terminal used by the user, a contract related to the user's vehicle is identified; selecting, as a recommended store, at least one store that can perform maintenance corresponding to the condition based on information about the contract store that is the store with which the contract has been made and location information of the user; outputting information related to the recommended store to the user terminal; and The recommended store is selected from stores that can perform maintenance corresponding to the condition based on relationship information indicating a business relationship between each of a plurality of stores and the contracted store and location information of the user. Information processing methods.

8. a contract identification process for identifying a contract related to the user's vehicle when information about the state of the user's vehicle and location information of the user are acquired from a user terminal used by the user; a selection process for selecting, as a recommended store, at least one store among stores that can perform maintenance corresponding to the condition, based on information about the contract store that is the store with which the contract has been made and location information of the user; an output control process for outputting information related to the recommended store to the user terminal; Let the computer run The selection process includes a process of selecting the recommended store from stores that can perform maintenance corresponding to the condition based on relationship information indicating a business relationship between each of a plurality of stores and the contracted store and location information of the user. program.

Images