Information processing device, information processing method, and program

Abstract

The present invention provides an information processing device, an information processing method, and a program that are capable of improving the profit of a store in a passenger terminal facility of public transportation.　In the information processing device, a registration unit associates and registers face information of a user and riding / boarding ticket information of public transportation used by the user. A face information acquisition unit acquires the face information of the user when the user orders in the store in the passenger terminal facility of the public transportation. An identification unit identifies the user by face authentication using the registered information and the acquired face information of the user. A guidance output unit acquires the riding / boarding ticket information associated with the face information of the user identified from the registered information, and outputs guidance based on the acquired riding / boarding ticket information to the identified user. In this case, when there remains a predetermined time or longer from the current time to the riding / boarding time, the guidance output means outputs, to the identified user, guidance for recommending placing an additional order as the guidance based on the riding / boarding ticket information.

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] Restaurants and other businesses are seeking to increase profits. For example, Patent Literature 1 discloses a system that uses biometric information to identify users and perform payments in stores, thereby reducing the labor required for payments in stores and ensuring the reliability of payments.

[0003] International Publication No. 2022 / 085469

[0004] However, the technology disclosed in Patent Document 1 leaves room for improvement in terms of increasing profits at stores when the system is used in stores at passenger facilities of public transportation.

[0005] In consideration of such problems, the present disclosure aims to provide an information processing device, an information processing method, and a program that can improve the profits of stores in passenger facilities of public transportation systems.

[0006] The information processing device of the present disclosure comprises: a registration means for linking and registering a user's facial information with boarding pass information for the public transportation system used by the user; a facial information acquisition means for acquiring the user's facial information when the user places an order at a store in a passenger facility of the public transportation system; an identification means for identifying the user by facial recognition using the registered information and the acquired facial information of the user; and a guidance output means for acquiring boarding pass information linked to the identified user's facial information from the registered information, and outputting guidance based on the acquired boarding pass information to the identified user, wherein the guidance output means outputs guidance to the identified user encouraging them to place an additional order as guidance based on the boarding pass information if there is more than a predetermined time between the current time and the boarding time.

[0007] The information processing method disclosed herein involves a computer linking and registering a user's facial information with boarding pass information for public transportation used by the user, acquiring the user's facial information when the user places an order at a store in a passenger facility of the public transportation, identifying the user through facial recognition using the registered information and the acquired user's facial information, acquiring boarding pass information linked to the identified user's facial information from the registered information, and outputting guidance based on the acquired boarding pass information to the identified user, and outputting guidance based on the boarding pass information to the identified user, if there is more than a predetermined time between the current time and the boarding time, prompting the identified user to place an additional order as guidance based on the boarding pass information.

[0008] The program disclosed herein causes a computer to execute the following process: linking and registering a user's facial information with boarding pass information for the public transportation system used by the user; acquiring the user's facial information when the user places an order at a store in a passenger facility of the public transportation system; identifying the user through facial recognition using the registered information and the acquired user's facial information; acquiring boarding pass information linked to the identified user's facial information from the registered information; outputting guidance based on the acquired boarding pass information to the identified user; and outputting guidance to the identified user based on the boarding pass information, if there is more than a predetermined time between the current time and the boarding time, a guidance urging the identified user to place an additional order as guidance based on the boarding pass information.

[0009] The present disclosure provides an information processing device, an information processing method, and a program that can improve the profits of stores in passenger facilities of public transportation.

[0010] FIG. 1 is a block diagram showing an example of the configuration of an information processing device 100 according to the present disclosure. FIG. 1 is a block diagram showing an example of the configuration of an information processing system 2 according to the present disclosure. FIG. 2 is a diagram showing an example of guidance output to a user in an information processing system 2 according to the present disclosure to encourage an additional order. FIG. 3 is a flowchart showing an example of the operation of an information processing system 2 according to the present disclosure. FIG. 4 is a flowchart showing an example of the operation of an information processing system 2 according to the present disclosure to output guidance based on boarding and boarding pass information. FIG. 5 is a flowchart showing another example of the operation of an information processing system 3 according to the present disclosure to output guidance based on boarding and boarding pass information. FIG. 6 is a flowchart showing another example of the operation of an information processing system 4 according to the present disclosure to output guidance based on boarding and boarding pass information. FIG. 7 is a flowchart showing another example of the operation of an information processing system 5 according to the present disclosure to output guidance based on boarding and boarding pass information. FIG. 8 is a block diagram showing an example of the configuration of a computer 1000 according to the present disclosure.

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are designated by the same reference numerals, and for clarity of explanation, duplicate explanations will be omitted as necessary.

[0012] First Embodiment First, the configuration of an information processing apparatus 100 according to a first embodiment will be described with reference to FIG.

[0013] 1 is a block diagram showing an example of the configuration of an information processing device 100 according to the present disclosure. As shown in FIG. 1 , the information processing device 100 includes a registration unit 101, a face information acquisition unit 102, an identification unit 103, and a guidance output unit 104.

[0014] The registration unit 101 associates and registers a user's facial information with boarding pass information for the public transportation facility used by the user. The facial information acquisition unit 102 acquires the user's facial information when the user places an order at a store in a passenger facility of the public transportation facility. The identification unit 103 identifies the user through facial recognition using the registered information and the acquired user's facial information. The guidance output unit 104 acquires boarding pass information associated with the identified user's facial information from the registered information, and outputs guidance based on the acquired boarding pass information to the identified user. Here, the guidance output unit 104 outputs, as guidance based on the boarding pass information, guidance to the identified user encouraging the user to place an additional order if there is more than a predetermined time between the current time and the boarding time.

[0015] As described above, the information processing device 100 according to the first embodiment outputs a guide to a user who is a customer of a store, encouraging the user to place an additional order, taking into consideration the boarding time. If the user has time until boarding, the user may wait on the public transportation platform or go to another location to waste time. In such a case, the user may be more likely to accept an additional order. The store can improve profits by providing guidance at a time when the user is more likely to accept an additional order, thereby increasing the likelihood that the user will place an additional order. Furthermore, the information processing device 100 can also improve profits for the user, by providing an opportunity to place an additional order and allowing the user to effectively use the time until boarding.

[0016] Second Embodiment Next, the configuration of an information processing system 2 according to a second embodiment will be described with reference to FIG.

[0017] The information processing system 2 is a system that provides guidance to users who use stores in passenger facilities of public transportation. Public transportation includes railways, trams, buses, ships, and airlines. Passenger facilities of public transportation include, for example, train stations, tram stations, bus terminals, passenger ship terminals, and airline passenger terminal facilities (airports). Stores are, for example, commercial facilities such as restaurants.

[0018] 2 is a block diagram showing an example of the configuration of an information processing system 2 according to the present disclosure. As shown in FIG. 2, the information processing system 2 includes an information processing device 10, an order terminal 20, a first camera 30, and a second camera 40.

[0019] The information processing device 10 is, for example, a server. The information processing device 10 communicates with the order terminal 20, the first camera 30, and the second camera 40 via a network. The information processing device 10 performs processing to provide guidance to users who use stores in passenger facilities.

[0020] The order terminal 20 is installed in a seat in a store of a passenger facility. The order terminal 20 is, for example, a tablet or a terminal dedicated to ordering. The order terminal 20 accepts orders from users at their seats in the store. The order terminal 20 transmits the accepted orders to the information processing device 10.

[0021] The first camera 30 is installed on a seat in a store in the passenger facility. The first camera 30 is, for example, a camera mounted on the order terminal 20 or a camera installed near a seat. The first camera 30 captures an image of the user's face when the user places an order at a seat in the store. The first camera 30 transmits the captured image of the user when placing an order at a seat in the store to the information processing device 10.

[0022] The above-mentioned ordering terminal 20 is not limited to a terminal installed at a seat in the store, but may also be a terminal installed in a location other than a seat in the store, such as in front of a cash register. In this case, the first camera 30 is a camera mounted on the ordering terminal 20 or a camera located near the installation location of the ordering terminal 20. Furthermore, the ordering terminal 20 may be a user terminal in the case where a user places an order using their own user terminal. In this case, the first camera 30 is, for example, a camera mounted on the user terminal.

[0023] The second camera 40 is installed at the exit of a store in the passenger facility. The second camera 40 captures an image of the user's face when the user leaves the store. The second camera 40 transmits the captured image of the user when the user leaves the store to the information processing device 10.

[0024] The order terminal 20, the first camera 30, and the second camera 40 may be installed in each store in the passenger facility. Also, the order terminal 20 and the first camera 30 may be installed at each seat in the store.

[0025] Next, a specific description will be given of the configuration of the information processing device 10 of the information processing system 2. The information processing device 10 includes a registration unit 11, a face information acquisition unit 12, an identification unit 13, a guidance output unit 14, a payment processing unit 15, and a storage unit 16. The information processing device 10 is a specific embodiment of the information processing device 100 according to the first embodiment. The registration unit 11, the face information acquisition unit 12, the identification unit 13, and the guidance output unit 14 of the information processing device 10 correspond to the registration unit 101, the face information acquisition unit 102, the identification unit 103, and the guidance output unit 104 of the information processing device 100, respectively.

[0026] The registration unit 11 registers information linking the user's facial information, payment method identification information, and public transportation boarding pass information in the storage unit 16. For example, the registration unit 11 registers the information based on information received from the user's terminal. The facial information is information representing the user's facial features. The payment method identification information is information for identifying the user's payment method, such as credit card information, transportation / commerce electronic money information, or QR code (registered trademark) information. The boarding pass information is information about the public transportation ticket / boarding pass used by the user. The boarding pass information includes, for example, information about the boarding / boarding time. The boarding / boarding pass information may also include information such as the boarding / boarding location, transfer stations, disembarking / alighting locations, and, in the case of a commuter pass, commuter pass information.

[0027] When a user places an order using the ordering terminal 20 at a seat in a store in a passenger facility, the facial information acquisition unit 12 acquires a photographed image of the user from the first camera 30. The facial information acquisition unit 12 acquires facial information of the user from the acquired photographed image.

[0028] The identification unit 13 identifies the user through face recognition using the information registered in the storage unit 16 and the user's face information acquired by the face information acquisition unit 12. For face recognition, a deep learning model such as a CNN (Convolutional Neural Network) model is used.

[0029] The guidance output unit 14 acquires boarding pass information linked to the face information of the user identified by the identification unit 13 from the information registered in the storage unit 16. The guidance output unit 14 outputs guidance to the user based on the acquired boarding pass information. For example, the guidance output unit 14 outputs guidance based on the acquired boarding pass information by voice or display to the order terminal 20 where the identified user places an order. Furthermore, the guidance output unit 14 may output guidance based on the acquired boarding pass information by voice or display to a terminal such as a smartphone used by the identified user.

[0030] More specifically, the guidance output unit 14 outputs, as guidance based on the boarding / boarding pass information, guidance to the user encouraging an additional order if there is a predetermined time or more between the current time and the acquired boarding / boarding time. The predetermined time takes into consideration factors such as the user's travel time from the store to the boarding / boarding location at the passenger facility and the time the user will spend placing an additional order, and is a time that allows the user to make the boarding / boarding time even if they place an additional order. The guidance encouraging an additional order is determined based on the remaining time until the boarding / boarding time. For example, if the remaining time until the boarding / boarding time is short, the guidance encourages the user to order an additional item that will be served to the user immediately after ordering or an item that does not require much time to eat (e.g., dessert, snack, drink). On the other hand, if the remaining time until the boarding / boarding time is long, the guidance encourages the user to order an additional item that will take a long time to be served to the user after ordering or an item that requires time to eat (e.g., main menu). The guidance encouraging an additional order may also include information that explains why the guidance encouraging an additional order was output. In this embodiment, the guidance prompting for an additional order is output when there is more than a predetermined time between the current time and the boarding time. For example, the guidance prompting for an additional order includes a message such as "There are xx minutes between the current time and the boarding time. Would you like to place an additional order?"

[0031] For example, the guidance output unit 14 outputs a guidance prompting an additional order shown in FIG. 3 to the user. FIG. 3 is a diagram illustrating an example of a guidance prompting an additional order output to a user in the information processing system 2 according to the present disclosure. As shown in FIG. 3, the guidance prompting an additional order is output by switching from the order screen on the ordering terminal 20 where the user places an order. The guidance prompting an additional order allows the user to selectively order product A (juice), product B (salad), product C (fried chicken), product D (potatoes), product E (coffee), and product E (cake). These products A to E are selected based on the assumption that there is little time remaining until boarding / reception, and are items that will be provided to the user immediately after ordering or that do not require much time for eating. The guidance prompting an additional order also includes a banner display that reads, "There are XX minutes between the current time and the boarding / reception time. Would you like to place an additional order?" The guidance prompting an additional order may also include the current time and the boarding / reception time.

[0032] The guidance to encourage an additional order is not limited to the time remaining until boarding / reception, but may be determined based on the user's attributes (e.g., age, gender, build, etc.), order history, etc. For example, the guidance may encourage a young user to order an additional item including an oily meal, and an older user to order an additional item other than an oily meal. Furthermore, the guidance may encourage an additional order of a meat dish if it is determined from the user's order history that the user prefers to order meat dishes. Furthermore, the guidance to encourage an additional order is not limited to being output by switching from the order screen on the ordering terminal 20 where the user places an order, but may also be output as a pop-up superimposed on the order screen.

[0033] Furthermore, if there is a predetermined time or more between the current time and the boarding time, the guidance output unit 14 may output guidance for other stores other than the store to the user. The other stores may be, for example, souvenir shops or convenience stores. The other stores may also be stores affiliated with the store from which the user placed an order. The guidance for the other stores may be, for example, guidance on the locations of the other stores and the products sold there.

[0034] In addition, if the time from the current time to the acquired boarding / boarding time is less than a predetermined time, the guidance output unit 14 outputs at least one of a guidance to the user that the boarding / boarding time is approaching and a guidance of the boarding / boarding location.

[0035] Furthermore, when the user leaves a store in the passenger facility, the facial information acquisition unit 12 acquires a photographed image of the user from the second camera 40. The facial information acquisition unit 12 acquires facial information of the user from the acquired photographed image. The identification unit 13 identifies the user by facial authentication using the information registered in the storage unit 16 and the facial information of the user acquired by the facial information acquisition unit 12.

[0036] The payment processing unit 15 acquires payment method specification information linked to the facial information of the identified user. The payment processing unit 15 processes payment for the order based on the acquired payment method specification information. Note that when the user pays at their seat, the payment processing unit 15 may acquire payment method specification information linked to the facial information of the user identified when placing the order, and process payment for the order based on the acquired payment method specification information.

[0037] Next, the operation of the information processing system 2 according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an example of the operation of the information processing system 2 according to the present disclosure.

[0038] 4, first, in step S101, the registration unit 11 of the information processing device 10 of the information processing system 2 registers information (registration information) linking the user's facial information, payment method identification information, and public transportation boarding pass information in the storage unit 16. The registration unit 11 accepts registration from the user terminal before the user places an order at a store in a passenger facility.

[0039] Next, in step S102, the face information acquisition unit 12 determines that the user has placed an order using the ordering terminal 20 at a seat in a store in the passenger facility. Next, in step S103, the face information acquisition unit 12 acquires face information of the user who placed the order from the image captured by the first camera 30. Next, in step S104, the identification unit 13 identifies the user who placed the order by face authentication using the registration information and the user's face information acquired by the face information acquisition unit 12.

[0040] Next, in step S105, the guidance output unit 14 acquires, from the registration information, boarding pass information linked to the face information of the user identified by the identification unit 13. Next, in step S106, the guidance output unit 14 outputs guidance based on the acquired boarding pass information to the order terminal 20.

[0041] Specifically, in step S106, the guidance output unit 14 performs the processes of steps S201 to S204 as shown in Fig. 5. Fig. 5 is a flowchart showing a specific example of the operation of the information processing system 2 according to the present disclosure to provide guidance based on boarding / boarding pass information.

[0042] As shown in Fig. 5, after step S105, in step S201, the guidance output unit 14 refers to the acquired boarding / boarding pass information. Next, in step S202, the guidance output unit 14 determines whether or not there is a predetermined time or more from the current time until the boarding / boarding time. If it is determined that there is a predetermined time or more from the current time until the boarding / boarding time (YES in step S202), the process proceeds to step S203. On the other hand, if it is determined that there is less than the predetermined time from the current time until the boarding / boarding time (NO in step S202), the process proceeds to step S204.

[0043] In step S203, the guidance output unit 14 outputs guidance encouraging an additional order to the ordering terminal 20. Note that in step S203, the guidance output unit 14 may output guidance for a store other than the store to the ordering terminal 20. Then, the process proceeds to step S107.

[0044] Furthermore, in step S204, the guidance output unit 14 outputs a notification that the boarding time is approaching and a guide to the boarding location to the ordering terminal 20. Note that in step S204, the guidance output unit 14 may output either the notification that the boarding time is approaching or the guide to the boarding location to the ordering terminal 20. Then, the processing proceeds to step S107.

[0045] Returning to the description of FIG. 4 , next, in step S107, the facial information acquisition unit 12 determines that the user is leaving a store in the passenger facility. Next, in step S108, the facial information acquisition unit 12 acquires facial information of the user leaving the store from the image captured by the second camera 40. Next, in step S109, the identification unit 13 identifies the user leaving the store through facial recognition using the registration information and the user's facial information acquired by the facial information acquisition unit 12. Next, in step S110, the payment processing unit 15 acquires payment method identification information linked to the identified user's facial information from the registration information. Next, in step S111, the payment processing unit 15 processes payment for the order of the identified user based on the acquired payment method identification information.

[0046] As described above, the information processing device 10 of the information processing system 2 according to the second embodiment outputs a guide to a user who is a customer of a store, encouraging the user to place an additional order, taking into consideration the boarding time. If the user has time until boarding, the user may wait on the public transportation platform or go to another location to waste time. In such a case, the user may be more likely to accept an additional order. The store can improve profits by providing guidance at a time when the user is more likely to accept an additional order, thereby increasing the likelihood that the user will place an additional order. Furthermore, the information processing device 10 can also improve profits for the user, by providing an opportunity to place an additional order and allowing the user to effectively use the time until boarding.

[0047] Furthermore, when there is little time left until boarding / boarding time, the information processing device 10 outputs at least one of a notice to the user that boarding / boarding time is approaching and a notice of the boarding / boarding location to the user. By doing so, the user can prevent themselves from ordering when there is little time left until boarding / boarding time. The store benefits from improved user satisfaction and reduced food waste by users.

[0048] Third Embodiment Next, a configuration of an information processing system 3 (not shown) according to a third embodiment will be described. The information processing system 3 is a system that improves store profits using a method different from that of the information processing system 2 according to the second embodiment.

[0049] The information processing system 3 has a configuration similar to that of the information processing system 2 shown in Fig. 2, but has the following additional functions: The guidance output unit 14 of the information processing device 10 of the information processing system 2 acquires boarding pass information linked to face information of the user identified by the identification unit 13 from information registered in the storage unit 16. The guidance output unit 14 outputs guidance based on the acquired boarding pass information to the identified user.

[0050] The guidance output unit 14 of the information processing device 10 of the information processing system 3 outputs, as guidance based on the boarding pass information, guidance to the identified user encouraging the user to place an additional order if the user, identified by the identification unit 13, can minimize waiting time at a transfer station by delaying the public transportation that the user plans to board. For example, delaying the public transportation that the user plans to board means that the user will board the train that is one stop after the train that the user plans to board. The guidance encouraging the user to place an additional order may also include guidance that explains why the guidance encouraging the user to place an additional order has been output. In this embodiment, the guidance encouraging the user to place an additional order is output because delaying the public transportation that the user plans to board will minimize waiting time at a transfer station. For example, the guidance encouraging the user to place an additional order includes guidance such as, "Delaying the public transportation that the user plans to board will minimize waiting time at a transfer station. Would you like to place an additional order?"

[0051] Furthermore, the guidance output unit 14 changes the boarding reservation in the user's boarding pass information at the timing when outputting the guidance encouraging an additional order. However, if the user's boarding pass is a commuter pass or the like, the boarding reservation does not need to be changed. Specifically, the guidance output unit 14 outputs a guidance encouraging an additional order and, after the user places an additional order, changes the boarding reservation to a public transportation facility that will minimize the waiting time at the transfer station. Note that the guidance output unit 14 may output a guidance encouraging the user to change the boarding reservation, change the boarding reservation according to the user's input, and then output a guidance encouraging the user to place an additional order. In these cases, the information processing device 10 automatically changes the boarding reservation. Furthermore, the guidance output unit 14 may output a guidance encouraging the user to change the boarding reservation at the same time as the guidance for the additional order. In this case, the user changes the boarding reservation themselves.

[0052] In the information processing system 3, it is desirable that the public transportation used by the user is a railroad or tramway, which allows the user to easily change the public transportation mode they are using. In this case, the passenger facilities of the public transportation are, for example, a railroad station or a tramway station.

[0053] Next, the operation of the information processing system 3 according to the third embodiment will be described. The information processing device 10 according to the third embodiment performs the operations from step S101 to step S111 shown in Fig. 4. In step S106, the guidance output unit 14 performs the processes of step S301 to step S303 as shown in Fig. 6. Fig. 6 is a flowchart showing another example of the operation of the information processing system 3 according to the present disclosure to output guidance based on boarding pass information.

[0054] As shown in FIG. 6 , in step S301, the guidance output unit 14 references the acquired boarding / boarding pass information and timetable information. The timetable information indicates the departure and arrival times of public transportation. Next, in step S302, the guidance output unit 14 determines whether the user can minimize the waiting time at the transfer station by delaying the public transportation they plan to board. If it is determined that the user can minimize the waiting time at the transfer station by delaying the public transportation they plan to board (YES in step S302), the process proceeds to step S303. On the other hand, if it is determined that the user cannot minimize the waiting time at the transfer station by delaying the public transportation they plan to board (NO in step S302), the process ends. In step S303, the guidance output unit 14 outputs a message to the ordering terminal 20 urging the user to place an additional order. Here, the guidance output unit 14 may output information such as the boarding time of the delayed public transportation.

[0055] When a user of public transportation transfers, the information processing device 10 of the information processing system 3 according to the third embodiment outputs a guide encouraging the user to place an additional order, taking into consideration the user's waiting time at the transfer station. Here, there is a possibility that some users do not like waiting at transfer stations. Users who do not like waiting at transfer stations may change their boarding plans and refrain from leaving the store, making them more likely to place an additional order. A store can improve its profits by providing guidance at a time when users are likely to place an additional order, thereby increasing the likelihood that users will place an additional order.

[0056] Fourth Embodiment Next, a configuration of an information processing system 4 (not shown) according to a fourth embodiment will be described. The information processing system 4 is a system that improves store profits using a method different from that of the information processing system 2 according to the second embodiment.

[0057] The information processing system 4 has a configuration similar to that of the information processing system 2 shown in Fig. 2, but has the following additional functions: The guidance output unit 14 of the information processing device 10 of the information processing system 2 acquires boarding pass information linked to face information of the user identified by the identification unit 13 from information registered in the storage unit 16. The guidance output unit 14 outputs guidance based on the acquired boarding pass information to the identified user.

[0058] The guidance output unit 14 of the information processing device 10 of the information processing system 4 outputs, as guidance based on the boarding pass information, guidance encouraging the identified user to place an additional order if the identified user can board less crowded public transportation by delaying the public transportation they are planning to board. Note that the guidance output unit 14 may also output, as guidance based on the boarding pass information, guidance encouraging the identified user to place an additional order if the public transportation they are planning to board is delayed or canceled. The guidance encouraging the identified user to place an additional order may also include guidance that explains why the guidance encouraging the additional order was output. In this embodiment, the guidance encouraging the additional order is output because the user can board less crowded public transportation by delaying the public transportation they are planning to board. For example, the guidance encouraging the additional order includes guidance such as, "By delaying the public transportation you are planning to board, you can board less crowded public transportation. Would you like to place an additional order?"

[0059] Furthermore, the guidance output unit 14 changes the boarding reservation in the user's boarding pass information at the timing when outputting the guidance encouraging an additional order. However, if the user's boarding pass is a commuter pass or the like, the boarding reservation does not need to be changed. Specifically, the guidance output unit 14 outputs a guidance encouraging an additional order and, after the user places an additional order, changes the boarding reservation to a less crowded public transportation facility. Note that the guidance output unit 14 may output a guidance encouraging the user to change the boarding reservation, change the boarding reservation according to the user's input, and then output a guidance encouraging the user to place an additional order. In these cases, the information processing device 10 automatically changes the boarding reservation. Furthermore, the guidance output unit 14 may output a guidance encouraging the user to change the boarding reservation at the same time as the guidance for the additional order. In this case, the user changes the boarding reservation themselves.

[0060] Furthermore, the guidance output unit 14 outputs guidance to the specified user urging him / her to place an additional order, and then, when an additional order is received from the specified user, issues a coupon to the specified user for cooperating in reducing congestion.

[0061] In the information processing system 4, it is desirable that the public transportation used by the user is a railroad or tramway, which allows users to easily change the public transportation they are using. In this case, the passenger facilities of the public transportation are, for example, a railroad station or a tramway station.

[0062] Next, the operation of the information processing system 4 according to the fourth embodiment will be described. The information processing device 10 of the information processing system 4 performs the operations of steps S101 to S111 shown in Fig. 4. In step S106, the guidance output unit 14 performs the processes of steps S401 to S405 as shown in Fig. 7. Fig. 7 is a flowchart showing another example of the operation of the information processing system 4 according to the present disclosure to output guidance based on boarding pass information.

[0063] 7, first, in step S401, the guidance output unit 14 refers to the acquired boarding pass information, timetable information, and operation information. The operation information indicates the degree of congestion, delays, suspensions, etc. of public transportation.

[0064] In step S402, the guidance output unit 14 determines whether the identified user can board less crowded public transportation by delaying the public transportation they plan to board. If it is determined that the identified user can board less crowded public transportation by delaying the public transportation they plan to board (YES in step S402), the processing proceeds to step S403. On the other hand, if it is determined that the identified user cannot board less crowded public transportation by delaying the public transportation they plan to board (NO in step S402), the processing ends.

[0065] In step S402, the guidance output unit 14 may determine whether or not there is a delay or cancellation in the public transportation that the identified user plans to board. If it is determined that there is a delay or cancellation in the public transportation that the identified user plans to board (YES in step S402), the processing proceeds to step S403. On the other hand, if it is determined that there is no delay or cancellation in the public transportation that the identified user plans to board (NO in step S402), the processing ends.

[0066] In step S403, the guidance output unit 14 outputs a message urging the customer to place an additional order to the ordering terminal 20. At this time, the guidance output unit 14 may output information such as the delayed boarding time of the public transportation.

[0067] Next, the guidance output unit 14 determines whether an additional order was accepted from the user at the ordering terminal 20 before leaving the store. If it is determined that an additional order was accepted from the user at the ordering terminal 20 before leaving the store (YES in step S404), the process proceeds to step S405. On the other hand, if it is determined that an additional order was not accepted from the user at the ordering terminal 20 before leaving the store (NO in step S404), the process ends. In step S405, a coupon that can be used at the store next time is issued to the identified user as a token of cooperation in reducing congestion.

[0068] The information processing device 10 of the information processing system 4 according to the fourth embodiment outputs a guide encouraging a user to place an additional order, taking into consideration the congestion of the public transportation used by the user. Here, there is a possibility that some users do not like crowded public transportation. A user who does not like crowded public transportation may change their travel plans and not leave the store, making them more likely to place an additional order. A store can improve its profits by providing a guide at a time when the user is likely to place an additional order, thereby increasing the likelihood that the user will place an additional order.

[0069] Furthermore, the information processing device 10 of the information processing system 4 according to the fourth embodiment outputs a guide to encourage a user to place an additional order, taking into consideration delays or cancellations of public transportation used by the user. When public transportation is delayed or canceled, the user must wait at the platform. If the user is aware of such a situation, they may refrain from leaving the store and be more likely to accept an additional order. The store can improve its profits by providing guidance at a time when the user is likely to accept an additional order, thereby increasing the likelihood that the user will place an additional order.

[0070] Furthermore, when the information processing device 10 of the information processing system 4 according to the fourth embodiment accepts an additional order, it issues a coupon as a token of cooperation in reducing congestion. This leads to improved user satisfaction, and the store can increase its profits by increasing the likelihood that users will visit the store in the future.

[0071] Fifth Embodiment Next, a configuration of an information processing system 5 (not shown) according to a fifth embodiment will be described. The information processing system 5 is a system that improves store profits using a method different from that of the information processing system 2 according to the second embodiment.

[0072] The information processing system 5 has a configuration similar to that of the information processing system 2 shown in Fig. 2, but has the following additional functions: The guidance output unit 14 of the information processing device 10 of the information processing system 2 acquires boarding pass information linked to face information of the user identified by the identification unit 13 from information registered in the storage unit 16. The guidance output unit 14 outputs guidance based on the acquired boarding pass information to the identified user.

[0073] The guidance output unit 14 of the information processing device 10 of the information processing system 5 outputs guidance based on boarding pass information to the specified user, such as a guidance suggesting a stopover along the way, when the specified user is using a commuter pass. The guidance suggesting a stopover along the way is, for example, a guidance for a leisurely trip with stopovers along the way.

[0074] In the information processing system 5, it is desirable that the public transportation used by the user is a railway or tramway, which is easy to use a commuter pass for. In this case, the passenger facilities of the public transportation are, for example, a railway station or a tramway station.

[0075] Next, the operation of the information processing system 4 according to the fifth embodiment will be described. The information processing device 10 of the information processing system 5 performs the operations of steps S101 to S111 shown in Fig. 4. In step S106, the guidance output unit 14 performs the processes of steps S501 to S503 as shown in Fig. 8. Fig. 8 is a flowchart showing another example of the operation of the information processing system 5 according to the present disclosure to output guidance based on boarding pass information.

[0076] As shown in Fig. 8, first, in step S501, the guidance output unit 14 refers to the acquired boarding pass information. Next, in step S502, the guidance output unit 14 determines whether the identified user is using a commuter pass. If it is determined that the identified user is using a commuter pass (YES in step S502), the process proceeds to step S503. On the other hand, if it is determined that the identified user is not using a commuter pass (NO in step S502), the process ends. In step S503, the guidance output unit 14 outputs guidance to the order terminal 20 suggesting that the user get off the train midway.

[0077] When the identified user is using a commuter pass, the information processing device 10 of the information processing system 5 according to the fifth embodiment outputs a guide suggesting that the user get off the train along the way. This leads to an improvement in user satisfaction, and the store can increase profits by increasing the likelihood that the user will visit the store in the future.

[0078] <Hardware configuration> Each configuration of the information processing device 10 and the information processing device 100 in the above-described embodiment is configured by hardware or software, or both, and may be configured by one piece of hardware or software, or may be configured by multiple pieces of hardware or software.

[0079] Specifically, each of the information processing devices 10 and 100 in the above-described embodiment is configured by a computer including a processor 1001 and a memory 1002. FIG. 9 is a block diagram showing an example of the configuration of the computer 1000 according to this embodiment. As shown in FIG. 9, the processor 1001 may be, for example, a microprocessor, a microprocessing unit (MPU), or a central processing unit (CPU). The processor may include multiple processors. The memory 1002 is configured by a combination of volatile memory and nonvolatile memory. The memory 1002 may include storage located remotely from the processor. In this case, the processor 1001 may access the memory via an I / O interface (not shown). The processor 1001 executes one or more programs including instructions for causing the computer to execute the algorithms described using the drawings.

[0080] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0081] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0082] Each drawing is merely an example for describing one or more embodiments. Each drawing may not relate to only one particular embodiment, but may also relate to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0083] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes: (Supplementary Note 1) An information processing device comprising: registration means for linking and registering facial information of a user with boarding pass information for a public transportation system used by the user; facial information acquisition means for acquiring the facial information of the user when the user places an order at a store in a passenger facility of the public transportation system; identification means for identifying the user by facial recognition using the registered information and the acquired facial information of the user; and guidance output means for acquiring boarding pass information linked to the identified user's facial information from the registered information, and outputting guidance based on the acquired boarding pass information to the identified user, wherein the guidance output means outputs, as guidance based on the boarding pass information, guidance to the identified user encouraging them to place an additional order if there is more than a predetermined time between the current time and the boarding time. The information processing device of Supplementary Note 1 further comprises: (Supplementary Note 2) The information processing device of Supplementary Note 1, wherein the registration means further links and registers the user's facial information with payment method identification information, which is information for identifying the user's payment method; and when the user leaves the store, further comprising payment processing means for acquiring the payment method identification information linked to the identified user's facial information from the registered information, and processing payment for the order based on the acquired payment method identification information. (Supplementary Note 3) The information processing device of Supplementary Note 1, wherein the facial information acquisition means acquires the user's facial information based on an image captured by a camera installed in a seat in the store when the user places an order using a terminal installed in a seat in the store; and the guidance output means outputs guidance based on the acquired boarding / boarding pass information to the terminal. (Supplementary Note 4) The information processing device of Supplementary Note 1, wherein the guidance output means outputs, as guidance based on the boarding / boarding pass information, at least one of a message that the boarding / boarding time is approaching and a message about the boarding / boarding location to the identified user when there is less than a predetermined time between the current time and the boarding / boarding time.(Supplementary Note 5) The information processing device according to Supplementary Note 1, wherein the guidance output means outputs, as guidance based on the boarding pass information, guidance to the specified user encouraging the specified user to place an additional order if delaying the public transportation the specified user is planning to board will minimize the waiting time the specified user has at a transfer station. (Supplementary Note 6) The information processing device according to Supplementary Note 1, wherein the guidance output means outputs, as guidance based on the boarding pass information, guidance to the specified user encouraging the specified user to place an additional order if delaying the public transportation the specified user is planning to board will allow the specified user to board less crowded public transportation. (Supplementary Note 7) The information processing device according to Supplementary Note 6, wherein the guidance output means, after outputting the guidance encouraging the specified user to place the additional order, if the additional order is accepted from the specified user, issues a coupon to the specified user for cooperating in easing congestion. (Supplementary Note 8) The information processing device according to Supplementary Note 1, wherein the guidance output means outputs, as guidance based on the boarding pass information, guidance to the specified user suggesting the specified user to get off midway if the specified user is using a commuter pass. (Supplementary Note 9) The information processing device according to Supplementary Note 1, wherein the guidance output means outputs, as guidance based on the boarding / passport information, guidance to the specified user urging them to place an additional order when there is a delay or cancellation in public transportation that the specified user is planning to board. (Supplementary Note 10) The information processing device according to Supplementary Note 1, wherein the guidance output means outputs, as guidance based on the boarding / passport information, guidance to the specified user about stores other than the store when there is a predetermined time or more from the current time until the boarding / boarding time.(Supplementary Note 11) An information processing method in which a computer links and registers facial information of a user with boarding pass information for public transportation used by the user, acquires the facial information of the user when the user places an order at a store in a passenger facility of the public transportation, identifies the user through facial recognition using the registered information and the acquired facial information of the user, acquires boarding pass information linked to the facial information of the identified user from the registered information, and outputs guidance based on the acquired boarding pass information to the identified user, and outputs guidance based on the boarding pass information to the identified user, if there is more than a predetermined time between the current time and the boarding time, to encourage the identified user to place an additional order as guidance based on the boarding pass information. (Supplementary Note 12) The information processing method of Supplementary Note 11, further linking and registering the user's facial information with payment method identification information, which is information for identifying the user's payment method, and when the user leaves the store, obtaining the payment method identification information linked to the identified user's facial information from the registered information, and processing the payment for the order based on the obtained payment method identification information. (Supplementary Note 13) The information processing method of Supplementary Note 11, when the user places an order using a terminal installed in a seat in the store, obtaining the user's facial information based on an image captured by a camera installed in a seat in the store, and outputting guidance based on the obtained boarding / boarding pass information to the terminal. (Supplementary Note 14) The information processing method of Supplementary Note 11, further linking and registering the user's facial information with payment method identification information, which is information for identifying the user's payment method, and when the user places an order using a terminal installed in a seat in the store, obtaining the user's facial information based on an image captured by a camera installed in a seat in the store, and outputting guidance based on the obtained boarding / boarding pass information to the terminal. (Supplementary Note 15) The information processing method described in Supplementary Note 11, wherein, as a guidance based on the boarding pass information, a guidance urging the identified user to place an additional order is output to the identified user if delaying the public transportation that the identified user plans to board will minimize the waiting time of the identified user at the transfer station.(Supplementary Note 16) The information processing method of Supplementary Note 11, wherein, as guidance based on the boarding pass information, if the specified user can board less crowded public transportation by delaying the public transportation that the specified user is planning to board, a guidance encouraging the specified user to place an additional order is output to the specified user. (Supplementary Note 17) The information processing method of Supplementary Note 16, wherein, if the additional order is accepted from the specified user after the guidance encouraging the additional order has been output to the specified user, a coupon is issued to the specified user for cooperation in alleviating congestion. (Supplementary Note 18) The information processing method of Supplementary Note 11, wherein, as guidance based on the boarding pass information, if the specified user is using a commuter pass, a guidance suggesting that the specified user get off along the way is output to the specified user. (Supplementary Note 19) The information processing method of Supplementary Note 11, wherein, as guidance based on the boarding pass information, if the public transportation that the specified user is planning to board is delayed or canceled, a guidance encouraging the specified user to place an additional order is output to the specified user. (Supplementary Note 20) The information processing method according to Supplementary Note 11, wherein, as guidance based on the boarding pass information, guidance for a store other than the store is output to the specified user if there is a predetermined time or more from the current time until the boarding / boarding time. (Supplementary Note 21) A program that causes a computer to execute the processes of linking and registering face information of a user with boarding / boarding pass information for a public transportation system used by the user, acquiring the face information of the user when the user places an order at a store in a passenger facility of the public transportation system, identifying the user by face recognition using the registered information and the acquired face information of the user, acquiring boarding / boarding pass information linked to the face information of the specified user from the registered information, and outputting guidance based on the acquired boarding / boarding pass information to the specified user, and, as guidance based on the boarding / boarding pass information, outputting guidance to the specified user encouraging them to place an additional order if there is a predetermined time or more from the current time until the boarding / boarding time.(Supplementary Note 22) The program according to Supplementary Note 21, further causing a computer to execute a process of registering the user's facial information in association with payment method identification information, which is information for identifying the user's payment method, and, when the user leaves the store, acquiring the payment method identification information associated with the identified user's facial information from the registered information, and processing payment for the order based on the acquired payment method identification information. (Supplementary Note 23) The program according to Supplementary Note 21, further causing a computer to execute a process of acquiring the user's facial information based on an image captured by a camera installed in a seat in the store when the user places an order using a terminal installed in a seat in the store, and outputting guidance based on the acquired boarding / boarding pass information to the terminal. (Supplementary Note 24) The program according to Supplementary Note 21, further causing a computer to execute a process of outputting to the identified user, as guidance based on the boarding / boarding pass information, at least one of a guidance that the boarding / boarding time is approaching and guidance on the boarding / boarding location, if a predetermined time is less than the current time until the boarding / boarding time. (Supplementary Note 25) The program according to Supplementary Note 21, further causing a computer to execute a process of outputting, as guidance based on the boarding pass information, guidance to the specified user urging them to place an additional order, if delaying the public transportation that the specified user plans to board will minimize the waiting time of the specified user at a transfer station. (Supplementary Note 26) The program according to Supplementary Note 21, further causing a computer to execute a process of outputting, as guidance based on the boarding pass information, guidance to the specified user urging them to place an additional order, if delaying the public transportation that the specified user plans to board will allow the specified user to board less crowded public transportation. (Supplementary Note 27) The program according to Supplementary Note 26, further causing a computer to execute a process of issuing a coupon to the specified user for cooperating in alleviating congestion, if the additional order is received from the specified user after outputting the guidance to the specified user urging them to place an additional order.(Supplementary Note 28) The program according to Supplementary Note 21, further causing a computer to execute a process of outputting, as guidance based on the boarding pass information, guidance to the specified user suggesting that the specified user get off along the way, if the specified user is using a commuter pass. (Supplementary Note 29) The program according to Supplementary Note 21, further causing a computer to execute a process of outputting, as guidance based on the boarding pass information, guidance to the specified user urging them to place an additional order, if there is a delay or cancellation in the public transportation that the specified user is planning to use. (Supplementary Note 30) The program according to Supplementary Note 21, further causing a computer to execute a process of outputting, as guidance based on the boarding pass information, guidance for stores other than the store, to the specified user, if there is a predetermined time or more from the current time until the boarding / boarding time.

[0084] 2 to 5 Information processing system 10 Information processing device 11 Registration unit 12 Face information acquisition unit 13 Identification unit 14 Guidance output unit 15 Payment processing unit 16 Storage unit 20 Order terminal 30 First camera 40 Second camera 100 Information processing device 101 Registration unit (registration means) 102 Face information acquisition unit (face information acquisition means) 103 Identification unit (identification means) 104 Guidance output unit (guide output means) 1000 Computer 1001 Processor 1002 Memory

Claims

1. An information processing device comprising: a registration means for linking and registering a user's facial information with boarding pass information for public transportation used by the user; a facial information acquisition means for acquiring the user's facial information when the user places an order at a store in a passenger facility of the public transportation; an identification means for identifying the user by facial recognition using the registered information and the acquired user's facial information; and a guidance output means for acquiring boarding pass information linked to the identified user's facial information from the registered information, and outputting guidance based on the acquired boarding pass information to the identified user, wherein the guidance output means outputs guidance to the identified user encouraging them to place an additional order as guidance based on the boarding pass information when there is a predetermined time or more between the current time and the boarding time.

2. The information processing device of claim 1, further comprising a payment processing means for registering the user's facial information in association with payment method identification information, which is information for identifying the user's payment method, and for acquiring the payment method identification information linked to the identified user's facial information from the registered information when the user leaves the store, and for processing payment for the order based on the acquired payment method identification information.

3. The information processing device according to claim 1, wherein the facial information acquisition means acquires facial information of the user based on an image captured by a camera installed on a seat in the store when the user places an order using a terminal installed on a seat in the store, and the guidance output means outputs guidance to the terminal based on the acquired boarding / boarding pass information.

4. The information processing device of claim 1, wherein the guidance output means outputs, as guidance based on the boarding / boarding pass information, at least one of a guidance to the identified user that the boarding / boarding time is approaching and a guidance of the boarding / boarding location if there is less than a predetermined time from the current time to the boarding / boarding time.

5. The information processing device of claim 1, wherein the guidance output means outputs, as guidance based on the boarding / pass information, guidance to the identified user encouraging the user to place an additional order if delaying the planned public transportation means will minimize the waiting time of the identified user at the transfer station; or, as guidance based on the boarding / pass information, outputs, as guidance based on the boarding / pass information, guidance to the identified user encouraging the user to place an additional order if delaying the planned public transportation means will enable the identified user to board a public transportation means that is not crowded.

6. The information processing device according to claim 5, wherein the guidance output means outputs the guidance encouraging the identified user to place an additional order, and then, if the additional order is accepted from the identified user, issues a coupon to the identified user as a reward for cooperating in alleviating congestion.

7. The information processing device according to claim 1, wherein the guidance output means outputs guidance to the identified user, based on the boarding / boarding pass information, such as guidance suggesting that the identified user get off at an intermediate station if the identified user is using a commuter pass.

8. The information processing device according to claim 1, wherein the guidance output means outputs, as guidance based on the boarding / boarding pass information, guidance to the identified user encouraging the user to make an additional order if there is a delay or cancellation in the public transportation that the identified user plans to board.

9. An information processing method in which a computer links and registers facial information of a user with boarding pass information for public transportation used by the user, acquires the facial information of the user when the user places an order at a store in a passenger facility of the public transportation, identifies the user through facial recognition using the registered information and the acquired facial information of the user, acquires boarding pass information linked to the facial information of the identified user from the registered information, and outputs guidance based on the acquired boarding pass information to the identified user, and outputs guidance to the identified user based on the boarding pass information, if there is a predetermined time or more between the current time and the boarding time, a guidance encouraging the identified user to place an additional order as guidance based on the boarding pass information.

10. A program that causes a computer to execute the following processes: linking and registering a user's facial information with boarding pass information for public transportation used by the user; acquiring the user's facial information when the user places an order at a store in a passenger facility of the public transportation; identifying the user through facial recognition using the registered information and the acquired user's facial information; acquiring boarding pass information linked to the identified user's facial information from the registered information; outputting guidance based on the acquired boarding pass information to the identified user; and outputting guidance to the identified user encouraging them to place an additional order as guidance based on the boarding pass information if there is more than a predetermined time between the current time and the boarding time.

Images