Information processing device, information processing system, information processing method, and information processing program

Abstract

An information processing device (10) comprises: a collection unit (11) that collects an action history of a user (U) performed online on a website that includes merchandise; a registration unit (12) that registers the action history in association with a user ID of the user (U); an acquisition unit (13) that acquires biometric information about the user (U) obtained at a real store (RS) visited by the user (U) from a store terminal (20) provided to the real store (RS); an identification unit (14) that identifies the user ID of the user (U) by controlling biometric authentication on the basis of the biometric information; and an output means (15) that outputs the action history associated with the user ID to the store terminal (20) when the biometric authentication is successful.

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium. [Background technology]

[0002] There is a demand for increasing sales of cosmetics in brick-and-mortar stores. For example, Patent Document 1 describes a system in which face-to-face counseling is conducted with a salesperson in a brick-and-mortar store, and products recommended to a purchaser are sold based on the results of the counseling. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2021-015433 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the system of Patent Document 1, the selection of recommended products to be recommended to a purchaser depends heavily on the experience of the salesperson who provides counseling, and there are cases where doubts arise as to whether the products are truly satisfactory to the purchaser. It is desirable to enable purchasers to make a purchase in a real store with a satisfactory result, thereby improving sales of cosmetics in the real store.

[0005] In view of the above-mentioned problems, an object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that can improve product sales in physical stores. [Means for solving the problem]

[0006] An information processing device according to one aspect of the present disclosure includes: A collection means for collecting a history of a user's online actions on a website including a product; A registration means for registering the behavior history in association with a user ID of the user; An acquisition means for acquiring biometric information of the user acquired at a physical store visited by the user from a store terminal installed at the physical store; an identification means for identifying the user ID of the user by controlling biometric authentication based on the biometric information; an output means for outputting the action history associated with the user ID to the store terminal when the biometric authentication is successful; Equipped with.

[0007] An information processing system according to one aspect of the present disclosure includes: A store terminal installed in a physical store, an information processing device connected to the store terminal via a wireless or wired communication line; Equipped with The information processing device includes: A collection means for collecting a history of a user's online actions on a website including a product; A registration means for registering the behavior history in association with a user ID of the user; An acquisition means for acquiring biometric information of the user acquired at a physical store visited by the user from the store terminal; an identification means for identifying the user ID of the user by controlling biometric authentication based on the biometric information; an output means for outputting the action history associated with the user ID to the store terminal when the biometric authentication is successful; has.

[0008] An information processing method according to one aspect of the present disclosure includes: Collecting the user's online behavior history on websites that contain products, The behavior history is registered in association with a user ID of the user; The biometric information of the user acquired at a physical store visited by the user is obtained from a store terminal installed at the physical store; Identifying the user ID of the user by controlling biometric authentication based on the biometric information; If the biometric authentication is successful, the behavior history associated with the user ID is output to the store terminal.

[0009] According to one aspect of the present disclosure, there is provided a non-transitory computer readable medium, comprising: A step of collecting a history of online user actions on a website including the product; A step of registering the behavior history in association with a user ID of the user; A step of obtaining the biometric information of the user acquired at a physical store visited by the user from a store terminal installed at the physical store; a step of identifying the user ID of the user by controlling biometric authentication based on the biometric information; When the biometric authentication is successful, outputting the behavior history associated with the user ID to the store terminal; An information processing program that causes a computer to execute the above is stored. Effect of the Invention

[0010] The present disclosure makes it possible to provide an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium that can improve product sales in physical stores. [Brief description of the drawings]

[0011] [Figure 1] 1 is a configuration diagram illustrating an information processing system according to a first embodiment. [Diagram 2] 1 is a block diagram illustrating an information processing device according to a first embodiment. [Diagram 3] 2 is a diagram illustrating an example of a user's behavior history collected by a collection unit of the information processing device according to the first embodiment. FIG. [Figure 4] 10 is a diagram illustrating an example of a registration screen displayed on a user terminal when a registration unit of the information processing device according to the first embodiment registers a user. FIG. [Diagram 5] 10 is a diagram illustrating an example of a registration screen displayed on a user terminal when a registration unit of the information processing device according to the first embodiment registers a user. FIG. [Figure 6] 11 is a diagram illustrating an example of a display screen displayed on a store terminal when an output unit of the information processing device according to the first embodiment outputs to the store terminal a behavior history, user information, and product information associated with the user information. FIG. [Figure 7] 3 is a flowchart illustrating an information processing method according to the first embodiment. [Figure 8] FIG. 11 is a block diagram illustrating an information processing device according to a second embodiment. [Figure 9] FIG. 11 is a diagram illustrating an example of a reservation screen displayed on a user terminal when a reservation notification unit of the information processing device according to the second embodiment accepts a reservation. [Figure 10] FIG. 11 is a diagram illustrating an example of a reservation completion screen displayed on the user terminal when a reservation notification unit of the information processing device according to the second embodiment notifies the user terminal of the completion of the reservation. [Figure 11] FIG. 11 is a diagram illustrating an example of a reservation status screen displayed on the store terminal when a reservation notification unit of the information processing device according to the second embodiment is notified of reservation completion from the store terminal. [Figure 12] FIG. 11 is a flowchart illustrating an information processing method according to the second embodiment. [Figure 13] FIG. 11 is a flowchart illustrating a reservation notification method according to the second embodiment. [Figure 14] FIG. 11 is a block diagram illustrating an information processing device according to a third embodiment. [Figure 15] FIG. 11 is a diagram illustrating a purchase screen displayed on a store terminal when a purchase acceptance unit of an information processing device according to a third embodiment accepts a purchase of a product from the store terminal. [Figure 16] FIG. 11 is a flowchart illustrating an information processing method according to a third embodiment. [Figure 17]FIG. 11 is a configuration diagram illustrating an information processing system according to a fourth embodiment. [Figure 18] FIG. 11 is a block diagram illustrating an information processing device according to a fourth embodiment. [Figure 19] FIG. 13 is a block diagram illustrating a store terminal according to a fourth embodiment. [Figure 20] FIG. 13 is a block diagram showing a configuration of a user terminal according to the fourth embodiment. [Figure 21] FIG. 11 is a block diagram showing the configuration of a face recognition device according to a fourth embodiment. [Figure 22] 13 is a flowchart showing the flow of face information registration processing according to the fourth embodiment. [Figure 23] 13 is a flowchart showing the flow of face recognition processing according to the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and duplicated descriptions will be omitted as necessary for clarity of explanation.

[0013] (Embodiment 1) An information processing system according to the first embodiment will be described. FIG. 1 is a configuration diagram illustrating an information processing system according to the first embodiment. As shown in FIG. 1, the information processing system 1 includes an information processing device 10 and a store terminal 20. The store terminal 20 is provided in a real store RS. The real store RS is also called a real store. The real store RS is a store that actually exists. The information processing device 10 is connected to the store terminal 20 via a wireless or wired communication line. For example, the information processing device 10 is connected to the store terminal 20 via a network NW. The network NW does not matter whether it is a wireless or wired communication line, and does not matter what type of communication protocol it uses. The information processing device 10 may be connected to each store terminal 20 of a plurality of real stores RS. The store terminal 20 may be an information terminal such as a personal computer, or may be a mobile terminal such as a smartphone or tablet carried by a salesperson P of the real store RS.

[0014] The information processing device 10 may be connected to a user terminal 30 used by a user U via a wireless or wired communication line. For example, the user terminal 30 may be connected to the information processing device 10 via a network NW. The user terminal 30 includes, for example, a mobile terminal such as a smartphone or a tablet, and a personal computer. The user U obtains information about a product he or she wishes to purchase online from a website that includes the product.

[0015] Furthermore, the information processing device 10 may be connected to the biometric authentication device 40 via a wireless or wired communication line. For example, the biometric authentication device 40 may be connected to the information processing device 10 via a network NW. The biometric authentication device 40 identifies the user U from the biometric information of the user U. The biometric information is, for example, a face image. In that case, the biometric authentication device 40 is a face authentication device 41. Note that the biometric information is not limited to a face image, and may be fingerprint information, palm print information, retina information, iris information, vein information, voiceprint information, or the like, as long as it can identify the user U.

[0016] Fig. 2 is a block diagram illustrating an information processing device 10 according to the first embodiment. As shown in Fig. 2, the information processing device 10 is separated from the information processing system 1 and becomes a standalone product. The information processing device 10 includes a collection unit 11, a registration unit 12, an acquisition unit 13, an identification unit 14, and an output unit 15. The collection unit 11, the registration unit 12, the acquisition unit 13, the identification unit 14, and the output unit 15 each have the functions of a collection means, a registration means, an acquisition means, an identification means, and an output means.

[0017] The collection unit 11 collects the user U's online behavior history on a website that includes products. The products are, for example, cosmetics. Note that the products are not limited to cosmetics, as long as the user U can receive advice on the use of the products when purchasing the products at the real store RS and the products can be purchased at the real store RS or the website.

[0018] When the user U accesses a website for a product such as cosmetics via the user terminal 30, the user U logs in using, for example, a user ID. Then, the user U obtains information about the product online from the website that includes the product.

[0019] FIG. 3 is a diagram illustrating an example of the behavior history of a user U collected by the collection unit 11 of the information processing device 10 according to the first embodiment. As shown in FIG. 3, for example, the user U purchases lipstick (red A) on a website related to the sale of lipstick, and browses the makeup method for the lipstick (red A) on a website related to makeup methods. The user U also browses the makeup method for the lipstick (pink A) on a website related to makeup methods, and diagnoses the lipstick (pink A) on a website related to makeup diagnosis. The image in this case is updated on the website. The user U also requests a sample of the lipstick (pink A) on a website related to trials. In addition, the user U may receive a proposal of a makeup method and cosmetics that match the user U's face, skin, face shape, hairstyle, and clothes on a website including cosmetics, or may virtually try and purchase cosmetics on the website. In this way, the user U can easily try cosmetics and makeup methods that suit him / herself from a large number of cosmetics on the website. The collection unit 11 collects the behavior history of the user U on the website logged in using a user ID.

[0020] When registering the user U, the registration unit 12 registers the user information input by the user in advance in the storage device together with the user ID.

[0021] 4 and 5 are diagrams illustrating a registration screen displayed on the user terminal 30 when the registration unit 12 of the information processing device 10 according to the first embodiment registers the user U. As shown in FIG. 4, the registration screen displayed on the user terminal 30 has an input field for inputting user information. The user information includes attribute information of the user U, such as the name, age, sex, address, contact information, and payment information of the user U. The attribute information of the user U may also include date of birth, occupation, educational background, hometown, and the like. The user information also includes biometric information such as a facial image of the user U. Furthermore, as shown in FIG. 5, the user information may also include information indicating the preferences of the user U, such as favorite colors, disliked colors, favorite clothing brands, favorite seasons, and matters of interest. The registration unit 12 registers the user information input by the user U in association with the user ID of the user U.

[0022] The registration unit 12 may also register product information associated with the user information. Specifically, for example, the registration unit 12 may classify popular products by generation, occupation, educational background, and hometown in advance and store them in the storage device. For example, the registration unit 12 may also classify products preferred by people with various tastes in advance and store them in the storage device. In this way, the product information associated with the user information includes products that are popular among people of the same generation, occupation, educational background, and hometown as the user U.

[0023] In addition, the registration unit 12 registers the behavior history of the user U collected by the collection unit 11 in association with the user ID. Thus, the behavior history collected by the collection unit 11 is associated with the user ID together with the user information and the product information associated with the user information.

[0024] The acquisition unit 13 acquires biometric information of the user U acquired at the real store RS visited by the user U from the store terminal 20. The real store RS has a biometric information acquisition device BM. A face image will be used as an example of the biometric information. Therefore, an image acquisition device 21 will be used as an example of the biometric information acquisition device BM.

[0025] The image acquisition device 21 is connected to the store terminal 20 via a wireless or wired communication line. The image acquisition device 21 may utilize the camera function of the store terminal 20. For example, the camera of the store terminal 20 may function as the image acquisition device 21. The image acquisition device 21 acquires a facial image of the user U when the user U visits the real store RS. The image acquisition device 21 outputs the acquired facial image to the store terminal 20. The store terminal 20 outputs the acquired facial image to the information processing device 10. In this way, the acquisition unit 13 acquires the facial image of the user U from the store terminal 20.

[0026] The identification unit 14 identifies the user ID of the user U by controlling biometric authentication based on the biometric information. Specifically, the identification unit 14 identifies the user ID of the user U by having the biometric authentication device 40 perform biometric authentication using the biometric information. When the biometric information is a face image, the biometric authentication device 40 is a face authentication device 41. The identification unit 14 outputs the face image acquired by the acquisition unit 13 to the face authentication device 41. The face authentication device 41 acquires a face image acquired in the real store RS and performs face authentication using the face image. As a result, the face authentication device 41 identifies the user ID. When the face authentication device 41 identifies the user ID, it outputs the user ID to the information processing device 10. As a result, the identification unit 14 identifies the user ID of the user U. In this way, when the user U visits the real store RS, the face image of the user U is transmitted to the face authentication device 41 via the store terminal 20 and the information processing device 10, and face authentication is performed.

[0027] When the biometric authentication is successful, the output unit 15 outputs the behavior history associated with the user ID. The output unit 15 may output at least one of the user information of the user U and the product information associated with the user information to the store terminal 20 in addition to the behavior history. FIG. 6 is a diagram illustrating a display screen displayed on the store terminal 20 when the output unit 15 of the information processing device 10 according to the first embodiment outputs the behavior history, the user information, and the product information associated with the user information to the store terminal 20. As shown in FIG. 6, when the user U visits the real store RS, the store terminal 20 displays the behavior history, the user information, and the product information associated with the user information of the user U, etc. Therefore, the salesperson P of the real store RS can grasp the product in which the user U is interested from various information associated with the user ID, and can make a more accurate product suggestion.

[0028] The information processing device 10 described above is, for example, an information processing device such as a server. The information processing device 10 may include a processor, a memory, and a storage device as components not shown. The storage device may store the processes performed by each component of the information processing device 10 as a program. The processor may load the program from the storage device into the memory and execute the program. In this way, the processor realizes the functions of the collection unit 11, the registration unit 12, the acquisition unit 13, the identification unit 14, and the output unit 15.

[0029] Each of the components of the information processing device 10 may be realized by dedicated hardware. Also, some or all of the components may be realized by general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. Some or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and programs. Also, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a quantum processor (quantum computer control chip), etc. may be used as the processor.

[0030] Furthermore, when some or all of the components of the information processing device 10 are realized by a plurality of information processing devices, circuits, etc., the plurality of information processing devices, circuits, etc. may be centrally arranged or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, etc., in a form in which each is connected via a communication network. Furthermore, the functions of the information processing device 10 may be provided in a SaaS (Software as a Service) format.

[0031] Next, an information processing method performed by the information processing device 10 will be described with reference to a flowchart. Fig. 7 is a flowchart illustrating an information processing method according to the first embodiment. As shown in step S11 of Fig. 7, first, a behavior history of the user U is collected. For example, the collection unit 11 of the information processing device 10 is caused to collect a behavior history of the user U performed online on a website including products.

[0032] Next, as shown in step S12, the behavior history is registered in association with the user ID of the user U. For example, the registration unit 12 is caused to register the behavior history of the user U on a website including the product in association with the user ID of the user U.

[0033] Next, as shown in step S13, biometric information of the user U who has visited the real store RS is obtained from the store terminal 20. For example, the obtaining unit 13 is caused to obtain, from the store terminal 20, biometric information (such as a face image) of the user U acquired at the real store RS that the user U has visited.

[0034] Next, as shown in step S14, the user ID is identified based on the biometric information. For example, the identification unit 14 is caused to identify the user ID of the user by controlling biometric authentication based on the biometric information (such as a face image).

[0035] Next, as shown in step S15, the behavior history is output to the store terminal 20. For example, when the biometric authentication is successful, the output unit 15 is caused to output the behavior history associated with the user ID to the store terminal 20. Note that the output unit 15 may be caused to output the user information and the product information associated with the user information to the store terminal 20 in addition to the behavior history.

[0036] Next, the effect of this embodiment will be described. In this embodiment, the information processing device 10 outputs the user U's online behavior history on a website including a product to the store terminal 20 in response to the user U performing biometric authentication when visiting the store. Thus, the user U can obtain and try product information on the website, and then purchase the product at the real store RS. In addition, the salesperson P at the real store RS can recommend a product that reflects the user U's behavior history to the user U. By combining such online behavior history with the product recommendation at the real store RS, the user U is convinced and purchases the product recommended by the salesperson P. Thus, the sales of the real store RS can be improved. In addition, the user U becomes a repeat customer of the real store RS by obtaining a sense of satisfaction, and the sales of the real store RS can be further improved. For example, it is possible to capture customers from the light layer who have just started using cosmetics, and improve sales.

[0037] In particular, when the product is a cosmetic, the user U tends to want to incorporate not only what he or she is satisfied with, but also the opinions of others on whether it looks good on the user or not, and the latest trends. In this embodiment, the user U can collect information online and purchase cosmetics after taking into account the opinions of the salesperson P at the real store RS, which can improve the sense of satisfaction. Furthermore, the information processing device 10 causes the store terminal 20 to output the user information and the product information associated with the user information in addition to the behavior history. The product information associated with the user information includes products that are popular among at least people of the same generation, occupation, educational background, and place of origin as the user. Therefore, even if the salesperson P has little experience, he or she can recommend products that match the latest trends to the user U, which can improve the sense of satisfaction of the user U.

[0038] (Embodiment 2) Next, an information processing device according to a second embodiment will be described. The information processing device of this embodiment further includes a reservation notification unit that accepts a reservation for a user U to visit a real store RS and notifies a store terminal 20 of the reservation. FIG. 8 is a block diagram illustrating an information processing device according to a second embodiment. As shown in FIG. 8, the information processing device 10a further includes a reservation notification unit 16. The reservation notification unit 16 has a function as a reservation notification means. When a user U visits the real store RS, the user U accesses the information processing device from a user terminal 30 on a website. 10a Make a reservation at.

[0039] 9 is a diagram illustrating a reservation screen displayed on the user terminal 30 when the reservation notification unit 16 of the information processing device 10a according to the second embodiment accepts a reservation. As shown in FIG. 9, the reservation notification unit 16 of the information processing device 10a accepts a reservation from the user terminal 30. Note that the reservation notification unit 16 may obtain available reservation times from the store terminal 20 in advance. Then, the reservation notification unit 16 may allow the user U to select a reservation time from the available reservation times.

[0040] The reservation notification unit 16 notifies the store terminal 20 of the reservation from user U. When the store terminal 20 accepts a reservation from user U, it checks whether the reservation time is available. If the reservation time is available, the store terminal 20 accepts the reservation. In this case, the store terminal 20 notifies the reservation notification unit 16 of the information processing device 10 that the reservation has been completed. As a result, the reservation notification unit 16 notifies the user terminal 30 that the reservation has been completed. Note that information on the reservation of user U to visit the real store RS and the products handled at the real store RS during the visit may be collected by the collection unit 11 as the user U's behavioral history and registered by the registration unit 12.

[0041] Fig. 10 is a diagram illustrating a reservation completion screen displayed on the user terminal 30 when the reservation notification unit 16 of the information processing device 10a according to embodiment 2 notifies the user terminal 30 of the completion of the reservation. As shown in Fig. 10, when the reservation notification unit 16 notifies the user terminal 30 of the completion of the reservation, the user terminal 30 displays the name of the real store RS for which the reservation has been made and the reservation date and time.

[0042] Fig. 11 is a diagram illustrating a reservation status screen displayed on the store terminal 20 when the reservation notification unit 16 of the information processing device 10a according to the second embodiment is notified of the completion of the reservation by the store terminal 20. As shown in Fig. 11, the store terminal 20 notifies the reservation notification unit 16 of the completion of the reservation and displays the reservation status of the real store RS.

[0043] If the reservation time desired by the user U is not available and the reservation from the user U cannot be accepted, the store terminal 20 notifies the reservation notification unit 16 of the information processing device 10a to make a new reservation. At that time, the store terminal 20 may notify a time when the reservation is available.

[0044] Next, a method for making a reservation by the user U at the real store RS described above will be described using a flowchart. FIG. 12 is a flowchart illustrating an information processing method according to the second embodiment. Steps S11 to S15 in FIG. 12 are similar to the information processing method according to the first embodiment. As shown in step S16 in FIG. 12, before step S13, a reservation from the user U to visit the real store RS is accepted, and the reservation is notified to the store terminal 20. For example, the reservation notification unit 16 of the information processing device 10 is caused to accept a reservation from the user U to visit the real store RS, and to notify the store terminal 20 of the reservation. Step S16 may be performed before or after steps S11 and S12, or may be performed in parallel with steps S11 and S12.

[0045] FIG. 13 is a flow chart illustrating a reservation notification method according to the second embodiment. As shown in step S21 of FIG. 13, the reservation notification unit 16 accepts a reservation request from the user terminal 30 to visit the real store RS. Next, as shown in step S22, the reservation notification unit 16 accepts the user's desired reservation time. Next, as shown in step S23, the reservation notification unit 16 notifies the store terminal 20 of the user U's desired reservation time. In response to this, the store terminal 20 checks whether the user U's desired reservation time is available. If the user U's desired reservation time is available, the store terminal 20 notifies the reservation notification unit 16 that the reservation is possible. On the other hand, if the user U's desired reservation time is not available, the store terminal 20 notifies the reservation notification unit 16 that the reservation is impossible.

[0046] Therefore, as shown in step S24, the reservation notification unit 16 judges whether a response that the reservation is possible has been received from the store terminal 20. If the response in step S24 is NO, that is, that the store terminal 20 has notified the user that the reservation is not possible, as shown in step S25, the reservation notification unit 16 inquires of the user U about another desired reservation time. Then, steps S22 to S24 are repeated. If the response in step S24 is YES, that the store terminal 20 has notified the user U that the reservation is possible, as shown in step S26, the reservation notification unit 16 notifies the user U that the reservation is complete.

[0047] According to this embodiment, the user U can make a reservation to visit the real store RS, thereby improving the user's convenience. In addition, the behavioral history of the user U includes information on the reservation to visit the real store RS and the products associated with the visit. Therefore, the salesperson P at the real store RS can know what advice has already been given to the user U at the real store RS and the products that have already been handled. This makes it possible to suppress advice and suggestions for products that overlap with those given at the previous visit. Other configurations and effects are included in the description of embodiment 1.

[0048] (Embodiment 3) Next, an information processing device according to a third embodiment will be described. The information processing device according to this embodiment further includes a purchase reception unit that receives, from a store terminal 20, a purchase of a product desired by a user U online on a website. FIG. 14 is a block diagram illustrating an information processing device according to the third embodiment. As shown in FIG. 14, the information processing device 10b further includes a purchase reception unit 17. The purchase reception unit 17 functions as a purchase reception means.

[0049] The purchase reception unit 17 receives purchases of products on a website from the store terminal 20 at the real store RS. For example, if the product that the user U wishes to purchase in response to a suggestion from a salesperson P is not available at the real store RS, or if the user U wishes to have the product that the user U wishes to purchase in response to a suggestion from a salesperson P delivered to his / her home, the user U purchases the product from the store terminal 20. In such a case, the store terminal 20 outputs the product to be purchased and user information to the information processing device 10b. The product to be purchased from the store terminal 20 and the user information such as the delivery address of the product may be collected by the collection unit 11 as the user U's behavior history and registered by the registration unit 12.

[0050] Fig. 15 is a diagram illustrating a purchase screen displayed on the store terminal 20 when the purchase reception unit 17 of the information processing device 10b according to the third embodiment receives a purchase of a product from the store terminal 20. As shown in Fig. 15, when the store terminal 20 requests a purchase from the purchase reception unit 17, the store terminal 20 causes the user U or the salesperson P to input the product to be purchased and user information. When the user U visits the store, the store terminal 20 displays the user U's behavior history, user information, and the like. Therefore, only the delivery address of the purchased product may be input on the purchase screen.

[0051] Next, a method for purchasing a product from the above-mentioned store terminal 20 via the purchase acceptance unit 17 will be described with reference to a flowchart. FIG. 16 is a flowchart illustrating an information processing method according to the third embodiment. Steps S11 to S15 in FIG. 16 are similar to the information processing method of the first embodiment. As shown in step S17 in FIG. 16, after step S15, a purchase of a product on the website is accepted from the store terminal 20. For example, the purchase acceptance unit 17 is caused to accept a purchase of a product on the website from the store terminal 20.

[0052] According to this embodiment, even if the product that the user U wishes to purchase in response to a suggestion from the salesperson P is not available in a real store, or even if the user U wishes to have the product that the user U wishes to purchase in response to a suggestion from the salesperson P delivered to his / her home, the user U can purchase the product, thereby improving the convenience of the user U. Other configurations and effects are included in the description of the first and second embodiments.

[0053] (Embodiment 4) Next, an information processing system according to a fourth embodiment will be described. In this embodiment, the information processing system will be described in more detail. FIG. 17 is a configuration diagram illustrating an information processing system according to the fourth embodiment. The information processing system 4 includes an information processing device 100, a store terminal 200, a user terminal 300, and a face authentication device 400. Each device and terminal is connected via a wireless or wired network NW. The information processing device 100, the store terminal 200, the user terminal 300, and the face authentication device 400 are examples of the above-mentioned information processing devices 10 to 10b, the store terminal 20, the user terminal 30, and the biometric authentication device 40, respectively. Each configuration will be described below.

[0054] <Information processing device> FIG. 18 is a block diagram illustrating an information processing device 100 according to the fourth embodiment. The information processing device 100 includes a storage unit 110, a memory 120, a communication unit 130, and a control unit 140. The storage unit 110, the memory 120, the communication unit 130, and the control unit 140 function as a storage means, a memory means, a communication means, and a control means, respectively. The storage unit 110 is a storage device such as a hard disk or a flash memory. The storage unit 110 stores a program 111, a user DB 112, a store information DB 113, a product information DB 114, and a behavior history DB 115. The program 111 is a computer program in which the processing of an information processing method is implemented.

[0055] The user DB 112 stores user information of the user U. Specifically, the user DB 112 stores user information 1122 in association with a user ID 1121. The user ID 1121 may be issued by the face authentication device 400 at the time of biometric information registration. The user information 1122 is information about the user U, and may include, for example, attribute information of the user U and information indicating the preferences of the user U. The attribute information may include at least one of age, place of residence, sex, family structure, place of employment, allergy information, and religious information. The attribute information may include a work environment, for example, whether the work is indoors or outdoors. The information indicating the preferences of the user U may include information about at least one of the hobbies of the user U, the fields of interest of the user U, and products or services evaluated by the user U.

[0056] The store information DB 113 is a database that stores various information related to the real store RS. Specifically, the store information DB 113 includes a store ID 1131 and store information 1132. The store ID 1131 is information that identifies the real store RS. The store information 1132 includes basic information about the real store RS, information about products or services provided by the real store RS, or campaign information or preferential treatment information about the products or services.

[0057] The product information DB 114 is a database that stores various information related to products. The product information DB includes product information 1141. The product information 1141 includes information on products associated with user information, for example, information on products that are popular with at least one of people of the same generation, occupation, educational background, and hometown as the user U.

[0058] The behavior history DB 115 stores the behavior history of the user U on a website that includes a product. The behavior history DB 115 stores a user ID 1151 and a behavior history 1152 in association with each other. The behavior history DB 115 records the behavior history of the user U for each user ID. For example, the behavior history includes the date and time of the behavior, the website used, and the product used.

[0059] The memory 120 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during operation of the control unit 140. The communication unit 130 is a communication interface with the network N.

[0060] The control unit 140 is a processor, that is, a control device, that controls each component of the information processing device 100. The control unit 140 loads the program 111 from the storage unit 110 into the memory 120 and executes the program 111. This realizes the functions of the collection unit 141, the registration unit 142, the acquisition unit 143, the specification unit 144, the output unit 145, the reservation notification unit 146, and the purchase acceptance unit 147. The collection unit 141, the registration unit 142, the acquisition unit 143, the specification unit 144, the output unit 145, the reservation notification unit 146, and the purchase acceptance unit 147 respectively correspond to the collection unit 11 and the 、 These are examples of the registration unit 12, the acquisition unit 13, the identification unit 14, the output unit 15, the reservation notification unit 16, and the purchase acceptance unit 17.

[0061] The collecting unit 141 collects the online behavior history of the user U on a website including products. When the registering unit 142 receives biometric information (e.g., a face image) from the user terminal 300, it transmits a biometric information registration request to the face authentication device 400. Then, when the face authentication device 400 registers the biometric information and issues a user ID, the registering unit 142 registers the user ID in the user DB 112. When the registering unit 142 receives a membership registration request from the user terminal 300, it registers the user information of the user U in the user DB 112 in association with the user ID of the user U used by the user terminal 300. When the acquiring unit 143 receives an information provision request or a biometric information payment request from the store terminal 200, it acquires the biometric information included in the request. The acquiring unit 143 supplies the biometric information to the identifying unit 144.

[0062] The identification unit 144 identifies the user U by controlling face authentication based on the face image. For example, the identification unit 144 causes the face authentication device 400 to perform face authentication on the face image acquired from the store terminal 200. For example, the identification unit 144 transmits a face authentication request including the acquired face image to the face authentication device 400 via the network NW. The identification unit 144 may extract the face area of ​​the user U from the face image and include the extracted image in the face authentication request. The identification unit 144 may also extract facial feature information from the face area and include the facial feature information in the face authentication request. Then, the identification unit 144 receives the face authentication result from the face authentication device 400. As a result, the identification unit 144 identifies the user ID of the user U.

[0063] If the biometric authentication is successful, the output unit 145 outputs the behavior history associated with the user ID to the store terminal 200. In addition to the behavior history, the output unit 145 may output at least one of the user information of the user U and product information associated with the user information. The reservation notification unit 146 accepts a reservation for the user U to visit the real store RS and notifies the store terminal 200 of the reservation. The purchase acceptance unit 147 accepts a purchase of a product desired by the user U from the store terminal 200 online at a website that includes the product.

[0064] <Store terminal> Next, the store terminal 200 will be described. Fig. 19 is a block diagram illustrating the store terminal 200 according to the fourth embodiment. As shown in Fig. 19, the store terminal 200 includes a face image acquisition unit 210, a storage unit 220, a communication unit 230, a display unit 240, an input unit 250, and a control unit 260. The face image acquisition unit 210, the storage unit 220, the communication unit 230, the display unit 240, the input unit 250, and the control unit 260 each have the functions of face image acquisition means, storage means, communication means, display means, input means, and control means.

[0065] The face image acquisition unit 210 acquires a face image according to the control of the control unit 260. The face image acquisition unit 210 may be disposed in the face image acquisition device BM. The memory unit 220 is a storage device in which programs for implementing each function of the store terminal 200 are stored. The communication unit 230 is a communication interface with the network NW. The display unit 240 is a display device. The display unit 240 may display the behavior history of the user U output from the information processing device 100. The input unit 250 is an input device that accepts input. The display unit 240 and the input unit 250 may be integrally configured like a touch panel. The control unit 260 controls the hardware of the store terminal 200.

[0066] <User device> Next, the user terminal 300 will be described. Fig. 20 is a block diagram showing the configuration of the user terminal 300 according to the fourth embodiment. As shown in Fig. 20, the user terminal 300 includes a camera unit 310, a storage unit 320, a communication unit 330, a display unit 340, an input unit 350, and a control unit 360. The camera unit 310, the storage unit 320, the communication unit 330, the display unit 340, the input unit 350, and the control unit 360 each have the functions of a camera means, a storage means, a communication means, a display means, an input means, and a control means.

[0067] The camera unit 310 is an imaging device that captures images according to the control of the control unit 360. The camera unit 310 may acquire a face image as biometric information. The memory unit 320 is a storage device that stores programs for implementing each function of the user terminal 300. The communication unit 330 is a communication interface with the network NW. The display unit 340 is a display device. The user U causes the display unit 340 to display a website including a product, and obtains product information. The input unit 350 is an input device that accepts input from the user U. The display unit 340 and the input unit 350 may be integrated into one unit, such as a touch panel. The control unit 360 controls the hardware of the user terminal 300.

[0068] <Facial recognition device> Next, a face authentication device 400 will be described as an example of a biometric authentication device. Fig. 21 is a block diagram showing the configuration of the face authentication device 400 according to the fourth embodiment. The face authentication device 400 includes a face information DB 410, a face detection unit 420, a feature point extraction unit 430, a registration unit 440, and an authentication unit 450. The face information DB 410, the face detection unit 420, the feature point extraction unit 430, the registration unit 440, and the authentication unit 450 each have the functions of a face information DB means, a face detection means, a feature point extraction means, a registration means, and an authentication means.

[0069] The face information DB 410 stores a user ID 411 and facial feature information 412 of the user ID in association with each other. The user ID 411 is information for identifying a user, such as an identification number. The facial feature information 412 is a collection of feature points extracted from a face image, and is an example of facial information. The face authentication device 400 may, in response to a request from a registered user of the facial feature information 412, Face information The facial feature information 412 in the DB 410 may be deleted. Alternatively, the face authentication device 400 may delete the facial feature information 412 after a certain period of time has elapsed since the registration of the facial feature information 412.

[0070] The face detection unit 420 detects a face area included in a registration image for registering face information, and supplies the face area to the feature point extraction unit 430. The feature point extraction unit 430 extracts feature points from the face area detected by the face detection unit 420, and supplies the face feature information to the registration unit 440. The feature point extraction unit 430 also extracts feature points included in a face image received from the information processing device 100, and supplies the face feature information to the authentication unit 450.

[0071] The registration unit 440 issues a new user ID 411 when registering the facial feature information. The registration unit 440 associates the issued user ID 411 with facial feature information 412 extracted from the registered image and registers them in the facial information DB 410. The authentication unit 450 performs face authentication using the facial feature information 412. Specifically, the authentication unit 450 compares the facial feature information extracted from the face image with the facial feature information 412 in the facial information DB 410. The authentication unit 450 returns a match of the facial feature information to the information processing device 100. The match of the facial feature information corresponds to the success or failure of authentication. The match of the facial feature information (match) refers to a case where the degree of match is equal to or greater than a predetermined value.

[0072] 22 is a flowchart showing the flow of face information registration processing according to the fourth embodiment. As shown in step S31, first, the face authentication device 400 acquires a registration image of the user U included in the face registration request. For example, the face authentication device 400 receives a face registration request via the network NW from the information processing device 100 that has received a member registration request from the user terminal 300. Note that the face authentication device 400 is not limited to this, and may also receive a face registration request directly from the user terminal 300.

[0073] Next, as shown in step S32, the face detection unit 420 detects a face region included in the registration image. Next, as shown in step S33, the feature point extraction unit 430 extracts feature points from the face region detected in step S32, and supplies facial feature information to the registration unit 440. Finally, as shown in step S34, the registration unit 440 issues a user ID 411, associates the user ID 411 with facial feature information 412, and registers the user ID 411 and facial feature information 412 in the face information DB 410. Note that the face authentication device 400 may receive the facial feature information 412 from a face registration request source, and register the facial feature information 412 in the face information DB 410 in association with the user ID 411.

[0074] 23 is a flowchart showing the flow of face authentication processing according to the fourth embodiment. As shown in step S41, first, the feature point extraction unit 430 acquires face feature information for authentication. For example, the face authentication device 400 receives a face authentication request from the information processing device 100 via the network N, and extracts face feature information from a face image included in the face authentication request as in steps S31 to S33. Alternatively, the face authentication device 400 may receive the face feature information from the information processing device 100.

[0075] Next, as shown in step S42, the authentication unit 450 collates the acquired facial feature information with the facial feature information 412 in the facial information DB 410. Next, as shown in step S43, it is determined whether the facial features match. Specifically, if the facial feature information matches in step S43, that is, if the degree of match of the facial feature information is equal to or greater than a predetermined value (YES), the authentication unit 450 identifies the user ID 411 of the user whose facial feature information matches, as shown in step S44. Then, as shown in step S45, the authentication unit 450 returns to the information processing device 100 the fact that the facial authentication was successful and the identified user ID 411 as a facial authentication result.

[0076] On the other hand, if it is determined in step S43 that no matching facial feature information exists (NO), then as shown in step S46, authentication unit 450 returns a message indicating that facial authentication has failed to information processing device 100 as a facial authentication result.

[0077] According to this embodiment, the information processing system 4 can link the components of the store terminal 200, the user terminal 300, and the face authentication device 400, which are connected to the information processing device 100. This can improve the convenience of the user U and the salesperson P, and can increase the sales of the real store RS.

[0078] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. For example, the configurations of the first to fourth embodiments may be combined.

[0079] In the above-described embodiment, the biometric authentication device has the biometric authentication function. However, instead of or in addition to the biometric authentication device, the information processing device may have the biometric authentication function.

[0080] Furthermore, an information processing program that causes a computer to read and execute the above-mentioned information processing method is also within the scope of the technical idea of ​​the embodiment. The information processing program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray (registered trademark) disk or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The information processing program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0081] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0082] (Appendix 1) A collection means for collecting a history of a user's online actions on a website including a product; A registration means for registering the behavior history in association with a user ID of the user; An acquisition means for acquiring biometric information of the user acquired at a physical store visited by the user from a store terminal installed at the physical store; an identification means for identifying the user ID of the user by controlling biometric authentication based on the biometric information; an output means for outputting the action history associated with the user ID to the store terminal when the biometric authentication is successful; An information processing device comprising: (Appendix 2) The output means outputs at least one of user information of the user and product information associated with the user information in addition to the behavior history. 2. An information processing device according to claim 1. (Appendix 3) The product includes a cosmetic product, The user information includes at least one of attribute information of the user and information indicating a preference of the user, The product information associated with the user information includes the cosmetics that are popular among at least people of the same generation, occupation, educational background, and hometown as the user. 3. An information processing device according to claim 2. (Appendix 4) The system further includes a reservation notification means for accepting a reservation for the user to visit the physical store and notifying the store terminal of the reservation. 4. The information processing device according to claim 1, (Appendix 5) The behavioral history includes information on the reservation for the visit to the brick-and-mortar store and the product associated with the visit. 5. The information processing device according to claim 4. (Appendix 6) The method further comprises a purchase acceptance means for accepting, from the store terminal, a purchase of a product desired by the user online at the website including the product. 6. The information processing device according to any one of claims 1 to 5. (Appendix 7) A store terminal installed in a physical store, an information processing device connected to the store terminal via a wireless or wired communication line; Equipped with The information processing device includes: A collection means for collecting a history of a user's online actions on a website including a product; A registration means for registering the behavior history in association with a user ID of the user; An acquisition means for acquiring biometric information of the user acquired at a physical store visited by the user from the store terminal; an identification means for identifying the user ID of the user by controlling biometric authentication based on the biometric information; an output means for outputting the action history associated with the user ID to the store terminal when the biometric authentication is successful; having Information processing system. (Appendix 8) The information processing device is connected to the information processing device via the wireless or wired communication line, and acquires biometric information of the user acquired at the physical store and performs biometric authentication using the biometric information. 8. An information processing system according to claim 7. (Appendix 9) The method further includes a user terminal connected to the information processing device via the wireless or wired communication line, and the user acquires information about the product online on the website including the product. 9. An information processing system according to claim 7 or 8. (Appendix 10) the information processing device further includes a reservation notification means for accepting a reservation for the user to visit the physical store and notifying the store terminal of the reservation; When the store terminal accepts the reservation from the user, the store terminal notifies the reservation notification means of completion of the reservation. An information processing system according to any one of appendix 7 to 9. (Appendix 11) a purchase acceptance means for accepting, from the store terminal, a purchase of a product desired by the user online at the website including the product; the store terminal outputs the product to be purchased and user information to the information processing device; An information processing system according to any one of claims 7 to 10. (Appendix 12) Collecting the user's online behavior history on websites that contain products, The behavior history is registered in association with a user ID of the user; The biometric information of the user acquired at a physical store visited by the user is obtained from a store terminal installed at the physical store; Identifying the user ID of the user by controlling biometric authentication based on the biometric information; When the biometric authentication is successful, the behavior history associated with the user ID is output to the store terminal. Information processing methods. (Appendix 13) A step of collecting a history of online user actions on a website including the product; A step of registering the behavior history in association with a user ID of the user; A step of obtaining the biometric information of the user acquired at a physical store visited by the user from a store terminal installed at the physical store; a step of identifying the user ID of the user by controlling biometric authentication based on the biometric information; When the biometric authentication is successful, outputting the behavior history associated with the user ID to the store terminal; A non-transitory computer-readable medium storing an information processing program for causing a computer to execute the above. [Explanation of symbols]

[0083] 1, 4 Information Processing System 10, 10a, 10b Information processing device 11 Collection Department 12 Registration Department 13 Acquisition section 14 Specific section 15 Output section 16 Reservation Notification Section 17 Purchase Reception 20 Store terminals 21 Image acquisition device 30 User terminals 40 Biometric authentication device 41 Face Recognition Device 100 Information processing device 110 Storage section 111 Program 112 User DB 113 Store Information DB 114 Product information DB 115 Action History DB 120 Memory 130 Communications Department 140 Control section 141 Collection Department 142 Registration Department 143 Acquisition Department 144 Specific part 145 Output section 146 Reservation Notification Section 147 Purchase Reception 200 store terminals 210 Face image acquisition unit 220 Storage section 230 Communications Department 240 Display section 250 Input section 260 Control Unit 300 User terminals 310 Camera Department 320 Storage section 330 Communications Department 340 Display section 350 Input section 360 Control Unit 400 Face Recognition Device 410 Face Information DB 411 User ID 412 Facial Feature Information 420 Face detection unit 430 Feature Point Extraction Unit 440 Registration Department 450 Authentication Department 1121 User ID 1122 User Information 1131 Store ID 1132 Store Information 1141 Product information 1151 User ID 1152 Activity History BM Biometric information acquisition device NW Network P Salesperson RS Real Store U User

Claims

1. A collection means for collecting a history of a user's online actions on a website including a product; A registration means for registering the behavior history in association with a user ID of the user; An acquisition means for acquiring biometric information of the user acquired at a physical store visited by the user from a store terminal installed at the physical store; an identification means for identifying the user ID of the user by controlling biometric authentication based on the biometric information; an output means for outputting the action history associated with the user ID to the store terminal when the biometric authentication is successful; Equipped with The output means outputs, in addition to the behavior history, user information of the user and product information associated with the user information; The user information includes at least one of attribute information of the user and information indicating a preference of the user, The product information associated with the user information includes the products that are popular among at least one of people of the same generation, occupation, educational background, and hometown as the user. Information processing device.

2. The product includes a cosmetic product, The product information associated with the user information includes the cosmetics that are popular among at least people of the same generation, occupation, educational background, and hometown as the user. The information processing device according to claim 1 .

3. The system further includes a reservation notification means for accepting a reservation for the user to visit the physical store and notifying the store terminal of the reservation.

3. The information processing device according to claim 1 or 2.

4. The behavioral history includes information on the reservation for the visit to the brick-and-mortar store and the product associated with the visit. The information processing device according to claim 3 .

5. The method further comprises a purchase acceptance means for accepting, from the store terminal, a purchase of a product desired by the user online at the website including the product.

3. The information processing device according to claim 1 or 2.

6. A store terminal installed in a physical store, an information processing device connected to the store terminal via a wireless or wired communication line; Equipped with The information processing device includes: A collection means for collecting a history of a user's online actions on a website including a product; A registration means for registering the behavior history in association with a user ID of the user; An acquisition means for acquiring biometric information of the user acquired at a physical store visited by the user from the store terminal; an identification means for identifying the user ID of the user by controlling biometric authentication based on the biometric information; an output means for outputting the action history associated with the user ID to the store terminal when the biometric authentication is successful; having The output means outputs, in addition to the behavior history, user information of the user and product information associated with the user information; The user information includes at least one of attribute information of the user and information indicating a preference of the user, The product information associated with the user information includes the products that are popular among at least one of people of the same generation, occupation, educational background, and hometown as the user. Information processing system.

7. The information processing device is connected to the information processing device via the wireless or wired communication line, and acquires biometric information of the user acquired at the physical store and performs biometric authentication using the biometric information.

7. The information processing system according to claim 6.

8. Collecting the user's online behavior history on websites that contain products, The behavior history is registered in association with a user ID of the user; The biometric information of the user acquired at a physical store visited by the user is obtained from a store terminal installed at the physical store; Identifying the user ID of the user by controlling biometric authentication based on the biometric information; When the biometric authentication is successful, the behavior history associated with the user ID is output to the store terminal.

1. An information processing method, comprising: When outputting to the store terminal, outputting user information of the user and product information associated with the user information in addition to the behavior history; The user information includes at least one of attribute information of the user and information indicating a preference of the user, The product information associated with the user information includes the products that are popular among at least one of people of the same generation, occupation, educational background, and hometown as the user. Information processing methods.

9. A step of collecting a history of online user actions on a website including the product; A step of registering the behavior history in association with a user ID of the user; A step of obtaining the biometric information of the user acquired at a physical store visited by the user from a store terminal installed at the physical store; a step of identifying the user ID of the user by controlling biometric authentication based on the biometric information; When the biometric authentication is successful, outputting the behavior history associated with the user ID to the store terminal; An information processing program for causing a computer to execute the following: In the step of outputting the store terminal, outputting user information of the user and product information associated with the user information in addition to the behavior history; The user information includes at least one of attribute information of the user and information indicating a preference of the user, The product information associated with the user information includes the products that are popular among at least one of people of the same generation, occupation, educational background, and hometown as the user. Information processing program.

Images