Information processing device, information processing method, and information processing program

Abstract

To promote further improvement of usability for users referring to makeup of others.SOLUTION: An information processing device includes a generation part, an application part, and a provision part. The generation part generates, from face images of posters wearing prescribed makeup, makeup information for generating a face image formed by applying same makeup as the prescribed makeup to the face image. The application part applies, to a face image of a user, the makeup information generated from a face image selected by the user from the face images posted by posters satisfying prescribed conditions. The provision part provides, to the user, a content representing the face image to which the makeup information is applied by the application part and a description content of an article used for the makeup.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] When considering purchasing cosmetics, it is common to see makeup applied to the faces of models or other people, but not be able to imagine what it would look like on oneself, and therefore not know whether it would suit oneself or not.

[0003] Conventionally, there is known a technology that supports makeup application by referring to the makeup of others as a technology for satisfying a desire to check whether makeup applied to the face of others suits oneself. For example, a technology is known that presents makeup information of others in association with regions of facial parts of a user. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5991536 [Non-patent literature]

[0005] [Non-Patent Document 1] W. Jiang, S. Liu, C. Gao, J. Cao, R. He, J. Feng, S. Yan “PSGAN: Pose and Expression Robust Spatial-Aware CAN for Customizable Makeup Transfer”, [online], [Retrieved January 24, 2020], Internet <https: / / openaccess.thecvf.com / content_CVPR_2020 / html / Jiang_PSGAN_Pose_and_Expression_Robust_Spatial-Aware_GAN_for_Customizable_Makeup_CVPR_2020_paper.html> Summary of the Invention [Problem to be solved by the invention]

[0006] However, in the conventional technology, for example, it was not possible to send customers to a sales site that sells the products after allowing users to check whether the products used in the makeup of others suit them using a try-on function, or to promote activation of customer sending support by makeup posters using performance-based rewards. Therefore, there is room for further improvement in usability for users who refer to the makeup of others.

[0007] The present application has been made in consideration of the above, and aims to promote further improvement of usability for users who refer to the makeup of others. [Means for solving the problem]

[0008] The information processing device of the present application is characterized by having a generation unit that generates makeup information for generating a facial image in which a similar makeup to a specified makeup is applied to a facial image of a poster wearing a specified makeup, an application unit that applies the makeup information generated from a facial image selected by a user from facial images posted by posters that satisfy specified conditions to the facial image of the user, and a provision unit that provides content to the user including the facial image to which the makeup information has been applied by the application unit and explanatory content of items used in the makeup. Effect of the Invention

[0009] According to one aspect of the embodiment, it is possible to promote further improvement in usability for users who refer to makeup styles worn by others. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of information processing according to the embodiment. [Diagram 3] FIG. 3 is an explanatory diagram for explaining information processing in a case where the priority order of a face image is set to be high according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of a user terminal according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of the configuration of a poster terminal according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a contributor information storage unit according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a cosmetic information storage unit according to the embodiment. [Figure 9] FIG. 9 is a flowchart illustrating an example of information processing according to the embodiment. [Figure 10]FIG. 10 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to the embodiments. In addition, the same parts in the following embodiments are given the same reference numerals, and duplicated explanations are omitted.

[0012] (Embodiment) [1. Configuration of information processing system] An information processing system 1 shown in Fig. 1 will be described. As shown in Fig. 1, the information processing system 1 includes a user terminal 10, a poster terminal 20, and an information processing device 100. The user terminal 10, the poster terminal 20, and the information processing device 100 are connected to each other via a predetermined communication network (network N) so as to be able to communicate with each other via wired or wireless communication. Fig. 1 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment.

[0013] The user terminal 10 is an information processing device used by a user who desires to check whether makeup applied to another person's face suits the user. A user who uses the user terminal 10 is, for example, a user who is considering purchasing cosmetics. The user terminal 10 may be any device that can realize the processing in the embodiment. The user terminal 10 may be a device such as a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, or a PDA. FIG. 2 shows a case where the user terminal 10 is a smartphone.

[0014] The user terminal 10 is, for example, a smart device such as a smartphone or a tablet, and is a mobile terminal device capable of communicating with any server device via a wireless communication network such as 3G to 5G (Generation) or LTE (Long Term Evolution). The user terminal 10 has a screen such as a liquid crystal display having a touch panel function, and may accept various operations on displayed data such as content, such as tapping, sliding, scrolling, etc., performed by a user's finger or a stylus. In FIG. 2, the user terminal 10 is used by a user U11.

[0015] Contributor terminal 20 is an information processing device used by a contributor who provides a face image with makeup applied. A contributor who uses contributor terminal 20, for example, posts a face image in which makeup is applied to a bare face before makeup is applied. Contributor terminal 20 may be any device that can realize the processing in the embodiment. Contributor terminal 20 may be a device such as a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, or a PDA. FIG. 2 shows a case in which contributor terminal 20 is a smartphone.

[0016] The contributor terminal 20 is, for example, a smart device such as a smartphone or tablet, and is a mobile terminal device capable of communicating with any server device via a wireless communication network such as 3G to 5G or LTE. The contributor terminal 20 has a screen such as a liquid crystal display with a touch panel function, and may accept various operations on displayed data such as content, such as tapping, sliding, scrolling, etc., performed by the contributor's finger or stylus. In FIG. 2, the contributor terminal 20 is used by contributors P11 and P12. The contributor terminal 20 1 and poster terminal 20 2 are the contributor terminals 20 of contributor P11 and contributor P12, respectively.

[0017] The information processing device 100 is an information processing device intended to promote further improvement of usability for users who refer to the makeup of others, and may be any device capable of implementing the processes in the embodiment. The information processing device 100 is realized by, for example, a server device, a cloud system, or the like. For example, the information processing device 100 is realized by, for example, a server device or a cloud system that provides a predetermined online shopping mall that sells cosmetics.

[0018] [2. An example of information processing] 2 is a diagram showing an example of information processing of the information processing system 1 according to the embodiment. In the following embodiment, a process for responding to a desire of a user U11 to check whether the makeup of a poster P11 suits him / her will be described as an example.

[0019] The information processing device 100 acquires information on a face image selected by the user U11 from face images posted by contributors such as celebrities called influencers whose number of followers exceeds a predetermined threshold on a social networking service (SNS) (step S101). Note that the face images selectable by the user U11 may include a plurality of face images posted by one contributor. In FIG. 2, it is assumed that face images IM11 posted by the contributor P11 and face images IM12 posted by the contributor P12 are included. In the following, it is assumed that the user U11 selects the face image IM11 from the content CT11. Note that the face images displayed in the content CT11 may be selected based on any criteria. For example, face images posted by contributors followed by the user U11 may be preferentially selected. Also, the content CT11 is content on a predetermined service that manages the contributors' face images.

[0020] The face image IM11 is a face image of the poster P11 after applying a predetermined make-up. The face image IM21 is a face image of the poster P11 before applying make-up for the make-up of the face image IM11. The face image IM21 may be displayed in the content CT11 together with the face image IM11, or may be displayed by an operation (e.g., a click or a tap) on the face image IM11. The face image IM21 may not be displayed to the user. This eliminates the need for the poster to show his or her bare face to the user, which can promote improvement in usability for the poster. The face image IM12 is a face image of the poster P12 after applying a predetermined make-up. The face image IM22 is a face image of the poster P12 before applying make-up for the make-up of the face image IM12. The face image IM22 may be displayed in the content CT11 together with the face image IM12, or may be displayed by an operation on the face image IM12. The face image IM22 may not be displayed to the user.

[0021] Here, as an example of a method for generating makeup information, for example, a method called PSGAN (Pose and Expression Robust Spatial-Aware Generative Adversarial Network) disclosed in Non-Patent Document 1, which transfers only makeup information from a face image to another face, can be mentioned (Non-Patent Document 1). This method uses deep learning, and can transfer only makeup information to another face regardless of facial expression or pose. The information processing device 100 uses a method such as PSGAN to generate makeup information for generating a face image in which makeup similar to the makeup of the poster P11 used in the face image IM11 selected by the user U11 is applied to the face image (step S102). Then, the information processing device 100 applies the makeup information generated in step S102 to the face image IM1 of the user U11 using a method such as PSGAN (step S103). At this time, the face image IM1 may be acquired in any way. The facial image IM1 may be, for example, one that is registered in advance by the user U11 and stored in an external information processing device or the user's own device, or one that is transmitted from the user terminal 10. The facial image IM1 may be one that is selected by the user U11 as an application target, or one that is automatically selected as an application target. The facial image IM2 is a facial image after application to the facial image IM1.

[0022] In step S103, the information processing device 100 transmits information for displaying content including a face image IM2 of the user U11 to which makeup information has been applied and content explaining the cosmetics (corresponding to items) used in the makeup to the user terminal 10 (step S104). Then, the user terminal 10 displays the content CT1 based on the information transmitted from the information processing device 100.

[0023] Here, the content CT1 includes explanatory content of the cosmetics used by the contributor P11 for makeup on the face image IM11. For example, information such as the product name and price of the cosmetics is included. Although FIG. 2 shows a case where two cosmetics (PR1 and PR2), i.e., lipstick and foundation, are included, the number of cosmetics is not particularly limited. For example, the content CT1 may include explanatory content of a set of cosmetics used by the contributor P11 to finish the face image IM21 before makeup to the face image IM11 after a certain makeup. The explanatory content may also include operation acceptance information B1 that accepts an operation to access a certain online shopping mall where the set of cosmetics used for makeup can be purchased. When the operation is accepted, the operation acceptance information B1 may, for example, access a product page that introduces the set of cosmetics, or access a purchase page where the set of cosmetics is added to a cart. Note that the operation acceptance information B1 may be integrated with the face image IM2 or other content in the explanatory content, and when an operation on the face image IM2 or other content in the explanatory content is accepted, the operation acceptance information B1 may access a product page or a purchase page.

[0024] The information processing device 100 determines whether the user U11 has purchased cosmetics linked to the explanatory content. For example, the information processing device 100 determines whether the user U11 has purchased a set or part of cosmetics including cosmetics PR1 and cosmetics PR2 in a predetermined online shopping mall accessed by operating the operation reception information B1. When the information processing device 100 determines that the user U11 has purchased the cosmetics, it decides to grant a reward according to the purchase of the user U11 to the poster P11 who posted the face image using makeup corresponding to the makeup information of the image IM2. Then, the information processing device 100 performs a process for granting the reward according to the purchase of the user U11 to the poster P11. Note that the information processing device 100 may decide to transmit information for the poster P11 to receive the reward according to the purchase of the user U11. In this case, the information processing device 100 transmits information for the poster P11 to receive the reward according to the purchase of the user U11. Also, the information processing device 100 may decide to remit the reward to the account of the poster P11. In this case, the information processing device 100 performs processing to transfer the reward to the account of the contributor P11.

[0025] (Processing variation 1: Display using face image before makeup) In the above embodiment, a case has been described in which face images with predetermined makeup, such as face image IM11 and face image IM12, are displayed in the content CT11, but the present invention is not limited to this example. For example, face images without makeup, such as face image IM21 and face image IM22, may be displayed in the content CT11, and a face image with makeup may be displayed by operating the face image without makeup. Then, the information processing device 100 may generate makeup information to be applied to the face image of the user by having the user U11 view and select a face image with makeup corresponding to the face image without makeup.

[0026] (Processing variation 2: Displaying makeup videos) In the above embodiment, a case has been shown in which a face image after a predetermined make-up, such as face image IM11 or face image IM12, is displayed in the content CT11, and by manipulating the face image after make-up, for example, a face image before make-up is displayed, but this is not limited to the example. For example, by manipulating the face image after make-up, a make-up video of the make-up applied by the poster to finish from a state before make-up to a state after make-up may be displayed. Note that the make-up video includes, for example, a face image before make-up, such as face image IM21 or face image IM22, and a face image after a predetermined make-up, such as face image IM11 or face image IM12. Also, the make-up video may be displayed in the content CT11 together with the face image after make-up.

[0027] (Processing variation 3: Limiting face images before makeup) In the above embodiment, the face images before makeup such as the face images IM21 and IM22 are face images of the poster's bare face, but the present invention is not limited to this example. For example, the face images before makeup such as the face images IM21 and IM22 may be face images with a certain degree of makeup such as only lipstick and foundation, as long as they are predetermined face images before makeup such as the face images IM11 and IM12. In this case, the information processing device 100 may generate makeup information such that the makeup information of the cosmetics used in the face images before makeup such as the face images IM21 and IM22 is not applied to the face image of the user, or may generate makeup information that is applied to the face image of the user. Note that the face images before makeup such as the face images IM21 and IM22 are used for learning the skeleton when generating makeup information, so that appropriate makeup information can be generated even if the face images are not bareface images. For this reason, the face images before makeup of the poster need only be registered once on a predetermined service that manages the face images of the poster. Furthermore, content explaining the cosmetics used in face images before makeup, such as face image IM21 and face image IM22, may or may not be included in content CT1.

[0028] (Processing variation 4: Automatic extraction of item information) In the above embodiment, the cosmetics used by the contributor P11 to apply makeup to the face image IM11 may be, for example, those previously identified by image analysis from the face image IM11 or IM21, and stored in an external information processing device or the contributor's own device in association with the face image IM11 or IM21. Also, for example, the cosmetics may be identified based on the contributor P11's purchase history of cosmetics in a predetermined online shopping mall and stored in association with the face image IM11 or IM21, or may be identified by the contributor P11 selecting from a list displayed as candidates based on the cosmetics purchase history, and stored in association with the face image IM11 or IM21. Also, for example, the cosmetics may be identified by accepting registration of cosmetics not sold in a predetermined online shopping mall from the contributor P11, and stored in association with the face image IM11 or IM21.

[0029] (Processing variation 5: Reflecting the order of makeup) In the above embodiment, the information processing device 100 may generate makeup information reflecting the order of makeup by identifying the order of makeup applied by the contributor P11 with respect to the facial image IM11. In this case, the information processing device 100 may identify the order of makeup by, for example, receiving an input of the order of makeup from the contributor P11, or, if there is a makeup video related to the facial image IM11, may identify the order of makeup from the makeup video. In addition, the information processing device 100 may identify the order of makeup by, for example, learning from a plurality of makeup videos. In addition, in the case of a makeup video, the information processing device 100 may select an applicable facial image since it can generate makeup information for each type of cosmetic. In addition, explanatory content reflecting the order of makeup may be included in the content CT1. In this way, the information processing device 100 can make an appropriate suggestion including the order of makeup.

[0030] (Processing variation 6: Face image priority display 1) In the above embodiment, the face images displayed in the content CT1 may be selected based on any criteria, and may be displayed in any priority order. For example, face images posted by posters followed by the user U11 may be preferentially selected, or face images of posters with a larger number of followers may be preferentially displayed. Also, for example, face images may be preferentially selected or displayed based on the face information or other physical information of the user U11.

[0031] Here, examples of face information include, for example, the shape, size, and arrangement of facial features, the color and contour (shape) of the face, the color and size of the eyes, etc. Furthermore, the face color includes, for example, the natural complexion color. For example, it includes the average color of all measurement points excluding the lips, the average color of the forehead region, the average color of the region under the left eye, the average color of the region under the right eye, the average color of the left cheek region, the average color of the right cheek region, the average color of the nose region, the average color of the upper lip, the average color of the lower lip, the average color of the chin region, etc. Furthermore, examples of physical information other than face information include, for example, hair (hairstyle, hair type, hair color, accessories, etc.), skin (skin color, skin type, wrinkles, etc.), body type (size of features, overall balance), etc.

[0032] In the above embodiment, the closer the physical information is to the user U11, the higher the priority may be set so that the poster's face image is preferentially selected or displayed. For example, the more identical or similar the face or other physical information is to the user U11, the higher the priority may be set to the poster's face image. Also, for example, the more identical or similar the age, skin age, or skin trouble is to the user U11, the higher the priority may be set to the poster's face image. Also, for example, the more identical or similar the makeup trouble is to the user U11, the higher the priority may be set to the poster's face image. Also, for example, the more identical or similar the hairstyle, hair color, or hair preference is to the user U11, the higher the priority may be set to the poster's face image. Also, for example, the more distant the physical information is from the user U11, the lower the priority may be set to the poster's face image so that the poster's face image is not preferentially selected or displayed. For example, the more different the balance of facial features is to the user U11, the lower the priority may be set to the poster's face image. Also, for example, the more different the facial contour is to the user U11, the lower the priority may be set to the poster's face image. Also, for example, the more different the natural facial color of the poster is from that of user U11, the lower the priority of the poster's face image may be.

[0033] Also, the facial image may be preferentially selected or displayed based on an index indicating the popularity of the facial image, such as the access history, purchase history, or evaluation history of multiple users for the facial image. Specifically, the facial image may be preferentially selected or displayed based on the access history of the facial image selected by multiple users, the purchase history of multiple users by sending customers through the content provided by selecting the facial image, the evaluation history by multiple users when applying makeup by selecting the facial image, and the evaluation history of the facial image or purchased cosmetics by multiple users after purchase. For example, the higher the index indicating the popularity of the facial image, such as the access history, purchase history, or evaluation history of multiple users for the facial image, the higher the priority of the facial image may be. Also, the facial image may be preferentially selected or displayed based on the total price of a set of cosmetics used by the poster for makeup. For example, the higher the total price of a set of cosmetics used by the poster for makeup, the higher or lower the priority of the facial image may be.

[0034] (Processing variation 7: Face image priority display 2) In the above embodiment, the selection or display may be prioritized based on the purchase history of cosmetics of the user U11. For example, the higher the priority of the poster's face image, the more the cosmetics owned by the user U11 are the same or similar to those of the user U11. For example, if the purchase history of the user U11 includes cosmetics PR1, cosmetics PR2, and cosmetics PR3, the higher the priority of the poster's face image that includes more cosmetics among cosmetics PR1, cosmetics PR2, and cosmetics PR3 in the purchase history. For example, the priority of the poster's face image that includes cosmetics PR2 and cosmetics PR3 in the purchase history may be higher than the face image of the poster that includes only cosmetics PR1 among cosmetics PR1, cosmetics PR2, and cosmetics PR3. Also, for example, the higher the priority of the face image, the more the cosmetics owned by the user U11 are the same or similar to those of the user U11. For example, if the purchase history of the user U11 includes cosmetics PR1, cosmetics PR2, and cosmetics PR3, the higher the priority of the face image that uses more cosmetics among cosmetics PR1, cosmetics PR2, and cosmetics PR3 in makeup.

[0035] 3 is an explanatory diagram for explaining information processing in which the priority of a facial image is increased as the facial image becomes more identical or similar to cosmetics owned by user U11, based on the cosmetic purchase history of user U11. Facial images IM11 and IM12 are facial images posted by poster P11, and facial image IM12 is a facial image posted by poster P12. The cosmetics used in the makeup for facial image IM11 are cosmetics PR1, cosmetics PR2, and cosmetics PR3, the cosmetics used in the makeup for facial image IM111 are cosmetics PR1, cosmetics PR4, and cosmetics PR5, and the cosmetics used in the makeup for facial image IM12 are cosmetics PR2, cosmetics PR6, cosmetics PR7, and cosmetics PR8. If the purchase history of user U11 includes cosmetics PR1, PR2, PR3, and PR6, the facial image IM11 common to cosmetics PR1, PR2, and PR3 will have a high priority, the facial image IM111 common to cosmetics PR2 and PR6 will have a medium priority, and the facial image IM12 common to cosmetics PR1 will have a low priority.

[0036] (Processing variation 8: Obtaining color information) In the above embodiment, the skin color such as complexion may be measured by a measurement item such as ZOZOGLASS (registered trademark) that can be worn by the user U11. By correcting the light and accurately measuring the skin color, the accuracy of the makeup information generated by the information processing device 100 can be improved.

[0037] [3. User terminal configuration] Next, the configuration of the user terminal 10 according to the embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the configuration of the user terminal 10 according to the embodiment. As shown in Fig. 4, the user terminal 10 has a communication unit 11, an input unit 12, an output unit 13, and a control unit 14.

[0038] (Communications Department 11) The communication unit 11 is realized by, for example, a network interface card (NIC) etc. The communication unit 11 is connected to a predetermined network N by wire or wirelessly, and transmits and receives information to and from the information processing device 100 etc. via the predetermined network N.

[0039] (Input section 12) The input unit 12 accepts various operations from a user. In Fig. 2, the input unit 12 accepts various operations from a user U11. For example, the input unit 12 may accept various operations from a user via a display surface using a touch panel function. The input unit 12 may also accept various operations from buttons provided on the user terminal 10, or a keyboard or mouse connected to the user terminal 10.

[0040] (Output section 13) The output unit 13 is a display screen of a tablet terminal or the like realized by, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display, and is a display device for displaying various information. For example, the output unit 13 displays information transmitted from the information processing device 100.

[0041] (Control unit 14) The control unit 14 is, for example, a controller, and is realized by a CPU (Central Processing Unit), MPU (Micro Processing Unit), etc., executing various programs stored in a storage device inside the user terminal 10 using a RAM (Random Access Memory) as a working area. For example, the various programs include application programs installed in the user terminal 10. For example, the various programs include application programs that display content including a face image transmitted from the information processing device 100. The control unit 14 is also realized by an integrated circuit, for example, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0042] As shown in FIG. 4, the control unit 14 has a receiving unit 141 and a transmitting unit 142, and realizes or executes the information processing operations described below.

[0043] (Receiving unit 141) The receiving unit 141 receives various information from other information processing devices such as the information processing device 100. For example, the receiving unit 141 receives information for displaying content including a facial image of a user to which makeup similar to the makeup of the poster used in the facial image selected by the user has been applied, and content explaining the cosmetics used in the makeup.

[0044] (Transmitter 142) The transmission unit 142 transmits various information to other information processing devices such as the information processing device 100. For example, the transmission unit 142 transmits information on a face image selected by a user to check whether the poster's makeup suits the user.

[0045] [4. Configuration of the contributor's terminal] Next, the configuration of the poster terminal 20 according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the configuration of the poster terminal 20 according to the embodiment. As shown in Fig. 5, the poster terminal 20 has a communication unit 21, an input unit 22, an output unit 23, and a control unit 24.

[0046] (Communications Department 21) The communication unit 21 is realized by, for example, a NIC etc. The communication unit 21 is connected to a predetermined network N by wire or wirelessly, and transmits and receives information to and from the information processing device 100 etc. via the predetermined network N.

[0047] (Input unit 22) The input unit 22 accepts various operations from posters. In Fig. 2, the input unit 22 accepts various operations from posters P11 and P12. For example, the input unit 22 may accept various operations from the posters via a display screen using a touch panel function. The input unit 22 may also accept various operations from buttons provided on the poster terminal 20, or a keyboard or mouse connected to the poster terminal 20.

[0048] (Output unit 23) The output unit 23 is a display screen of a tablet terminal or the like realized by, for example, a liquid crystal display, an organic EL display, etc., and is a display device for displaying various information. For example, the output unit 23 displays information transmitted from the information processing device 100.

[0049] (Control unit 24) The control unit 24 is, for example, a controller, and is realized by a CPU, MPU, or the like executing various programs stored in a storage device inside the poster terminal 20 using the RAM as a working area. For example, these various programs include application programs installed in the poster terminal 20. For example, these various programs include an application program that transmits a face image of the poster in response to an operation by the poster. The control unit 14 is also realized by an integrated circuit, for example, an ASIC, an FPGA, or the like.

[0050] As shown in FIG. 5, the control unit 24 has a receiving unit 241 and a transmitting unit 242, and realizes or executes the information processing operations described below.

[0051] (Receiving unit 241) The receiving unit 241 receives various information from other information processing devices such as the information processing device 100. For example, when a user who applies makeup to his / her own face image after viewing a face image provided by a poster purchases cosmetics corresponding to the applied makeup in a predetermined online shopping mall, the receiving unit 241 receives information regarding a reward that the poster can receive, which is determined according to the user's purchase. Note that the receiving unit 241 may receive information for the poster to receive a reward according to the user's purchase.

[0052] (Transmitter 242) The transmission unit 242 transmits various information to other information processing devices such as the information processing device 100. For example, the transmission unit 142 transmits a face image of the poster in response to an operation by the poster.

[0053] 5. Configuration of Information Processing Device Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 6, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

[0054] (Communication unit 110) The communication unit 110 is realized by, for example, a NIC etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from the user terminal 10 etc. via the network N.

[0055] (Storage unit 120) The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 6, the storage unit 120 has a contributor information storage unit 121 and a cosmetic information storage unit 122.

[0056] The poster information storage unit 121 stores a face image of a poster. An example of the poster information storage unit 121 according to the embodiment is shown in Fig. 7. As shown in Fig. 7, the poster information storage unit 121 has items such as "Poster ID" and "Facial Image".

[0057] "Contributor ID" indicates identification information for identifying the poster. "Facial image" indicates a facial image of the poster's natural face that the poster registered when using the service for the first time, etc. In the example shown in FIG. 7, conceptual information such as "Facial image #11" and "Facial image #12" is stored in "Facial image", but in reality, image data, etc. are stored. In addition, for example, a URL where the image data is located, a file path name indicating the storage location, etc. may be stored in "Facial image".

[0058] That is, FIG. 7 shows an example in which the face image of the contributor "P11" is "face image #11".

[0059] The cosmetics information storage unit 122 stores information about cosmetics used by the poster for makeup. As shown in Fig. 8, the cosmetics information storage unit 122 has items such as "Poster ID", "Facial image", and "Cosmetics set".

[0060] "Poster ID" indicates identification information for identifying the poster. "Facial image" indicates a facial image posted by the poster. In the example shown in FIG. 8, conceptual information such as "Facial image #21" and "Facial image #22" is stored in "Facial image", but in reality, image data or the like is stored. In addition, "Facial image" may store, for example, a URL where the image data is located, or a file path name indicating the storage location. "Complete set of cosmetics" indicates the complete set of cosmetics used by the poster for makeup.

[0061] That is, Fig. 8 shows an example in which the face image posted by the poster identified by the poster "P11" is "Face Image #21", and the set of cosmetics used by the poster for makeup is "Product A1 (lipstick) from brand XX, Product A2 (foundation) from brand XX, ...". Note that the type of cosmetics is indicated in parentheses.

[0062] (Control unit 130) The control unit 130 is a controller, and is realized, for example, by a CPU, an MPU, or the like, executing various programs stored in a storage device inside the information processing device 100 using a RAM as a working area. The control unit 130 is also a controller, and is realized, for example, by an integrated circuit such as an ASIC or an FPGA.

[0063] 6, the control unit 130 has an acquisition unit 131, a generation unit 132, an application unit 133, a provision unit 134, and a determination unit 135, and realizes or executes the information processing action described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 6, and may be other configurations as long as they perform the information processing described below.

[0064] (Acquisition part 131) The acquisition unit 131 acquires various pieces of information from an external information processing device. The acquisition unit 131 acquires various pieces of information from other information processing devices such as the user terminal 10.

[0065] The acquiring unit 131 acquires various types of information from the storage unit 120. In addition, the acquiring unit 131 stores the acquired various types of information in the storage unit 120.

[0066] The acquisition unit 131 acquires information on a face image selected by a user from among face images posted by a contributor on a predetermined service.

[0067] The acquisition unit 131 acquires information about cosmetics used by the contributor in applying makeup to the face image selected by the user.

[0068] (Generation unit 132) The generating unit 132 generates makeup information for generating a face image in which the same makeup as the poster's makeup used on the face image selected by the user is applied to the face image by using a method such as PSGAN based on the information acquired by the acquiring unit 131. Furthermore, when the order in which the poster applied makeup to the face image selected by the user is specified, the generating unit 132 may generate makeup information that reflects the order in which the makeup was applied.

[0069] The generation unit 132 generates information for displaying content including a facial image to which makeup information has been applied by the application unit 133 described below, and cosmetic explanatory content identified based on the information acquired by the acquisition unit 131.

[0070] (Applicable part 133) The application unit 133 applies the makeup information generated by the generation unit 132 to the face image of the user selected as the application target, thereby generating a face image to be displayed on the user terminal 10.

[0071] The application unit 133 generates a facial image to be displayed on the user terminal 10 by applying makeup information generated from a facial image selected from among facial images selected or displayed with a higher priority based on a priority order determined based on the user's facial information, body information, cosmetic purchase history, etc.

[0072] The application unit 133 generates a facial image to be displayed on the user terminal 10 by applying makeup information generated from a facial image selected from among facial images selected or displayed with a higher priority based on a priority order determined on the basis of indicators indicating the popularity of the facial image, such as access history, purchase history, and evaluation history for the facial image.

[0073] The application unit 133 generates a facial image to be displayed on the user terminal 10 by applying makeup information generated from a facial image selected from among facial images selected or displayed with a higher priority based on a priority order determined based on the total price of the cosmetics used by the poster for the makeup.

[0074] (Provider 134) The providing unit 134 transmits information for displaying the content generated by the generating unit 132 to the user terminal 10. Upon receiving the information transmitted by the providing unit 134, the user terminal 10 displays the content corresponding to the information generated by the generating unit 132.

[0075] (Decision unit 135) The determination unit 135 determines whether the user has purchased cosmetics linked to the content provided by the provision unit 134, and if it is determined that the user has purchased the cosmetics, the determination unit 135 determines to grant a reward corresponding to the user's purchase to the poster who posted the face image selected by the user. Then, the provision unit 134 performs processing for granting the reward corresponding to the user's purchase to the poster. The determination unit 135 may also determine to transmit information for the poster to receive the reward corresponding to the user's purchase. In this case, the provision unit 134 transmits information for the poster to receive the reward corresponding to the user's purchase. The determination unit 135 may also determine to transfer the reward to the poster's account. In this case, the provision unit 134 performs processing for transferring the reward to the poster's account.

[0076] [6. Information processing flow] Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the procedure of information processing by the information processing system 1 according to the embodiment.

[0077] As shown in FIG. 9, the information processing device 100 acquires information on a face image selected by a user from among face images posted by a contributor on a predetermined service (step S201).

[0078] Based on the acquired information, the information processing device 100 generates makeup information for generating a face image in which the same makeup as the poster's makeup used in the face image selected by the user is applied to the face image (step S202).

[0079] The information processing device 100 applies the generated makeup information to the face image of the user selected as the application target, thereby generating a face image to be provided to the user (step S203).

[0080] The information processing device 100 transmits information for displaying content including the generated face image and content explaining the cosmetics used by the poster for makeup (Step S204).

[0081] 7. Modifications The information processing system 1 according to the embodiment described above may be implemented in various different forms other than the above embodiment, so other embodiments of the information processing system 1 will be described below.

[0082] In the above embodiment, the face image of the user after the makeup information is applied is displayed on the user terminal 10, but the present invention is not limited to this example. For example, the face image may be displayed on a terminal device of another person who communicates with the user online. For example, when the user selects a face image of the poster in order to participate in a conference online, makeup related to the selected face image may be pseudo-applied to the face of the user participating in the conference online, and the face image to which the makeup related to the face image selected by the user is applied may be displayed on the terminal device of the other person. Then, when the user participates in a conference using the poster's makeup, the user may be charged according to the usage status such as the usage time and frequency of use. Then, a process may be performed to give a part of the amount charged to the user as a reward to the poster. As a result, the made-up face is displayed to others online, so that the user can participate in the conference with his or her bare face.

[0083] In this case, the application unit 133 applies the makeup information generated by the generation unit 132 to the face image of the user being captured in real time, thereby generating a face image to be displayed on the terminal device of another person in real time. The generation unit 132 uses the face image generated by the application unit 133 to generate information in real time for displaying the face image in which the makeup information is applied to the face image of the user on the terminal device of the other person. The provision unit 134 transmits the information generated by the generation unit 132 to distribute the face image to which the makeup information is applied by the application unit 133 to another person who communicates with the user online in real time. The determination unit 135 determines a reward to be granted to a poster who posted a face image selected by the user according to a usage situation (e.g., usage time and usage frequency) in which the face image generated by the application unit 133 was used online. In other words, the determination unit 135 determines a reward to be granted to a poster who posted a face image from which makeup information is generated according to a usage situation of the face image to which makeup information is applied to the face image of the user. The application may be performed on the user's cloud, in which case the providing unit 134 may provide, for example, only the right to use the makeup information. Then, the user may exercise the provided right to use the makeup information to cause a face image with the makeup information applied to the user's face image to be displayed on another person's terminal device.

[0084] 8. Effects As described above, the information processing device 100 according to the embodiment includes the generation unit 132, the application unit 133, and the provision unit 134. The generation unit 132 generates makeup information for generating a face image in which a similar makeup to a predetermined makeup is applied to a face image of a poster wearing the predetermined makeup. The application unit 133 applies the makeup information generated from a face image selected by the user from face images posted by posters satisfying predetermined conditions to the face image of the user. The provision unit 134 provides the user with content indicating the face image to which the makeup information has been applied by the application unit 133 and content explaining the items used in the makeup.

[0085] In this way, the information processing device 100 according to the embodiment can appropriately meet the desire of a user to instantly check whether or not another person's makeup suits the user.

[0086] The content includes information that allows a user to access a predetermined online shopping mall where the user can purchase items by performing an operation on the user.

[0087] As a result, the information processing device 100 according to the embodiment can appropriately direct customers to a predetermined online shopping mall where products used for makeup by other people can be purchased.

[0088] In addition, the information processing device 100 according to the embodiment further has a decision unit 135 that decides that when a user purchases an item in a specified online shopping mall, a reward corresponding to the user's purchase should be awarded to the poster who posted the facial image selected by the user.

[0089] This allows the information processing apparatus 100 according to the embodiment to appropriately motivate posters to post face images.

[0090] Furthermore, the application unit 133 applies makeup information generated from a face image selected from face images that are preferentially selected or displayed based on a predetermined criterion.

[0091] As a result, the information processing device 100 according to the embodiment can provide appropriate information to the user based on a predetermined criterion, and can therefore more appropriately meet the desires of the user.

[0092] In addition, the application unit 133 applies makeup information generated from a facial image selected from among facial images selected or displayed with a higher priority based on a priority order determined based on at least one of the user's facial information, physical information, or product purchase history.

[0093] As a result, the information processing device 100 according to the embodiment can provide appropriate information to the user based on face information, body information, product purchase history, and the like, and can therefore more appropriately meet the user's desires.

[0094] In addition, the application unit 133 applies makeup information generated from a facial image selected from among facial images selected or displayed with a higher priority based on a priority order determined based on at least one of the access history, purchase history, and evaluation history for the facial image.

[0095] As a result, the information processing device 100 according to the embodiment can provide appropriate information to the user based on the access history, purchase history, evaluation history, etc. of the face image, and can therefore more appropriately meet the needs of the user.

[0096] In addition, the application unit 133 applies makeup information generated from a facial image selected from among facial images selected or displayed with a higher priority based on the priority order determined based on the total price of the items.

[0097] As a result, the information processing device 100 according to the embodiment can provide appropriate information to the user based on the total price of the items, and can therefore more appropriately meet the desires of the user.

[0098] [9. Hardware Configuration] Moreover, the user terminal 10, contributor terminal 20, and information processing device 100 according to the above-described embodiments are realized, for example, by a computer 1000 configured as shown in Fig. 10. Fig. 10 is a hardware configuration diagram showing an example of a computer that realizes the functions of the user terminal 10, contributor terminal 20, and information processing device 100. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

[0099] The CPU 1100 operates and controls each unit based on a program stored in the ROM 1300 or the HDD 1400. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, programs that depend on the hardware of the computer 1000, and the like.

[0100] The HDD 1400 stores programs executed by the CPU 1100, data used by such programs, etc. The communication interface 1500 acquires data from other devices via a predetermined communication network and sends it to the CPU 1100, and transmits data generated by the CPU 1100 to other devices via the predetermined communication network.

[0101] The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 1600. The CPU 1100 acquires data from the input devices via the input / output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input / output interface 1600.

[0102] The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0103] For example, when the computer 1000 functions as the user terminal 10, the poster terminal 20, and the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control units 14, 24, and 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, these programs may be obtained from other devices via a predetermined communication network.

[0104] [10. Other] In addition, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0105] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0106] Furthermore, the above-described embodiments can be appropriately combined as long as the processing contents are not contradictory.

[0107] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be embodied in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the forms described in the Disclosure of the Invention section.

[0108] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit", etc. For example, an acquisition section can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0109] 1. Information Processing Systems 10 User terminal 11 Communications Department 12 Input section 13 Output section 14 Control section 20 Poster's terminal 21 Communications Department 22 Input section 23 Output section 24 Control Unit 100 Information processing device 110 Communications Department 120 Storage section 121 Contributor information storage unit 122 Cosmetic information storage unit 130 Control section 131 Acquisition Department 132 Generation part 133 Application section 134 Provision Department 135 Decision Section 141 Receiving unit 142 Transmitter 241 Receiving unit 242 Transmitter N Network

Claims

1. A generation unit that generates makeup information for generating a face image in which makeup similar to a predetermined makeup is applied to a face image of a poster wearing the predetermined makeup; an application unit that applies makeup information generated from a face image selected by a user from face images posted by a contributor who satisfies a predetermined condition to the face image of the user; a providing unit that provides a face image to which makeup information has been applied by the applying unit; having the providing unit provides to the user explanatory content including at least one of a brand, a product name, and a sales price of a product used in the makeup and which is linked in advance to each face image of the poster, and including information that allows the user to purchase the product; 23. An information processing apparatus comprising:

2. The information on whether the product can be purchased is information that allows access to a predetermined sales site where the product can be purchased.

2. The information processing apparatus according to claim 1,

3. a decision section that decides, when the user purchases the product at the predetermined sales site, to give a reward corresponding to the purchase by the user to a poster who posted the face image selected by the user.

3. The information processing apparatus according to claim 2, further comprising:

4. The application unit includes: Applying the makeup information generated from a face image selected from the face images that are preferentially selected or displayed based on a predetermined criterion 4. The information processing device according to claim 1, wherein the information processing device is a computer.

5. A computer-implemented information processing method, comprising: A generation step of generating makeup information for generating a face image in which makeup similar to the predetermined makeup is applied to the face image of the poster from the face image of the poster wearing the predetermined makeup; an application step of applying makeup information generated from a face image selected by a user from face images posted by contributors who satisfy a predetermined condition to the face image of the user; a providing step of providing a face image to which makeup information has been applied by the applying step; Including, The providing step provides the user with explanatory content including at least one of a brand, a product name, and a sales price of a product used in the makeup and which is linked in advance to each face image of the poster, and including information that allows the user to purchase the product.

23. An information processing method comprising:

6. A generation step of generating makeup information for generating a face image in which makeup similar to a predetermined makeup is applied to a face image of a poster wearing the predetermined makeup; an application step of applying makeup information generated from a face image selected by a user from face images posted by contributors who satisfy a predetermined condition to the face image of the user; a providing step of providing a face image to which makeup information has been applied by the applying step; on the computer, The provision step includes providing to the user an explanatory content including at least one of a brand, a product name, and a sales price of the product used in the makeup and which is linked in advance to each face image of the poster, and including information that allows the user to purchase the product.

2. An information processing program comprising:

Images